My cat Gandalf (actually, my boyfriend adopted him, but he lives with me and his other two siblings) didn't much care for me. I would pet him once and he'd walk away. They are all now going on 8 months old and with lots of time spent playing with him in particular, giving him a little bit of extra attention, petting him when he's sleepy, feeding him treats from my hand, and definitely not making him feel nervous or threatened by trying to grab him all of the time has helped a lot.
He has really warmed up to me, even lets me pet him now and will push his head against my hand and lick me! Such improvement. Cats just tend to be very cautious, especially once they understand they have free reign with really no limitations.
Although I do treat my cats like children. If they do something I think is wrong, jumping on the kitchen counter, I take them off immediately and say, "No," very firmly. Speaking strongly with them, but also rewarding them with praise and niceness will create a stronger bond with your cats. That's been my amateur experience, anyway, I treat them almost as I would babies. They do learn as long as there is an obvious consequence and obvious reward. And establishing that they know you as predictable and do not act suddenly.
I have a very, very skittish kitty who sometimes still runs away when I slowly move to pet her. With lots of speaking to her, lots of patience, turning my back to her as I slowly walk beside her so as to make her feel safer, she's extremely cuddly now and very, very affectionate. She has also come into her own independence amid the other cats.
Basically, it just takes time. ^_^