I'm curious to know this, too. I'd like to think cats might remember stuff 'from before' cause like when my one brother in law comes to visit (about every 2 or 3 mths.) Snowball goes crazy and is all over him. They're like best buds. One day Simone got into something and my husband said no to her and he said she cowered like he was gonna hit her or something. So, I often wonder if Simone didn't come from an abusive home. She doesn't care for women or children and it could have been because of situations in her previous home where there were children. Who knows what went on.
Both of my cats were very people friendly until we had someone come over with a very mean child. After that 2 day visit, if people come over, my cats are hiding for days. I have to go and find them and give them attention. I know all of their hiding spots Back to the point, my cats also dislike children until they reach about 4 years old. Even if a kid comes close to them, they will hiss.