I would also suggest that you find a 10-15 minute period everyday to play with the cat. Twice a day would even be better.
We raised three children, while having three large dogs (this was before we had cats). We did not forgo walking the dog or playtime with the dogs with a new baby. When my husband came home from work, I got some dog time. When I fed the babies, he would play with the dogs. Just switch out the word dog for cat and you will have a happier cat.
Skin kids - Jason, Kevin, Allison
Canine kids - Bennett & Bailey (always in our hearts), Riley, Banker, Rogue and Boz
Feline kids - Zoey, Talley and Abra