Aww. Bless you!! Yes, I think some don't realize how much they love cats until they are fully exposed to one. I hope your hubby will grow to love her too! Feel free to post with any specific questions. We'd all love to see a pic of the girl and many of us have ideas for names.
You may want to call the vet and start to arrange for a primary provider for kitty. Especially since she is so young, she may have needs albeit temporary during this fragile time. The vet will also help in identifying any active health issues earlier before it gets too costly or uncomfortable for kitty.
I remember getting our first cat in our new home with my bf. He never had one before and was so overwhelmed. This is what we did to accomodate Snowy:
-buy a litter box
-buy kitty litter (our fave is Tidy Cats Clay, it is less allergenic and quite cheap, best odor control I've had)
-buy some toys
-get a scratching post to train kitty to use that instead of furniture early on
-get some food bowls
-get multiple water bowls throughout the house for good hydration
-get a brush
-get a nail clipper especially designed for cats
-get a toothbrush and paste for cats (much easier to train them early and avoids lots of expensive dental care when you brush them regularly)
-buy a small warm bed
-buy cat food (your kitty will start off with soft and work up to dry if you like)
This is what I taught my bf (lol) as I had a cat as a child:
-provide kitty with a "safe zone" e.g. the bathroom by the litterbox, this reduces anxiety while at the same time helping kitty remember where the box is to avoid accidents
-clean the litter daily
-this encourages kitty to pee and poo more and helps avoid medical complications from doing too little of either
-with clay litter, we scoop out the poo daily and add litter as needed for the pee to be covered, then all the litter
is changed on Sunday, we use pan liners for easy disposal
-not sure if your kitty is litter box trained yet, but I'm sure forum members have good tips
-clean the food and water bowls regularly (I do daily)
-again, encourages eating and drinking
-consistent play and love to socialize the baby
-if there are behaviors you want to curb e.g. scratching furniture, jumping on dining tables etc. I'd be sure to
-very consistently give a stern "NO!"
-very consistently reward kitty for acceptable alternative behaviors e.g. using a scratching post and giving a treat
Hope this gives some start
Edit: btw, I forgot to mention, you can try going to the local shelter, some of them have nice starter packages for very cheap and often good quality items. Plus, the proceeds go to the shelter!