Hard to say without knowing what's causing your symptoms. If it's a virus, it's unlikely you could pass it to your cat. Most common viruses aren't transmissible between humans and animals. If your conjunctivitis is being caused by a bacteria, then, depending on the bacteria, it could be passed to your cat. Although I don't think the risk is high, I suppose it's a good idea just to wash your hands BEFORE handling your cat.