Something that many people have had luck with is this:
Be sure you are alone in the room with him. No other kitties should interupt.
Sit on the floor near (but not too close to scare him) your kitty. Talk in nice soft tones and remain as still and calm as you can. (make sure you go to the bathroom first, you may be there a while)
You could also read aloud softly. Keep a comfortable distance. After a while, he should come out to look at you. DON"T immediately reach out to pet him. Let him come to you. When he does, praise him and pet him. Reassure him that it's ok. Don't pick him up or try to force him into a position. He needs to be "in charge" of the situation. After a few times, move to sitting in a chair instead. Eventually, he will grow adjusted to your presence. Whenever you see him, remeber, soft tones. Reward his actions with treats or play or petting.
This takes time, but it does work. Both of you should do this if you want to have a good relationship with him.
Also keep in mind, that some cats are very shy. He may get better but not be as social as you other cats. It's ok. That's his personality. He'll find ways of bonding with you that are uniquely his.