You can have social phobia without being intimidated by everyone. I am very uncomfortable in certain social situations. For example, if a person has a mole on their face, I can't stop myself from staring while talking to them. I can't remember being intimidated by any individual though. Intimidation would mean I am afraid of them. I'm not afraid of them, I'm afraid of my inability to act normally around them.
I think I know what you are trying to ask but perhaps the question should be, "Who are you more uncomfortable around?"