You're not a freak for feeling this way, first of all. I guess freak means rare behavior, that's about it, but it seems common place for this community. I know i jumped at the title because i relate a lot, although I live with my mother and younger sister, and even though they are family and i know them better than anybody I felt this way. To me at least it's not trusting that people are being their deeper, more caring selves, the way I am to most if not all others. I'm afraid that people are shallow and care about things i don't, so i'm paranoid they see me differently.. Idk hard to explain. But I don't think it's freakish ESPECIALLY with roommates, you might have the requirement to get to know them on a really deep level before you let them into your personal space, and they are in your house, your personal space already.
I should add that it could just be a matter of being a person with high priorities on personal space and boundaries, or it could be a matter of spending so much time alone. just speaking from myself