Sex is one of those things that's only a big deal when you're not having it... sort of like food. If you're starving, you get weaker and weaker until finally you get some and it tastes and feels like the best meal you've ever had. But if you have lots of food to eat every day, you just take it for granted and don't really think so much about it.
So while it doesn't make you happier in the long run, I can definitely understand why someone would be upset about not getting it.
Anyways, I was in the same boat for a long while.
It wasn't so much that I wasn't able to attract women as I would hide away all the time feeling sorry for myself... and when I did go out I would sabotage my own chances because I didn't feel worthy, which in turn made me want to hide away again. To be honest, I think I felt even worse when someone found me attractive because I felt like I would have to either reject them to protect my 'space' or my privacy, or try to live up to what I thought their expectations of me were-- and the expectations were always probably too high.
This eventually lead to me trying to convince myself that it was fine to be this way, that I could still be happy and of course the usual hostility towards 'mainstream' society... basically, I would tell myself and others anything I could to attempt to avoid the shame and that sense that I was wasting my life.
Finally, I had an opportunity, decided I had been a virgin long enough, and went for it. It wasn't exactly the special, loving, tender moment I had always pictured, but it happened. It wasn't some big exciting change that made me think of the world in a different way, either... but I have to say, it was good to get it over with so I would stop worrying so much about being a virgin, stop being so afraid of being judged for it, etc.
So in some ways, it was a good experience that helped me to feel more confident. As much as people want to portray FWB or 'casual' sex as something that causes only despair, being a older virgin is probably worse... though I suppose it depends on whether or not you can be okay with it. I know I wasn't okay with it, even though I constantly told myself that I was. And in the end, it really wasn't such a big deal... sort of like ripping off a band-aid. And it definitely doesn't mean that I'm incapable of giving or receiving love.
Others might not agree, but I think that loneliness is probably the worst form of agony there is. I'm saying this as someone who is definitely an introvert, uncomfortable at large social gatherings, and anxious as hell in situations that others wouldn't be. Human beings need each other... I'm not saying they need EVERYONE else, but they do need at least one other person to feel complete and be happy. At least, that has been my experience.
I'm not saying go to a prostitute... but you might want to consider looking for a different type of girl.