Since youre asking for advice, I will give you mine.
You shouldnt add more anxiety to your life, and stress with a person who has anxiety does just that. Dont focus on sex, focus on finding the stability within yourself. A lot of times we start backwards with happiness. We think when I have money, when I have this job, or maybe even when I have sex and feel like some one needs me then, I will be happy. The reality is, it works the opposite. YOU must be the source of happiness for yourself. No one else can give you that. Sex won't give you that. Once you are comfortable with yourself (like in Buddhism acheiving Zen or satori) then you will be able to live life to its full potential. And ironically, then all those things will come with it.... the things you make yourself unhappy to acheive.
And I am staying a virgin till I am married. Obviously the world has a very different view on this subject than I do. I am well aware. But it has so far served me well and I in no way feel incomplete. I want to focus on people for who they are and not have to think about that. Then when I am married I look forward so much to being with my husband! We will share a bond that no one else will, and it will be special to US.
Whether you choose this route is up to you, but I highly suggest you rethinking what will REALLY make you happy. "Happiness doesn't happen someday when. It happens right now, whereever you are."