It's about finding the right person to share it with. Life's successes, tribulations, etc, are not tickboxes on some spreadsheet of life. You do something because it has intrinsic value and meaning to you, otherwise, don't do it.
As wonderful as this kind of perspective is, I don't think it's very realistic. Your first time as some sort of holy act might have been the best way to look at it when people were getting married at 18, but not in the society we're living in now.
The way I looked at it was if I waited too long I'd end up passing my peak and never being able to enjoy it in the same way again. So yeah, for me it was more like a science experiment than a spiritual act-- a little scary and even a little tainted by traces of Christian guilt, but ultimately it was better than continuing to remain in the dark.
The way I look at it, waiting for that special someone is like refusing to travel or refusing to do something you've always wanted to do because everything is perfect-- eventually you'll just keep putting it off and finally you'll be too old. I really don't think that not being a virgin is in any way a fair reason to reject someone... it's actually really offensive because there are people out there who aren't virgins not by their own choice, and just because that happened to them it doesn't mean that they're dirty or tainted or that they can never be the same again, so the same goes for anyone else.