You probably just need to be more open and tell them what's really bothering you. If you've got a good counselor, you'll get the help you need. Just be honest. He's not there to judge you, but to help you in any way that he knows how. You sound like you need to talk to someone, so I'd give it another shot if I were you. As long as you voice you concerns, he'll lead you in the right direction. It's going to take time, but this kind of thing always does. Hang in there, and I hope you find the help you need.
Peace