I don't personally know you lol, but if your boyfriend is saying it then maybe he is genuinely meaning that and thinking it. Maybe he's actually right, what if it's just your SA acting up again. People always tell me I'm pretty and smart and talented...it's hard to believe them because my confidence is currently non-existent and my whole life I've been ridiculed for some reason. But then I ask myself, what are they gaining by lying to me? Maybe they ARE telling the truth. Maybe I am all the positive things they described me to be. Perhaps I just don't see it yet, even if it's there.
Maybe what your boyfriend meant to say is that people will have their own opinion of you whether positive or negative (everyone has an opinion) and that if anyone tries to pull something against you, don't let it get to you?
That's my interpretation...I think.