Don't pay too much attention to teachers. I remember a teacher telling me that I should 'try to be more sensitive to people around me, not to be selfish and join in!'...... If he'd been even slightly sensitive to the people around him, he'd have noticed I was being backstabbed badly, and couldn't possibly function normally because of it.
My point is, don't take it as a personal slight from a credible source. I didn't challenge what he said until later in life just because he was an adult and I was 16. It's only what he thinks, and he's wrong. Just because he's older doesn't mean he's necessarily insightful.
I still regret not taking it up with him though. So maybe you should just explain your problem - purely for your benefit, as you know, it's frustrating being misunderstood. But if you can be sure it won't bother you in the future, then let it go.