Yes I have been called handsome on quite a few ocassions, and my girlfriend thinks I am attractive obviously. Still, I am very self-aware because of my teenage years when I was often on the chubby side, and people were very rude about my looks in general, wether it's weight, clothes or hair. And I think so too when I look back at old pictures that I looked like crap. It was actually at the end of highschool and i had grown in looks and started taking on a "style" and as a result a happier and more outgoing personality, that people started to act friendly and interested in me.
Anyway those years where I was treated like crap, even by friends, still are with me, and that results in self-awareness about looks to this day. Even though I know I look atleast presentable, it just stays with you, no matter how many times people say you look good. Kind of like a Dr. Jekkyl and Mr. Hyde thing; because you heard so many comments in your life about your looks that GREATLY differ in nature you forget who you are and are insecure about it.
Anyway, I personally don't think looks are that much of a big deal. It's really personality that makes me like a person. There are a lot of attractive people who have a rotten personality.