I think it varies widely with how affected any one person is by it. For some people it is undoubtedly a disability. For me, I have managed to adjust my life to a point where the SA does not disable me....meaning, I have found a job where I work mostly on my own with animals; I live close to my family and center my social interactions around them (for better or worse); I am in a relationship with someone who does not make social demands on me; I have developed my own interests and hobbies to give my life more flavor and meaning; I have entrenched myself in certain volunteer organizations to the point where I feel comfortable showing up and being around those people while we work as a group.
In short, I have taken what I was given (a disability) and changed my life to make a "normal" routine possible. Before I had accomplished this, I would say I was disabled. But I think with work it is a disability that can be adjusted to and lived with, much like most physical disabilities. It does not have to be permanently disabling for any of us.