me too , even when is a group of known people, and situations of stress, possible fights or when i need to confront a argument, things like this...
when i'm one by one with someone i know for a fair amount of time i'm alright, but sometimes i do restrain myself to try not being "against" someone, or fit someone expectation.
it's complex... basically always with someone i don't know and groups, and sometimes with people i know.
but i never get a anxiety attack or panic (but today i think i almost passed out)