Don't do this. If you want to fit in with society and/or within a specific group, you need to be able to talk and communicate. Avoiding to talk, you'll just feel worse and paranoid about being the center of attentions because you're the only one not talking. If you want to fit in, you have to do it by joining others in the most common ways, and that begins in the communicational aspect, verbal and physical.
My father once said to me, when I felt terrified of attending my driver's license classes, that the best way to dodge anxiety and its symptoms was to mangle with others by taking the initiative and talk instead of waiting for someone to single you out.