I agree with you 100%. As someone who suffers from SAD (Social Anxiety Disorder) I really sort of get where you are coming from. I'm lucky enough to work with a very small group of people so it makes things easier. Small doses.
Various people have their own personal problems, when together with others, socializing, these small personal problems come out and flame others, metaphoric speak, for example a flame catches on to other things and increase in volume. These problems is what cause people to generate such various problems between socialize places in society. For me is been bullies in school, deception, dishonesty, robbing, and general negativity. Though now i don't go to school is just basically people around neighborhood are the new problem, of course crime in general in the neighborhood is a problem so i'm not surprised.
Various people on edge with many things, not trusting people, not wanting to be bothered with people, selfishness, everyone for themself. I dunno, is just a different time where things get bad and keep getting worst than better. The idea of no one looking out for each other especially when the lesser person can use it, is just bad sight for sore eyes. Besides that, me on the other hand, i just rather have something to look forward to than just have to deal with so many different things that make it seem like i have excuses for my lack of (whatever it is i do or say) that isn't helping me or anyone. I don't want problems or trouble, with other people talking bad about me, to me or against me, while it will happen regardless of what i want, is just a matter of how to deal and cope with it.
Find a place to have people you can get along with, i don't need diagnosis with aspergers, i don't need to be told something about me is uncommon, i need people i can get along with being the way i am and accepted for it. Not convert me to a more desired person or expected personality to fit with others.