I don't think that's it. I think highly anti-social behavior is often deliberate, looking for someone to challenge you. An exertion of power. That's why pretty much everyone learns to ignore the behavior and not say anything.