Why are they so rude to Sawyer?

Rewatching Lost, I forgot how completely and idiotically rude everyone is to Sawyer. He didn’t do a damn thing to any of them.