Balance is the key to success in just about every philosophy.
I remember hearing the Dalai Lama (who's catchphrase is "loving compassion) talking about times when compassion isn't appropriate. Like if a mad dog tries to attack you. The appropriate response is fear, and fight or flight. Which is the opposite of compassion. Self preservation is important. But self preservation becomes selfishness when it's not necessary.
Unfortunately our moral compass is very easily swayed. It's very easy to tap into fear and create mob mentality. Fear of being rejected by our peers, fear of an outside "boogieman", fear of losing the balance of power.
I have found most people don't understand (or respect) equality, which ethical liberty, in its pure form, has to include. Or they just don't care. "I am happy for everyone to be equal on my terms."
Extremes are the opposite of balance. They are mere places for mini tyrants to entertain their delusions of superiority.