One thing I've come to hate so far is an unorganized environment. I get angry when it's not coming from me or someone close; imagine saying the same thing over and over again. I understand how you must have felt at those moments. People see minimalists from a different perspective which is different from yours.
Getting them to understand can be very difficult, applying empathy is the best approach to avoiding such situations.