What is so wrong with dressing "emo"?

I get called emo all the time, just because I wear tighter pants and t-shirts. But most of my t-shirts are either Misfits or other horror punk bands, and I don't act "emo."