I think that most people have an image in their minds about what a certain type of person that listens to certain genres. For instance, metal listeners tend to look a little grungy, whereas rappers tend to where a lot of jewelry and have grills. If you want to stop someone from pigeon holing you, stop doing the actions that get you put there. Change your look and scare the crap out of them.