I thought about this for a while, and at first I agreed with everybody. It's not possible to hate all music. I can think of one possible exception though. What if someone has a psychiatric problem and can't handle the emotions music brings out? If it causes too much sensory overload, then I could see someone preferring silence.
That's a good point. I didn't think about people with sensory processing disorders; they may find music too much to handle, since it's hard enough for them to sort out everyday sounds.