I'm not too sure that there is more energy in the higher frequencies. One reason I think that is, in a 2-way speaker, most of the amp power is going into the woofer, not the tweeter.As far as frequency dependence on hearing damage goes, I've never heard that referenced. We have to go through an annual lecture on hearing protection and related OSHA matters, and all they ever mention is SPL (over 85 dB). They never mention spectrum at all.
What seems to dominate is rise time and peak level - a very loud impulse might permanently deafen you instantly, as opposed to a prolonged exposure to 100dB.