I have similar problems with a lot of earbuds out there. I thought the same thing - that I must have really weird shaped ears. Then my friend pointed out to me that it's probably because I happen to sweat a lot, even when I'm not working out. So, I tried out the Phaiser BHS-750 Headphones that are sweatproof, and they've been awesome. They're usually pretty pricey, but if you have Amazon Prime you can get them for around $45 right now.