I've noticed that mine drops when I have more than one set of Bluetooth earbuds nearby. See if that's your problem. I'm not a massive fan of AirPods, but they're good enough for working out, which is what I primarily use them for. I also like that they charge quickly.
Those this happen when the other set of airpods have been connected to the device in the past?