Headphone jacks usually come off a dedicated sound card, which means it can do a lot of the sound refinement up front. USB comes off a standard USB socket which rarely has specialist sound processing so the speakers or headphones matter a lot more as the conversion to analog is done by them.