When you buy a CD, you own the CD. The copyright owner has no right to reclaim that particular CD, but he does have a right to restrict your use of it. The rights of the owner of the CD are pretty clear - He can play it for personal enjoyment. He can't use it for commercial use.It doesn't matter if the owner of the CD thinks the work is underutilized or not, the copyright owner is who ultimately has the right to decide whether it should be played publically. So if the copyright owner decided he wanted the work to be silenced, he has that right. The owner of the CD would still have the right to use the CD privately, but he never had the right to promote it publically, so no "rights" would have been rescinded.
"Fair Use" is a different issue. It has nothing to do with selling a single copy of a work that was purchased, like transferring title of a used car. "Fair Use" is the ability to talk about a copyrighted work, to maybe even quote parts of it or make a likeness of a copyrighted work, such as a parody.