I'm pretty sure I'm in the same boat as you, only it's one of the wires going to the CD player rather than a speaker.
Is it a speaker in a door? If so, you'll probably have to remove the interior door panel for access to the speaker. Then you should be able to just pull the speaker right out and fix the wiring.