Go for it. Might have to use contact cement and it cant get any worse that that in itself.If you scuff the plastic you might get an epoxy to bond. You'll have to experiment with bonding agents. You could try some of that silly peal and stick veneer for fun if that will bond.
Extra flat veneer. Cut the pieces to fit like you would marquetry. The fate of the job will lie with the glue