I have a SE45 too. Not DRD though, but a WE91-like. When I used a 12AX7 in SRPP as driver, before switching to the WE91 config, that happened to me often. After some measurings, I came to realize that the SRPP stage was unable to fully drive the '45, and had severe rise time problems. I'd rather have distortion in the output stage than in the driver, but that is just my opinion.Bottom line, I think it could be that you are trying to squeeze too much output power and you are getting driver stage distortion.
Good luck
Gastón