Yes. This is the main selling point of all the advanced audio players and equipment that have made their way to us through the years. Streamed music will never degrade in quality.
I look at it this way though: Playing old music on old technology takes me back to that time. Elton John records on a turntable will transport me back to 1975, and that's a good feeling to have.
I totally agree with what you said here. The thing is that sometimes, it is about having that experience and not necessarily about the sound quality. Playing old songs on some older devices brings back those memories and that is what I would like to experience.