There is nothing wrong with new equipment as far as I am concerned.
The most important thing is the cartridge, IMO, and making sure the platter spins at precisely 33 1/3.
When going out to get an amplifier, make sure it has a phono pre-amp. One of the inputs will be labelled as "phono" or indicate that is where the record player's output goes. Without this pre-amp the sound will be incredibly quiet with nothing but tinny high end.
Thanks a lot for the advice. I have copied and printed this for me to check when I buy the vinyl player. I just need more money for this investment but I'm sure it will be worth it.