No, as long as you upgrade carefully (e.g. upgrading pairs rather than having odd speakers competing) they should be fine. I can't afford to upgrade my system all at once, so I rarely have everything from the same people, but the sound quality is good.