I don't know what a magic eraser is (I know what it is conceptually, but I have no idea what it's made of) but it may well be your problem now.As wayne says, it's probably oxidation, but it may be the oxidation of residue deep in the brush marks of the metal.
Before I tried anything else I'd try the Never Dull again (the cotton batten impregnated kind?) by itself, or some Brasso and a clean cotton rag, something like that.