I agree with you on the blackwalls. Does the linseed oil change the color of the bare metal to any degree?
I've never had it change the color of bare steel before, maybe if you put it on to thick it would discolor it a little. The oil is naturally a translucent yellow.