Sounds just like what you see on a lot of older alloy wheels with a clearcoat, like old Ford wheels. It starts to oxidize and/or flake off.
If you wanted to DIY, you could make sand it down and re-clear it, or else take them to a powdercoater and have them re-done in silver/any finish you...