The only problem with that is you are trading out wash mitts, which are rinse-able and reusable, for clay bars, which are not reusable after a certain point.
Also, if the paint were heavily contaminated or just improperly "clay washed" you would essentially be rubbing your paint with a piece of...