"Any thoughts on why I shouldn't continue cleaning this way?"

Because you'll permanently damage or destroy the clay composition of the chip you're "cleaning". The red color that came off on your cotton swab was part of the clay being dissolved.