Perfection is the goal for sure!
The orange pads are definite dust storms by nature if they aren't almost saturated with anqd, they are dense, and designed to cut, so I agree they are the main culprit.
Might I suggest adding a pea sized drop of finishing glaze to keep the polish wet and...