I have the same thing with my towels feeling 'rough', I wonder though if its not just something microfiber towels do, especially if they get older?!
About removing swirls, I bought the Pinnacle Advanced Swirl Remover and Pinnacle Advanced Finishing Polish. Still need to receive them so I can't...