IMHO, if you're blot drying then that may very well be the cause of the streaks.. If you were to simply dry your paint off [I mean really dry it, instead of just delicately patting a towel of the paint] in the 1st place, you wouldn't have to follow up with a 2nd "dry run" with a towel. I believe that technique is what can lead to unnecessary swirls over time.
What kind of drying towel do you use? How long have you been using the same towel.
You shouldn't have any doubts about doing what you have to do in order to dry your vehicle with any quality microfiber drying towel, including waffle weaves. IMO you really don't need any "drying aids" either... IME they also cause you to have to rub the paint alot harder than you normally would if you weren't using them.
That's just my opinion though..