I too learned this the hard way...and in the kitchen no less (some of the window and drywall are protected for quite some time now).
I think what makes the original cap leak is the absence of the little cardboard disc inside the cap. Sometimes that comes off the first time you open and sometimes it will stay in there through a couple openings.
Mine never leaked while keeping one finger on the lid, but I did transfer most of it to a Meguiars bottle with the clean tip. Those lids don't tighten real well either, so make sure and hold it down when you shake that as well.