There's more difference than just the product. Taking the post-rinse step out of the equation, as you have hypothesized, you're left with the pre-rinse, the actual wash steps and the drying stage.
And here's the big difference: With a shampoo, you're agitating and loosening the dirt, not much...