For me, it becomes a fatigue issue, but the situation changes. Did a boat yesterday, and ended up in flip flops because I kept trashing the back of the boat climbing in and out.
Running shoes seem to work well for me now. I'm not doing a lot that can cause injury, most of the time, so it's hard...