I don't risk it anymore after someone tried to steal my old fungus infested deck shoes on RCL a few years ago. My only pair of shoes, I would have been pretty sour if I didn't catch the guy.
Now I have a bag with a combo lock with a wire to connect to a piece of furniture etc for my things when I am taking a dip.