Well, coming and going to and from the island on the wrong bearing seems to have some unpleasant consequences. Such as uncontrolled time-jumping and death. Maybe the doctor was able to float to the island because he was already dead, and maybe that's why he arrived before he left. because his dead body did a little time jumping while it was floating in.
I don't know, I'm just making guesses
