I think the time warp theory can be discredited as I believe the authors are using something similiar inside; Parallel existence . Thus there is likely more than 6 that get off the island depending on which piece of the 'time threads' one ends up on.

A simple clue is all those passports of Bens. Could they all be correct and not forgeries?