I think that originally he did not see the two women in his flashes. But he tnen offered to switch with Charlie once he realized that they would be down there.