Well we all know how much Richard likes to recruite people he could have brought him there also..

Or they killed him and that is why smokey was able to take on his form ( I know Benmer won't agree)hehe.. Kidding Ben =)

__________________
Please don't give up, Des. Because all we really need to survive is one person who truly loves us. And you have her. I will wait for
you. Always. I love you, Pen

DESMOND: I love you, Penny. I've always loved you. I'm so sorry. I love you!
PENNY: I love you too.
DESMOND: I don't know where I am, but--
PENNY: I'll find you, Des--
DESMOND: --I promise--
PENNY: --no matter what--
DESMOND: --I'll come back to you--
PENNY: --I won't give up--
BOTH: I promise. I love you.