I was thinking more along the lines that if Desmond wants to save Charlie he is going to have to sacrifice being with Penny again.. Or vice versa Having Penny again he is going to have to let Charlie die!

__________________
Please don't give up, Des. Because all we really need to survive is one person who truly loves us. And you have her. I will wait for
you. Always. I love you, Pen

DESMOND: I love you, Penny. I've always loved you. I'm so sorry. I love you!
PENNY: I love you too.
DESMOND: I don't know where I am, but--
PENNY: I'll find you, Des--
DESMOND: --I promise--
PENNY: --no matter what--
DESMOND: --I'll come back to you--
PENNY: --I won't give up--
BOTH: I promise. I love you.