I think you are pretty close to accurate on the timeline....we know he did not know Penny when he left the Monastary, so he had to have been there first. Plus, after he broke up with that other girl he was engaged to, he left and went to monastary.