The correct answer is there was no reason.
There was actually a reason but it was never stated publicly and it was because of all the affairs that occurred between them. They went to France to live outside of it all and not deal with repercussions and save their marriage.