I cannot remember what the title was but what I do remember of the story is:
*The protagonist has some ability, either pheromones or by touch that any female will become his. He tries to control the ability (successfully eventually I think). But does end up with multiple wives.
*It may start when he is in High School.
*A policewoman/FBI agent/secret agent goes to investigate the protagonist and his family, but on meeting the protagonist becomes affected by his ability. She does not stay with protagonist but marries someone else and stays close by.
*Ending: The protagonist and his closest wives sail off from their grown up family due to them not aging like normal humans (they are human) due to his abilities. They plan to leave by faking their death by 'lost at sea' or capsized boat.