Despite what many men believe, they might not have all the time in the world when it comes to having children.