This is not a one night stand, it is a relationship. He is not leaving because he cannot forgive himself. He is leaving to be with the other woman. If you try to make him stay, realize that he will still cheat. Contact a lawyer to take preventative actions in case of divorce.