You should have a heart to heart with your partner and discuss your feelings, it is important that you come to an agreement about what you want in life.
Human beings are very selfish. neutral family system is the reason of it. Children from there do not know how to share. I will make an awareness to my partner.
The partner who does not want more children should have the final say. Bringing in more children than the other wants creates major stress. But do discuss their reasoning.