Placing multiple cotton balls soaked in oil of peppermint or citronella around your home's foundation, at the spot where you suspect mice are getting in should be very helpful.
I live on five acres and mice are always a concern. A natural way to repel them is to use peppermint oil, just soak a cloth or cotton ball with it and put it in the problem area. Apparently mice don't like the smell and will stay away.
Peppermint Oil and Citronella are natural rodent repellents. You can get candles that will repel rodents or you can use cotton balls and place the material around the outside of your house. It is a perfect way to get rid of unwanted pests.