I've read information where it is actually unhealthy to use distilled water for babies because of the lack of natural minerals; it can actually pull vitamins/minerals from the body.
Distilled water is water treated and all impurities and minearls are removed. Purified water comes from underground source which contains minerals. This water is filtered when it comes to surface.