A dog's nose is often dry when they are perfectly healthy. They keep it moist by licking it normally. You're better off providing humidity in the room.
No, you should visit a vet. Dry nose can be a sign of temperature of dehydration and both are serious problems and should be taken care of immediately.
