When you have facial hair loss it means that you either don't have hair or you are losing facial hair. This could be brought on by age, stress, disease, or genetics. In some people hair loss is hereditary. In others hair loss comes with age or health issues. Others just lose hair over stress.