Always wear a sweatshirt with a hood on it so you can pull it over your ears and head. Also, it is a good idea to bring coffee or hot chocolate. Finally, make sure to wear mittens or gloves for your hands.
Dressing in layers usually helps people stay warm. Depending on how cold it is, start with a long sleeve shirt, then a sweater, then a jacket. Wear thermal underwear too.