The best thing I've found to work are Mr. Clean magic erasers. They're fairly inexpensive and usually do the trick pretty quickly. I've used them on anything from glass to bathtubs to walls.
Goo be gone removes crayon from everything. You could also just try to scrape the glass with a blade form an exacto knife. After this you can use windex to break up the rest of the residue.