Most insects spend at least part of their life in the ground. You may be seeing adult females boring in to lay eggs, for instance. Does the "bug" have hard, shiny wing covers? If so, it's a beetle. Really long back legs? Cricket or grasshopper. Wasps dig in, too.