If the Dr. leaves behind fragments of a broken tooth you should go back to the same Dr. who did the extraction and have him evaluate the tooth fragments.
To prevent an infection and specifically a very painful abscess, it is necessary to have a dentist remove any remaining broken teeth after a dental surgery.