It is. If proper care of the stitched wound is not given, infection will result. This is because the skin still has some openings in it, along the wound, where infection can enter.
No, this is not at all common, though rarely some people can react to the stitches themselves. Any sign of infection should be treated as serious and dealt with accordingly.