Yes, I would be concerned. There are several different things that cause seizures in dogs, and only a vet will be able to properly diagnose the condition. Seizures cause damage, so it would be wise to go right away.
A seizure is a very serious thing, you should consult your vet immediately. It may not be anything big, but it could be symptomatic of neurological disorder or certain diseases.