Give it time. If you broke-up with him, you had good reason to... trust yourself. You can love someone, and miss them, even though they're not right for you.
You might feel bad because you regret breaking up with him. Rethink your decision, and make sure you did what you really should have done. Also, you might feel bad just because breaking up is not an easy thing to do.