Try to make sure that you have your right elbow tucked in by your ribcage. This is if you are right handed. This should make you start drawing the ball. Try to make sure you are not leaving your club face open when contacting the ball.
A push means your club face is open at impact. Make sure the club is square at address. During the swing turn your hands over to get the club square at impact. To compensate a push you can also adjust your grip to a stronger position.
If you generally push your golf shots you probably are making good contact with the ball but are not following through on your swing. Usually this is a result of slowing your downswing.