Three things come to mind. you could be swinging outside in, ball is too far back in the stance, or you shift you WHOLE body including your head, forward on the downswing, meaning you lunge out the ball.