You could be swaying from side-to-side.

Lots of things it could be.

I would suggest to take easy practice swings to "find" the bottom of your swing prior to addressing the ball.

Keeping your head DOWN too can help.