You probably do it to generate power...use the stick at the range and don't worry at first about how far it goes just learn to stay behind the stick (pivot) and hit it straight(ish)...once you get comfortable with it you can begin to apply a little more power while still maintaining control. It'll feel strange at first but if you think moving laterally is causing you control problems then it'll be worth the time invested in fixing it. Good luck with it. Btw there will be others reading and contributing to this thread so please report back any results, even if they're negative ones so that way someone can suggest something else.
A well-balanced and well-executed golf shot is like a graceful dance move...seemingly effortless but a lot harder to do correctly than it appears.
Stay behind the ball.

Shade