I think it is pretty well accepted that high handicapped golfers are not going to be able to hit a driver very well. You are probably putting a lot of side spin on the ball because of your swing plane and angle of attack into the ball. You can get away with this with the irons to a certain extend but the relatively flat face of a driver is unforgiving. Get some lessons to develop a better swing and the driver will take care of itself. No quick fixes are going to help you much. You would score better probably by using a three or five wood.