Well like most folks you have hit-idus; a magical disease that exist only in your mind.
One way to get over it is to line up 10 or so balls straight in a line either teed up or on the ground. Step back and take a few practice swings, back and forth without pausing, then walk into the hitting them with the same rhythm and tempo. In otherwords you are going to have to learn to trust your swing.