From what I can tell, the controller "lag" happens when you move the Wiimote too fast and it loses track of where it is relative to where it should be. Generally speaking, you don't need to flail your arms and wrists about as there's plenty of time to follow through naturally. Best advice I can give for people who are having trouble is try to centre the Wiimote in front of you after every shot.
That seems to be part of my issue. First of all, I think my swings were too big, secondly, if they're too fast then it can mess with the calibration. The controls seem rather sensitive and specific, without much room for error, and judging by reactions here it seems like it just doesn't click for some people. It still hasn't for me. I had the same issue with Swordplay in Wii Sports Resort.