If that was the only feedback, then yeah, but they were smart about it. When you're hitting your beats right, you get a little "Hey" or similar chant, and a little musical note over your head, so you get that immediate feedback, and then the hit syncs to the following beat.
I think when people start out, they're missing a lot of beats so they aren't getting that extra layer of feedback and the game just feels sort of lagged, but once you get the groove of it, it all clicks.
Excellent, that's the way to play. You'll get it, it takes a little bit to click.