Oops
I'll leave it there and let everyone think I'm an idiot then. I skimmed the episode list to remember the early episodes and misconstrued it as being earlier than it was. Everyone proceed to stone me.
I don't think I'd say a long time still since I think Tiger Millionaire is an easy place it takes off which is after only an hour and a half of run time. Then you start getting into the shit of Fusions and Sword Fighting and it's a snowball from there. I wasn't hooked immediately either, but I think saying Steven's a shit kid for at least 20 episodes is still a little much.
It is a bit much but its a pretty common opinion. I know a lot of people dropped it early on cause they just simply did not like Steven which is a bit sad but understandable since your not getting attached to the main character.
Its not like Adventure Time where you can just pick it up anytime cause Finn and Jake are just goofy likable characters. Same with how Regular Show is and sadly those two shows aren't looking that great these days.