I got it at release for PS3, and I finished it twice. The second time was for a gold trophy.
I didn't hate it from the beginning, but I do remember the building set of disappointments. Oh, it's not the same Liberty City as before. Oh, this and that feel slow. Oh, there's no tanks. The gradual realisation that 4 is nothing like 3-SA, which replaced the fun with bowling.
I remember doing police missions and my car flipping over on a low speed corner. I don't know if that was the straw that broke the camel's back, but it is the lasting impression I'm left with.
The game isn't without merit, and I had hoped to return for the DLC years later since I own it all in PC, but Rockstar decided to fuck with it all and unless it's been fixed recently by modders it's said to be an absolute mess. However, the last time I played the base game on PS3 I couldn't do it without cheats because the fast cars make the driving more tolerable.
Forget Paul McCartney conspiracy theories, Rockstar is the one who was replaced and it happened after San Andreas was released.