Finally got to Novigrad yesterday.. I keep ending up doing side quests and stumbling across PoI's that distract me. Also keep playing Gwent. I spent ages facing a guy repeatedly till I beat him, he was super hard.. And I got a crappy card as a reward :'(
I think my main complaint in the game so far is the lack of feeling like I'm progressing. I guess the whole armour/weapon side of things is supposed to be fairly slow and straightforward but I'm used to constant upgrades and cool goodies in chests. Most of the time it's a rake.
I also never quite feel immersed in the game. And I'm not sure why. I've turned a lot of HUD stuff off which has helped a bit but I am still always semi aware I'm playing a game if you get what I mean. I think it's a mix of the third person camera and the more vibrant than real life colour to everything.
If you ask me, you should focus on hoarding crafting ingredients (They are weightless, so don't worry) and collecting Witcher sets diagrams (Wolf, Cat, Bear, Griffin).