buffs aren't given out until later in the game, when the jungler isn't relying on a single camp to get him an entire level.
listen, the jungle is hard right now. really hard. it hits harder, mobs respawn 100% later than last season, and now junglers only get 2 pots to deal with the increased damage output that the mobs do.
if you're taking the golems at level 1 you're not just putting your jungler behind. you're putting midlane and toplane behind because now the jungler has less to work with if he wants to get a gank off because he is missing out on crucial experience.
i'd rather put one lane in a deficit than two lanes and a jungler. stay off my creeps and i'll stay off yours. for a while.
I disagree with putting the mid and top behind. I think that you are putting bot lane ahead by more than the jungler is getting set back.
It's ok that we disagree though, it's more interesting that way. I think this is going to get nerfed so that bot lanes can't do this anymore since it is op, but if you're right then there should be no nerf since the team is losing more than it gains by doing it.
If you can bring more value to the team by taking golems than allowing your bot lane to do it then that should be fine and you are definitely making the correct decision.