That's why I fight for that ground during the middle and through the end, when it matters most.
And the earlier your team gains control, the easier those middle and end fights will be for them. The more control you give up early, the harder it is to come back during those late game fights. Immediately putting your team at a big disadvantage because "The last 30 seconds are all that matters" is a risky strategy. It's better to fight that last fight from a position of power than from a dangerous, difficult comeback.