Uhuh, really? I figured they had a time window and you are toast if you miss it. That's great!
I'm just after I stopped watching Beast so it's all new to me from now on!
Nope you're all good. There are points in the story where it gets tougher to roam in the open world but in general you're fine to continue on the main mission if you aren't feeling the side stuff.