As someone who doesn't follow the comics, that's a fair explanation. I briefly considered it, too.I'm not sure if it's error or not. I recalled that Scarlet Witch could teleport/warp in the comic book.
But if Ultron and SW are rushing off, why is QS just standing around?