Well you still have to do the first travel to connect the place at the chyral network and you give a choice to the player, like for example i don't wanna use the fast travel for story mission but for some secondary shit with a lot of backtracking it would be useful.
I think that with a proper fast travel, some of the negative reviews maybe they could've been slightly different (sorry for the terrible english, i'm the fucking worst with past and future shit) and a little more positive, it's always better have a choice especially in a game with a non-ordinary gameplay thst can bore some people.
You have to trust players if you really think that your gameplay loop is ok and give them the choice to use or not use the fast travel.