I still don't think those giant blue sword stakes are "towers" that unlock areas on the map. I think those may be more story related and kept just as warp points.
I can always count on you
