you need the cloth to get to/through the castle, so I dunno. you'd have to glitch the game into thinking you completed the four shrines or something?
Aonuma said the game could be beaten within 15 minutes. There has to be a way to get off the Plateau early.