This actually ties into another one of my complaints: at base, it seems like most horses are kinda shitty (I'm to understand that patterned horses control less derpy than solid colored horses, based on what a random NPC told me).
Like, I understand they wanted variation in horses, but they should have limited it to things like stamina and speed as opposed to the damn things veering left and right randomly.
That said, I'm looking forward to experimenting with the horses more now that I'm in post-game: I really like the design of being able to force slow motion by jumping off a horse and then aiming with the bow.
This may be a horse's true use :v