I think stuff like this is because of user error (as in accuracy in speech) as well, like when you search for something and google is like "did you mean [x]?", no you didn't, but enough people have searched for this other thing so now it thinks you are making a mistake.
I've heard many people refer to the series controller to "series x" or "series s" controller, but no such thing exists, in fact the "xbox series controller" is really just called the "xbox wireless controller", because it wholly replaces the "xbox one wireless controller" as well.
But then you also have the "xbox one wireless controller", which wound up being called "xbox wireless controller" when they revised it with a headphone jack...and then they released the xbox one s which had a new controller with bluetooth, which has been called both "xbox wireless controller" and "xbox one s controller".
Then finally there's the "xbox controller s", which is also being called the "xbox classic controller s", which if you search for the latter you get exactly that controller, but if you search for the former, because people have been calling these controllers all kinds of things with varying accuracy, you literally get search results for every xbox controller ever made.
So of course the LLM gets it wrong in these cases, it can't verify what you are actually asking for because everyone called it differently so it just gives you the thing that came up the most.
it did try to give me the answer for the Xbox Controller S as confirmed by it clarifying it's the 2002 revision of the original Duke controller,
and still got the number of face buttons wrong.
so, there was no confusion which controller is meant, and it still got it wrong.
also I have never seen anyone usr the name Xbox Controller S for anything but the original Xbox controller revision.
so if the AI doesn't understand context like this, it's also a damning sign that AI can never be trusted with info gathering.
Xbox Controller S is also the exact OFFICIAL name of this, and only this, controller.
anyone who knows anything about video games would instantly know which controller is meant when I say Xbox Controller S. and would know instantly which controller is meant when I say "the first Xbox One controller", Xbox One headphones jack controller, Xbox One S controller, or Xbox Series X controller. these are all distinct variants and easy to distinguish in context and with the words I chose to describe them, even if there never was an official name for them.
if an AI can not naturally make these connections and find infos on the correct controller... what is it good for? ABSOLUTELY NOTHING -Edwin Starr
at that point I could just google Xbox One controller revisions and look at the Wikipedia article. no clarification needed, just a list of controller revisions.
but again, it's important to see that Grok ultimately understood which controller I meant after I told it it got it wrong initially, and still ot got me the wrong amount of face buttons as it didn't know Black and White exist.