When I tried it in the past, I kinda didn’t take it seriously because everything was confined to its instance, but now, there’s full-featured global search and proper federation everywhere? Wow, I thought I heard there were some technical obstacles making it very unlikely, but now it’s just there and works great! I asked ChatGPT and it says this feature was added 5 years ago! Really? I’m not sure how I didn’t notice this sooner. Was it really there for so long? With flairs showing original instance where video comes from and everything?
It might be wrong more often than you think
https://futurism.com/study-ai-search-wrong
Besides the other commenter highlighting the specific nature of the linked study, I will say I’m generally doing technical queries where if the answer is wrong, it’s apparent because the AI suggestion doesn’t work. Think “how do I change this setting” or “what’s wrong with the syntax in this line of code”. If I try the AI’s advice and it doesn’t work, then I ask again or try something else.
I would be more concerned about subjects where I don’t have any domain knowledge whatsoever, and not working on a specific application of knowledge, because then it could be a long while before I realize the response was wrong.
IS wrong
Ftfy
In this study they asked to replicate 1:1 headline publisher and date. So for example if AI rephrased headline as something synonymous it would be considered at least partially incorrect. Summarization doesn’t require accurate citation, so it needs a separate study.
OK but google (or ask your AI?) about AI accuracy. This isn’t the only source saying theres a problem with the answers.