You know how Google’s new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won’t slide off (pssst…please don’t do this.)
Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these “hallucinations” are an “inherent feature” of AI large language models (LLM), which is what drives AI Overviews, and this feature “is still an unsolved problem.”
It’s quite simple. Garbage in, garbage out. Data they use for training needs to be curated. How to curate the entire internet, I have no clue.
The real answer would be “don’t”. Have a decent whitelist dor training data with reliable data. Don’t just add every orifice of the internet (like reddit) to the training data. Limitations would be good in this case.
Its worse than reddit, they’ve been pulling data from the onion.
Is that for real?
Its been quoting some onion articles verbatim, so either they pulled from the onion directly or from somewhere that re-posts onion articles.
Just train it on linux help forum replies, because everyone there is always 100% right.
Having a curated whitelist would definitely be a good idea, but if it only shows information from a limited list of websites, that would make it a terrible search engine incapable of searching most of the web.
They already have a curated data set. It’s called Google Scholar.