This is 100% the answer, the only solution to the model decay from LLM outputs overwhelming the web is to start collecting data IRL.
This is also why companies like OpenAI are desperately investing in ‘AI wearables’ that no-one wants. They have to get the unpolluted data from somewhere, and recording real conversations will at least mostly have come from actual humans instead of AI.
This is 100% the answer, the only solution to the model decay from LLM outputs overwhelming the web is to start collecting data IRL.
This is also why companies like OpenAI are desperately investing in ‘AI wearables’ that no-one wants. They have to get the unpolluted data from somewhere, and recording real conversations will at least mostly have come from actual humans instead of AI.
since coffe shops also free wifi, they would want access to the data of laptops, and phones as well.
Excellent video on this!