As I previously warned, artificial intelligence companies are running out of data. A Wall Street Journal piece from this week has sounded the alarm that some believe AI models will run out of "high-quality text-based data" within the next two years in what an AI researcher called "a frontier research

This article describes what ive been thinking about for the last week. How will these billions of investments by big tech actually create something that is significantly better than what we have today already?

There are major issues ahead and im not sure they can be solved. Read the article.

  • altkey@lemmy.dbzer0.comEnglish
    41·
    12 hours ago

    That’s probably Machine Learning, the root category of tools and the origin of LLMs, not Large Language Models themselves we call ‘AI’. These have many applications they are efficient at gradually explored from the 80s I believe, while the AI boom involving Google, Meta, OpenAI and others is about generalistic chatbots that are bad in just about everything they used in. I’m putting that distinction not because I’m an ass, but because I don’t want the hype wave to get more credibility on the back of real scientifical and technological progress.

    • Womble@lemmy.worldEnglish
      2·
      11 hours ago

      It depends, if they’re use a transformer or diffusion based archetecture I think it would be fair to include it in the same “AI wave” thats been breaking since the release of chat gpt publicly.