Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

    • kescusay@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      2
      ·
      12 hours ago

      It’s already happening. GPT 5.2 is noticeably worse than previous versions.

      It’s called model collapse.

      • Zos_Kia@jlai.lu
        link
        fedilink
        English
        arrow-up
        2
        ·
        7 hours ago

        To clarify : model collapse is a hypothetical phenomenon that has only been observed in toy models under extreme circumstances. This is not related in any way to what is happening at OpenAI.

        OpenAI made a bunch of choices in their product design which basically boil down to “what if we used a cheaper, dumber model to reply to you once in a while”.