• MalReynolds@slrpnk.net
    link
    fedilink
    English
    arrow-up
    3
    ·
    3 hours ago

    Cheap fuckers cheaping out, shocker (context is (V)RAM). AI speedrunning enshittification, who’d of thunk.

    • pixxelkick@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 hours ago

      Uh… no its just the free models being free, theyre lower cost intentionally to provide free options for people who dont wanna pay subscription fees.

      (context is (V)RAM)

      Eh sort of, its more operating costs, the larger the context size the more expensive the model is to run, literally in terms of power consumption.

      Keep in mind we are on the scale of fractions of cents here, but multiply that by millions of users and it adds up fast.

      But the end result is that the agent will fuck stuff up, and will even quickly /forget/ it fucked that up if you dont catch it asap

      A lot of them have a context window that can be wiped out within like, 2 minutes of steady busywork…