• YesButActuallyMaybe@lemmy.ca
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    7
    ·
    16 hours ago

    It’s running in memory… I’m not going to explain it, just ask an AI if it exists when you don’t prompt it

    • Gladaed@feddit.org
      link
      fedilink
      English
      arrow-up
      10
      ·
      15 hours ago

      That’s not how that works.

      LLMs execute on request. They tend not to be scheduled to evaluate once in a while since that would be crazy wasteful.

      • stringere@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        9 hours ago

        Edit to add: I know I’m not replying to the bad mansplainer.

        LLM != TSR

        Do people even use TSR as a phrase anymore? I don’t really see it in use much, probably because it’s more the norm than exception in modern computing.

        TSR = old techy speak, Terminate and Stay Resident. Back when RAM was more limited (hey and maybe again soon with these prices!) programs were often run once and done, they ran and were flushed from RAM. Anything that needed to continue running in the background was a TSR.

        • Gladaed@feddit.org
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 hours ago

          Please tell me why you believe that the LLM keeps being executed on your chat even when the response is complete.

            • Gladaed@feddit.org
              link
              fedilink
              English
              arrow-up
              1
              ·
              13 minutes ago

              Ohh, that makes sense.

              I wouldn’t have gotten that abbreviation without the explainer. Good on you for explaining it. Never heard it working in tech.