• Shadow@lemmy.ca
    link
    fedilink
    English
    arrow-up
    21
    arrow-down
    3
    ·
    13 hours ago

    I don’t know if a lot of people realize that LLM’s basically started from Google translate.

    • TheBlackLounge@lemmy.zip
      link
      fedilink
      English
      arrow-up
      16
      ·
      8 hours ago

      Not in a meaningful sense. It used to be actual string-to-string translation, now it’s extracting the translation from a question-answer zero shot.

    • forrgott@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      4
      ·
      edit-2
      11 hours ago

      I wonder if they connect all the way back to Micro$oft’s neo Nazi chat bot from decades ago?

      • jacksilver@lemmy.world
        link
        fedilink
        English
        arrow-up
        25
        ·
        11 hours ago

        Not sure if you really want to know, but a Google paper is where transformers (backbone of LLMs) were first mentioned (2016 I believe). Google initially used transformers for translations and eventually search, but OpenAI experimented with them for text generation (gpt 1+) eventually leading to chatgpt.