• Brewchin@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    32 minutes ago

    This should come in handy for the recently projected need for 300 GB RAM* in upcoming self-driving cars.

    *Not a typo. 😳

  • Deconceptualist@leminal.space
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    1
    ·
    edit-2
    3 hours ago

    Should be called Middle-Out? That was the algorithm IIRC. Pied Piper was the name of the startup.

    Either way, funny shit.

  • AbouBenAdhem@lemmy.world
    link
    fedilink
    English
    arrow-up
    27
    ·
    5 hours ago

    TurboQuant, meanwhile, could lead to efficiency gains and systems that require less memory during inference. But it wouldn’t necessarily solve the wider RAM shortages driven by AI, given that it only targets inference memory, not training — the latter of which continues to require massive amounts of RAM.

    I didn’t realize the RAM shortage was mostly due to training—I would have thought inference was at least a big a factor.

    • Dran@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      ·
      3 hours ago

      Inference is dirt cheap in comparison. Hundreds to thousands of concurrent users can be served by hardware costing in the high-thousands to low-ten-thousands.

      Training those same foundational models is weeks to months of time on tens to hundreds of millions worth of hardware.

      • AbouBenAdhem@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        2 hours ago

        Yeah—but in theory you only need to train once, while inference costs are ongoing and scale up with usage.

        I guess it’s ultimately a business decision by AI companies to weigh how often retraining is worth the cost.

        • JGrffn@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 hour ago

          Yeah i don’t think they ever stop training is the thing. At this point I’d assume they have multiple training pipelines to try different shit out, just queued up to hit the big farms as soon as the last models are done training.

          Resting isn’t a thing in capitalism.

    • uuj8za@piefed.social
      link
      fedilink
      English
      arrow-up
      9
      ·
      3 hours ago

      Yes, it should be Nucleus. Them calling it PiedPiper is a propaganda campaign to try to earn good will from people. Fuck Google locking down Android.

    • hopesdead@startrek.website
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 hours ago

      Sure but didn’t the plot line with Nucleus come in a later season?

      Secondly, I am pretty certain the Google logo was always in the opening credits.

    • cecilkorik@lemmy.ca
      link
      fedilink
      English
      arrow-up
      25
      arrow-down
      1
      ·
      edit-2
      5 hours ago

      No, that is what it would be if we were using traditional, deterministic compression and using a reversible and verifiable mapping of data. But this is the new era of memetic compression, “Pied Piper” is what everyone remembers from the show, so we compress it to “Pied Piper” to minimize the amount of memetic overhead and allow the smallest possible compression artifact. Like with “AI”, it doesn’t need to be correct, just close enough for people to think it is! /s

  • SalamenceFury@piefed.social
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    4 hours ago

    Funny thing that came with this: apparently Micron’s stock fell off a cliff, and apparently so did RAM prices? Can’t confirm that later one.

    • BetaDoggo_@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 hours ago

      Neither are true, Micron has been plummeting since their earnings report on the 18th. This might have caused a small dip but it’s nothing compared to the cliff they just fell off of.