The narrative in AI infrastructure over the last two years has been dominated by the enormous and growing demand for compute capacity and its economic consequences, such as the buildout of data centers and the consequent shortages of key resources such as land, water, power, and copper.

But of all these bottlenecks, memory is by far the most significant. The demand for memory is now outpacing the demand for other drivers of compute capacity. The implications of this will ripple through not just the economics of data centers, but the cost of every single consumer and enterprise hardware device.

In this piece, we unpack the market action around memory prices, its ripple effects across the consumer and industrial electronics market, and the supply and demand curve that is emerging around AI. Critically, we explain why the amount of memory being purchased by AI companies like OpenAI seems to be more than what they need, and how the threat of on-device inference might actually be incentivizing an engineered memory shortage.

  • midribbon_action@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 hours ago

    It’s a scary world out there, I absolutely understand the feeling of reading too far in to a slop piece and feeling like my time was stolen from me. We have to support good human content, even if it’s from some hedge fund think tank thing. Thank you for being honest, sorry for calling it bullshit. It was bullshit, but, like I’m sorry.

      • skulblaka@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 hour ago

        Chad mod action nuking whatever this exchange was but leaving the bit at the end where the guy was humble and respectable