tal@lemmy.today to Technology@lemmy.worldEnglish · 2 days ago'Consider a system with no DRAM' replaced by a 'recycling fiber loop': John Carmack envisages bold future to avoid AI-driven RAM crisiswww.techradar.comexternal-linkmessage-square51fedilinkarrow-up1180arrow-down114
arrow-up1166arrow-down1external-link'Consider a system with no DRAM' replaced by a 'recycling fiber loop': John Carmack envisages bold future to avoid AI-driven RAM crisiswww.techradar.comtal@lemmy.today to Technology@lemmy.worldEnglish · 2 days agomessage-square51fedilink
minus-squarems.lane@lemmy.worldlinkfedilinkEnglisharrow-up10·2 days agoIt’s an interesting idea, but what’s the floor size for a pair of 200TB/s fibre transceivers vs. 32GB of HBM? It’s it’s not significantly less, this doesn’t seem like it’d be particularly helpful outside the 200TB/s of streaming data.
minus-squaretal@lemmy.todayOPlinkfedilinkEnglisharrow-up5·edit-22 days agoI’m assuming that the point is the bandwidth. goes looking for HBM bandwidth https://en.wikipedia.org/wiki/High_Bandwidth_Memory It says that HBM 4, which came out one year ago, can do 2 TiB/s.
It’s an interesting idea, but what’s the floor size for a pair of 200TB/s fibre transceivers vs. 32GB of HBM?
It’s it’s not significantly less, this doesn’t seem like it’d be particularly helpful outside the 200TB/s of streaming data.
I’m assuming that the point is the bandwidth.
goes looking for HBM bandwidth
https://en.wikipedia.org/wiki/High_Bandwidth_Memory
It says that HBM 4, which came out one year ago, can do 2 TiB/s.