tal@lemmy.today to Technology@lemmy.worldEnglish · 4 days ago'Consider a system with no DRAM' replaced by a 'recycling fiber loop': John Carmack envisages bold future to avoid AI-driven RAM crisiswww.techradar.comexternal-linkmessage-square51linkfedilinkarrow-up1185arrow-down114
arrow-up1171arrow-down1external-link'Consider a system with no DRAM' replaced by a 'recycling fiber loop': John Carmack envisages bold future to avoid AI-driven RAM crisiswww.techradar.comtal@lemmy.today to Technology@lemmy.worldEnglish · 4 days agomessage-square51linkfedilink
minus-squarems.lane@lemmy.worldlinkfedilinkEnglisharrow-up10·4 days agoIt’s an interesting idea, but what’s the floor size for a pair of 200TB/s fibre transceivers vs. 32GB of HBM? It’s it’s not significantly less, this doesn’t seem like it’d be particularly helpful outside the 200TB/s of streaming data.
minus-squaretal@lemmy.todayOPlinkfedilinkEnglisharrow-up5·4 days agoI’m assuming that the point is the bandwidth. goes looking for HBM bandwidth https://en.wikipedia.org/wiki/High_Bandwidth_Memory It says that HBM 4, which came out one year ago, can do 2 TiB/s.
It’s an interesting idea, but what’s the floor size for a pair of 200TB/s fibre transceivers vs. 32GB of HBM?
It’s it’s not significantly less, this doesn’t seem like it’d be particularly helpful outside the 200TB/s of streaming data.
I’m assuming that the point is the bandwidth.
goes looking for HBM bandwidth
https://en.wikipedia.org/wiki/High_Bandwidth_Memory
It says that HBM 4, which came out one year ago, can do 2 TiB/s.