jaykrown@lemmy.world to Technology@lemmy.worldEnglish · 22 hours agoDeepSeek Permanently Reduces The Price Of Its Flagship V4 Model By 75 Percenttech.yahoo.comexternal-linkmessage-square105linkfedilinkarrow-up1431arrow-down116
arrow-up1415arrow-down1external-linkDeepSeek Permanently Reduces The Price Of Its Flagship V4 Model By 75 Percenttech.yahoo.comjaykrown@lemmy.world to Technology@lemmy.worldEnglish · 22 hours agomessage-square105linkfedilink
minus-squareboonhet@sopuli.xyzlinkfedilinkEnglisharrow-up1·10 hours agoFor self hosting it essentially needs to fit in VRAM + RAM but it’ll take a lot of CPU for the part in RAM Deepseek probably uses those big fancy H cards and not one but several together to increase VRAM.
For self hosting it essentially needs to fit in VRAM + RAM but it’ll take a lot of CPU for the part in RAM
Deepseek probably uses those big fancy H cards and not one but several together to increase VRAM.