Sahwa@reddthat.com to Technology@lemmy.worldEnglish · 1 day agoMystery company accidentally blew $500 million on Claude in a single month — failed to put usage limit on licenses for employeeswww.tomshardware.comexternal-linkmessage-square160linkfedilinkarrow-up1795arrow-down112
arrow-up1783arrow-down1external-linkMystery company accidentally blew $500 million on Claude in a single month — failed to put usage limit on licenses for employeeswww.tomshardware.comSahwa@reddthat.com to Technology@lemmy.worldEnglish · 1 day agomessage-square160linkfedilink
minus-squareBlackLaZoR@lemmy.worldlinkfedilinkEnglisharrow-up2·2 hours agoIf you have a high VRAM GPU (like 16GB or more) you can try running some model locally with LMStudio. You won’t get the same level as cloud models but depending on use case it might be good enough.
minus-squareeleitl@lemmy.ziplinkfedilinkEnglisharrow-up1·38 minutes agoI only have an Radeon RX Vega 56 8GB HBM2, so limited to CPU-only. 64 GB memory there at least. Not upgrading unless hardware dies.
If you have a high VRAM GPU (like 16GB or more) you can try running some model locally with LMStudio. You won’t get the same level as cloud models but depending on use case it might be good enough.
I only have an Radeon RX Vega 56 8GB HBM2, so limited to CPU-only. 64 GB memory there at least. Not upgrading unless hardware dies.