It’s one of those “if you have to ask, you can’t afford it” scenarios.

I’ve heard FP16 is likely to be 6TB of VRAM, when Kvcache is factored in.

Even a more sensible quant will likely be 1TB.

… most of us are not running this at home.

3-2-1

3 copies of your data, on at least 2 devices, and 1 those must be off site.

As for the rest, start here

www.tinyurl.com/FUTOSelfhost

Yes. People occasionally talk about pooling resources / creating a co-op to buy something like this. Easier to split $200K purchase (and probably $10k/month electricity costs) if 200-2000 people chip in. But then…that’s just the cloud with extra steps.

Can’t says I’ve ever seen a co-op like that work but ICBW

Yeah. But they’re slow because most of us are GPU peasants. If someone were willing to drop $3-5K on a rig, they could probably run decent, dense models at greater than cloud speeds. Hell, with enough black magic, they could do it with less, but they’d have to go deep into the weeds.

OTOH, $3-5K buys you a shit ton on Open Router, Claude, Chat, Lumo etc.

The game is entirely rigged for “you will own nothing and be happy about it”.

I guess it depends on your definition of perfect - cheap, good or fast.

This thing is probably going to cost at least $20K USD.

Edit:

“Next year’s base M7 processor is expected to arrive in the first half of 2027 and will also upgrade memory bandwidth to about 240 GB/s.”

That’s…really fucking slow. What’s the goal here - CGI, engineering sims, game dev etc? 1.5TB is cool but at 240GB/s that will crawl for AI use.

Comparison: this is about $100K, for 7.2TB/s, 252GB VRAM (+500GB system ram, so closer to 750GB total)

https://www.nvidia.com/en-us/products/workstations/dgx-station/

Honestly, I think that’s the only llm of its kind. The next closest thing is this

https://github.com/karpathy/nanochat

If you don’t mind something narrower (an expert system, sort of), I’m slowly coding something for myself here. It’s not ready yet (about half way done to initial release).

https://codeberg.org/BobbyLLM/picoGURU

Public facing docs are a bit of a mess at the moment (sorry; writing docs is boring AF; will probably be the last thing I tidy before official 1.0.0) and it’s not really runnable right now, but when done, the “source files” for this will be kiwix (off line Wikipedia), your own markdown notes and 30 or so trusted domains (user defined).

So it’s all either your own content or public domain aka open source fully. Code itself is AGPL-3.

Anyway, that’s the goal.

So far, we have exactly one of those

https://en.wikipedia.org/wiki/Apertus_(LLM)

Given the option, I specifically avoid stores with self check outs. Thankfully that’s still an option for now

Nah, not all of us. When switch 2 came out (and because I wanted a hand held) I looked at it, poked at in the shop and decided to buy a DS instead. $80 vs $650. If I’d been feeling more generous, I would have gotten a Retroid pocket 5 or something. I didn’t need it.

The switch 2 is shiny, but it didn’t fill any niche for me that one of my other rigs couldn’t do (Wii, Wii u, $100 emulation box I built).

“Bigger, better, faster” is a mug’s game. It cannot be won and it’s the lynchpin of capitalism. The way to win is to not play.

Gaming is a luxury good. If the big players are going to go full retard, let them. Let it all burn while you find greener pastures.

This goes for all tech (and luxury goods), IMHO. Do more with less.

Reject the status ladder → identify the actual function → satisfy it with the smallest tool that works = you win.

Then enjoy the absurdity of $650 Switch 2 (and marvel at the cost of Switch 1 increasing in price. Lol no).

deleted by creator

Right? I still have my OG Xbox 360, Wii U etc, with physical discs.

For a while, I went the other way; I bought a Lenovo M93p (think: size of Wii) - it runs everything up to PS2 era at 2x resolution, as well as PC games to around 2015/6 era (and later indies). Total cost was under $100. I turned it into a kiosk with Playnite, so you could turn it on and be playing whatever in under 10 seconds.

Right now I have the OG Wii (modded) sitting in its place…something about the joys of original hardware speaks to me. But I could (should) swap the lenovo back in. That way I have Just Cause 2 sitting right next to Mario Kart Double Dash, right next to Luanti and modded Fallout 3.

Part of me thinks “eh, emulation” but the other part is “dude…not everything is Nintendo”.

I do hope people realise that 7th gen and earlier consoles are still fucking awesome. Yes, that’s PS3/Xbox360/Wii/GBA/DS era.

Some of those still have lively homebrew scenes. Hell, the Wii just got a new (physical) release game.

https://www.gamespot.com/articles/its-2026-and-the-wii-is-getting-a-new-physical-game-release/1100-6538083/

Reject modernity. Embrace retro.

deleted by creator

https://shreddit.com/

Over-write first, then deletes. Optionally, allows you to do download your comments first for archival.

Those are rookie numbers. They need to pump that up. $10K a console, and you need to scan your retina to use it.

Ya know… for a luxury good with literally dozens of other, better options… “Make it impossible to buy our stuff” is a dumb hill to die on.

Oh well.

laughs in 40 years of non PlayStation games

You could not live with your failure. And where did that bring you? Back to (Lem)my.

• Brands increase prices
• People stop buying brands
• Brands cry foul
• Oh no! Anyway…

The trick, William Potter, is to bleed the people just enough to satiate your parasitism without exsanguinating them, eh?

Gee, we’ve never seen that trick before.

Does shreddit not work any more?

Ah but redreader parses old.reddit.com. So with the proposed changes, you will probably need an account to use even the excellent RedReader.

IIRC, when the APIpocolypse happened, Reddit tried really hard to nerf Redreader. They got shamed into allowing it access again on accessibility grounds.

It’s only a matter of time before it stops working.

Take solace in knowing that “lol, fuck reddit then” is a perfectly cromulent response to this.

I just hope Lemmy doesn’t become Reddit 2.0

Oh no! Anyway…

EDIT: Just to be clear, I am not dismissing OP. I’m saying “fuck Sony” and “this would be a good time to convert to PCmasterrace or go retro”