SocialistVibes01@lemmy.ml to

Linux@lemmy.mlEnglish · 1 day ago

Which specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?

19

Which specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?

SocialistVibes01@lemmy.ml to

Linux@lemmy.mlEnglish · 1 day ago

Something to handle code, text and math.

Chat

wraekscadu@vargar.org
link
fedilink
arrow-up
2
arrow-down
1·
1 day ago
Depends on how big your local LLM model is. You can easily run 2-3B param models on a potato. BUT, the model is shit.

Linux@lemmy.ml

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word “Linux” in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
No misinformation
No NSFW content
No hate speech, bigotry, etc

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

757 users / day
2.27K users / week
5.48K users / month
9.85K users / 6 months
1 local subscriber
65.2K subscribers
744 Posts
10.5K Comments
Modlog