SocialistVibes01@lemmy.ml to

Linux@lemmy.mlEnglish · 2 months ago

Which specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?

33

Which specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?

SocialistVibes01@lemmy.ml to

Linux@lemmy.mlEnglish · 2 months ago

Something to handle code, text and math.

Chat

plutopos@lemmy.zip
link
fedilink
arrow-up
1·
1 month ago
AMD has better Linux support if you plan on using it

Linux@lemmy.ml

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !linux@lemmy.ml

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word “Linux” in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
No misinformation
No NSFW content
No hate speech, bigotry, etc

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

587 users / day
2.28K users / week
4.45K users / month
13.1K users / 6 months
1 local subscriber
66.5K subscribers
4.55K Posts
77.5K Comments
Modlog