Does something like an AI distribution exist?

Question

I was wondering if something like AI/LLM distros exist, in the sense of bundled models, interfaces, prompts, and tools (as in tools called by the LLM) tested to work well together and ready to run on modest hardware.Picture an open source ChatGPT (meaning UI, LLM, tools to generate and run scripts, etc.), but entirely open source. Everything bundled and ready to run. GNUbot? GPTKnoppix? Geminibuntu? :)

bigyabai · Accepted Answer

It's not necessary. Most distros contain all the packaging required to hardware-accelerate AI already, packages that need AI-specific tooling can specify it as a dependency and pull it in as-needed.
> Picture an open source ChatGPT (meaning UI, LLM, tools to generate and run scripts, etc.), but entirely open source.
We're kinda already past that: https://flathub.org/apps/com.jeffser.Alpaca

theletterf · Answer

Perhaps something like https://www.redhat.com/en/products/ai/enterprise-linux-ai ?