#local AI
3 articles tagged local AI. At twelve articles this topic starts lifting the whole site in search.
Timeline
-
What is llama.cpp — the engine under Ollama and LM Studio, and what 1.0 promises
-
What is an open-weight AI model — and why you can't run a trillion parameters at home
-
What mixture of experts (MoE) is — how a 125B model runs on a gaming GPU
All articles
-
Tech · 19 min readWhat is llama.cpp — the engine under Ollama and LM Studio, and what 1.0 promises
Meaning — a C/C++ engine that runs AI models stored as GGUF files on CPUs and GPUs; Ollama and LM Studio run on it
-
Tech · 3 min readWhat is an open-weight AI model — and why you can't run a trillion parameters at home
Definition — downloadable trained weights you can run yourself; data and code are separate questions
-
Tech · 2 min readWhat mixture of experts (MoE) is — how a 125B model runs on a gaming GPU
Structure — many 'experts' plus a router that picks a few per token: big in total, small in compute