LOCAL AI
Run AI locally: local inference, desktop tools, self-hosted servers, hardware requirements and deployment guides.
Local AI: How to Run Generative AI on Your Own Hardware
Local AI explained: run LLMs, image and video models on your own hardware with private inference, self-hosted APIs, Apple Silicon and local workflows.
Open Source LLMs: How to Choose, Run, and Deploy Local Language Models
Open-source and open-weight LLMs explained: model selection, quantization, local inference, hardware, APIs, licensing and practical deployment.
llamafile: Run an Open LLM From a Single Executable File
llamafile is a single-file local LLM runtime from Mozilla.ai that bundles llama.cpp into a portable executable for macOS, Linux and Windows, with no installation required. License unverified.
Rapid-MLX: A Local, OpenAI-Compatible AI Server for Apple Silicon
Rapid-MLX is a local AI server for Apple Silicon that runs LLMs on M-series Macs with OpenAI- and Anthropic-compatible APIs, CLI, desktop app and coding-agent support. License unverified.