The pipeline
Green nodes are human, coral are AI, ink are automation. The role is the node color, and the chain is the timeline. No zigzag happens, because the diagram never asks the arrows to leave a column.The model-routing philosophy
The routing is opinionated, not magic. Every model has a sweet spot, and clear rules in~/CLAUDE.md and AGENTS.md say which model to use when. The
strongest model handles multi-file refactors and deep reasoning. The cheap one
handles line-level completion. Local inference covers anything not worth cloud
tokens.
The reasoning behind that split, and how it is governed once several agents share
one endpoint, lives on Model routing. The serving
stack that runs the local tiers is under Local LLM.
Local AI gateway (LiteLLM)
The LiteLLM router pool is the single endpoint for the shared local inference fabric on the homelab. Workstation AI tools reach cloud providers (OpenAI, Gemini, OpenRouter) directly, using each tool’s own native credentials. The router pool isn’t in that path. Tools resolve task classes (Research, Coding, Review, Pre-commit) to a current model at call time. Never hardcode model identifiers in committed config. WhenlocalOnlyMode is enabled, every request
routes exclusively to the local MLX inference server on port 11434.
See Homelab GPU for routing conventions, local-only mode details, and provider capabilities.
Priority order
- Anthropic official: Claude Code plugins, skills, patterns
- LiteLLM router: local, on-estate inference routing across the router pool
- Personal or custom: only when no alternative exists
Repos that power this pipeline
ai-assistant-instructions
Universal AI configuration layer: rules, permissions, workflows, agents.
claude-code-plugins
Commands, skills, hooks, agents for Claude Code.
nix-ai
Nix package and config layer for every AI coding tool.
claude-code-routines
Scheduled remote-agent routines on Claude.ai.
ai-workflows
Reusable GitHub Copilot agentic workflows.
raycast-smart-issue
Raycast extension for AI-drafted GitHub issues via local MLX.