Home β€Ί Architecture

πŸ—οΈ Bicameral Architecture

Left hemisphere: madhatter GPU inference. Right hemisphere: Kubernetes cluster. Bridge: Corpus Callosum.

madhatter β€” Left Hemisphere

ComponentSpecification
CPUIntel i7-9700K (8 cores, no HT)
RAM16 GB β€” HARD CEILING (R3)
GPUNVIDIA RTX 3060 β€” 12 GB VRAM. 14b models cannot coexist.
OS DriveCrucial 1 TB NVMe (nvme1n1) β†’ / /boot /home
AI Engine DriveIntel 660p 1.8 TB NVMe β†’ /mnt/ai_engine/ [R2]
Tailscale IP100.72.190.41
Docker Root/mnt/ai_engine/docker

Docker Stack Topology

StackServicesOrder
dryad-coreCaddy (80/443), Portainer (9443), Netdata1st
dryad-brainLiteLLM (4000), Redis (6379), Qdrant (6333), open-webui (3010)2nd
dryad-mcpmcp-search (8020), mcp-mem0 (8030), mcp-station (8585)3rd
dryad-appsOpenWork (3456)4th
dryad-portaldryad-portal (3080)5th
dryad-tutorialsnginx:alpine β†’ this site6th
Systemd services (not in Docker)Ollama (11434) and OpenCode (4096) run as host systemd services. Containers reach Ollama via host.docker.internal:11434.

Inference Request Path

Client β†’ dryad-litellm:4000 (Authorization: Bearer sk-dryad-master)
         β”œβ”€β”€ GPU tasks    β†’ Ollama host.docker.internal:11434 (RTX 3060)
         β”œβ”€β”€ Ollama cloud β†’ qwen3-coder:480b-cloud stub
         β”œβ”€β”€ Cloud NIM    β†’ NVIDIA NIM API (nim-deepseek alias)
         └── Phase 8 CC   β†’ cluster 10.10.10.100 (Corpus Callosum)