How to Setup a Local Coding Agent on macOS (ikyle.me) AI

The article walks through setting up a local “coding agent” on macOS by running llama.cpp (with Metal acceleration) as an OpenAI-compatible /v1 server using Gemma 4 26B plus an MTP speculative-decoding draft model, then connecting it to Pi configured to accept both text and images via the Gemma 4 multimodal projector.