A Visual Guide to Gemma 4 (newsletter.maartengrootendorst.com) AI

The article provides a visual and technical overview of Google’s Gemma 4 model family, covering four variants and their dense vs. mixture-of-experts designs. It explains shared architectural choices such as interleaved local (sliding-window) and global attention, and details efficiency techniques for global attention (grouped query attention, K=V, and p-RoPE). It also outlines how Gemma 4 handles multimodal inputs, including image understanding via a vision transformer and approaches for variable aspect ratios.