Gemma 4 · Local
checking on-device model…
◆ Local-first · On-device · Private

Gemma 4,
On Your Machine

Open-weight intelligence that runs entirely on your hardware. No cloud calls, no API keys, no data leaving the room.

↳ your GPU, your rules
Run it in 60 seconds See the live demos ↓
Gemma4 On Your Machine — Julian Goldie guide hero illustration
0
On-disk with QAT
down from 7.2 GB
0
Faster on an M2 Air
12–31% range
0
Runs on-device
your silicon
0
Cloud calls
nothing leaves
live & on your machine

Three demos, zero cloud

Each one talks to your local Gemma 4 through a same-origin proxy. Play them right here.

Gemma 4 isn't running yet. The demos below will show a friendly setup state until you ollama pull gemma4:e2b-it-qat  — update Ollama, then pull the model.
Pictionary
Sketch on the canvas — Gemma 4's vision guesses what you drew, live.
localhost · /gemma-demos/pictionary
Live demo runs inside the
Agent Operating System
dashboard.
vision · on-device Inside the dashboard ↗
Local Oracle
Ask anything. A glowing orb answers from a model that never leaves your laptop.
localhost · /gemma-demos/oracle
Live demo runs inside the
Agent Operating System
dashboard.
chat · private Inside the dashboard ↗
QAT Visualiser
Watch quantisation-aware training shrink the weights without losing the quality.
localhost · /gemma-demos/qat-viz
Live demo runs inside the
Agent Operating System
dashboard.
7.2 → 4.3 GB Inside the dashboard ↗
why it fits

Same quality.
Half the footprint.

QAT — quantisation-aware training — teaches Gemma 4 to stay sharp at lower precision. The result on a real M2 MacBook Air: smaller on disk, faster to respond, and quality that matched or beat the non-QAT build.

gemma4:e2b-it-qat E2BE4B 12B26B (a4b)31B
Standard Q47.2 GB
QAT weights4.3 GB
Speed on M2 Air+12–31%
no PhD required

Run it in 60 seconds

Three steps from zero to a private model humming on your own machine.

1

Update Ollama

Grab the latest build so it knows the Gemma 4 tags. One download, runs in the background.

2

Pull the model

Pull the QAT weights — 4.3 GB on disk, tuned for everyday laptops. Then it's yours, offline.

3

Open the Gemma 4 tab

Refresh this page. The status light turns cyan and the demos above go live, instantly.

$ ollama pull gemma4:e2b-it-qat