§0 · Hermes Agent + Qwen 3.8 27B · free

Hermes Agent + Qwen 3.8 27B: the free brain that lives on your Mac

Hermes Agent just got a free brain upgrade, and it runs on your own computer.

Imagine opening your laptop and finding a giant AI model already sitting there waiting for you.

No account. No key. No internet needed.

It reads pictures, it uses tools, and it thinks before it answers.

Your own private AI employee, working for free, forever.

There is also one setting almost everyone gets wrong, and I will show you how to fix it in ten seconds.

0Bparameters
0 GBon your disk
0Kcontext
0tokens / sec measured
$0to run it
§1 · THE PROBLEM

The Rented Brain Problem.

You do not own any of it.

Every question goes to somebody else's computer, and every answer comes back on their terms.

You every question Somebody else's computer the meter is running they set the price and can change it they hold your work on a machine you never see they can turn it off and you have no say you are paying rent on a brain you never keep

What you're looking at: the rented brain. Today we move in.

THINKING IT? "Running AI on my own machine sounds like a developer thing."

It is four commands, and every one of them is on this page.

If you can type a sentence into a text box, you can do the whole build.

§2 · WHAT JUST LANDED

Qwen 3.8, the 27B, is the one to grab.

A model that only chats is a toy. A model that uses tools is an employee.

18 GB on your disk 256K context window Reads images too Uses tools runs things for you this is the one Thinks before it answers one download · then it is yours

What you're looking at: the four things that make this one worth the disk space.

§3 · THE MLX BUILD

Take the one with mlx on the end.

MLX is Apple's own way of running AI on the chip inside your Mac.

Same model, same answers, built for the machine you already own.

Same model two builds generic build made for every computer works fine leaves speed on the table the mlx build Apple's own path straight to the chip qwen3.8:27b-mlx

What you're looking at: don't drop the mlx. That is the whole tip.

§4 · WHAT YOU NEED

Three checks before you touch anything.

Three green ticks and you are good to go.

Apple Silicon Mac M1, M2, M3 or M4 — not Intel 32 GB memory+ there is a catch — see §22 20 GB free disk the model itself is 18 check all three now, not halfway through the download

What you're looking at: the three-second sanity check that saves you an hour.

§5 · STEP 1 — CHECK YOUR VERSION

The trap that stops most people on line one.

Open Terminal and run this. If your Ollama is old, the download fails with a code nobody explains.

ollama --version

What you're watching: my real session. Version 0.32.5 looked fine, then the pull died on a 412 — "requires a newer version of Ollama". The MLX builds are too new for older Ollama to even read.

§6 · STEP 2 — UPGRADE OLLAMA

Two minutes, and you get a bonus.

Download Ollama again from ollama.com, drag it into Applications, replace the old one, reopen it.

What you're watching: 0.32.5 became 0.32.14 on my machine — and the new build ships one-command wiring for Claude Code, OpenCode, Hermes and a dozen more. We use the Hermes one at §11.

THINKING IT? "Will upgrading break the models I already have?"

It did not touch mine. Every model I already had was still listed straight after the upgrade.

Your models live in a separate folder from the app, so replacing the app leaves them alone.

"You are paying rent on a brain you never get to keep."
§7 · STEP 3 — MAKE ROOM

Go and look at your model graveyard.

Run df -h ~ and read the "Avail" column.

I had 15 GB free and needed 18. Three deletions later I had 63.

Free space on my drive before 15 GB free the model needs 18 GB after 63 GB free what was just sitting there doing nothing: old model · 16 GB old model · 14 GB old model · 6 GB old model · 5 GB = 41 GB

What you're looking at: four models I had already tested and moved on from months ago. Deleting them took three seconds.

§8 · STEP 4 — PULL THE MODEL

One command. Then go make a coffee.

This is the download. Eighteen gigabytes, once, and then it is yours forever.

ollama pull qwen3.8:27b-mlx

What you're watching: the real pull finishing, then ollama list showing it sitting on my disk at 18 GB. From here it works with the wifi switched off.

§9 · STEP 5 — FIRST REPLY

The first answer is slow. That's normal.

Your Mac has to lift 18 GB off the disk before it can think at all. Mine took about 35 seconds.

Every answer after that comes back straight away.

What you're watching: the real first reply, then a warm one — and the number I measured on an M4 Max: 24.9 tokens a second.

THINKING IT? "Thirty-five seconds? That is unusable."

That is the load, not the thinking, and it only happens once per session.

Ask it a second question and the answer starts immediately, because the model is already awake.

§10 · THE SPEED

It writes three times faster than you read.

A number on its own means nothing, so here it is against a human.

Tokens per second you, reading aloud ≈ 8 Qwen 3.8 27B, warm 24.9 measured on an M4 Max · it never feels like waiting

What you're looking at: the answer unrolls faster than you can read it, so it feels like it was already there.

§11 · STEP 6 — WIRE IT INTO HERMES

The whole wiring is one line.

Ollama holds the model. Hermes is the agent. This joins them.

ollama launch hermes --model qwen3.8
Ollama holds the 18 GB model one command Hermes Agent tools · sessions · skills now running on your model Work done on your machine no config files, no guessing, no keys

What you're looking at: the join. Before this, connecting a local model to an agent meant editing files and guessing.

§12 · STEP 7 — THE PROFILE FILE

Or set it up by hand, for more control.

Hermes keeps a folder per personality — a profile. Make one, drop this file in, and you can point it anywhere.

~/.hermes/profiles/qwen38/config.yaml
# Hermes "qwen38" profile — Qwen 3.8 27B (MLX 4-bit) via Ollama.
# 100% offline. Apple-Metal MLX build. ~25 tok/s warm on an M4 Max.
# Run it with:  hermes -p qwen38

model:
  default: qwen3.8:27b-mlx
  provider: ollama-launch
  base_url: http://127.0.0.1:11434/v1
  context_length: 8192       # ← the setting from §23. keep it small.
  ollama_num_ctx: 8192      # ← this is the one that eats your RAM.

providers:
  ollama-launch:
    api: http://127.0.0.1:11434/v1
    default_model: qwen3.8:27b-mlx
    models:
      - qwen3.8:27b-mlx
    name: Ollama (local, offline)

# nothing in the cloud to fall back to — that is the point
fallback_providers: []

toolsets:
  - hermes-cli

agent:
  max_turns: 60
  gateway_timeout: 1800     # local models think slower than the cloud
  api_max_retries: 2
  tool_use_enforcement: 'off'
  environment_probe: false

terminal:
  backend: local
  cwd: ~/.hermes/profiles/qwen38/workspace

# then:  hermes profile list     → your profile appears in the table
#        hermes -p qwen38        → you are talking to your own machine

What you're watching: the real profile file, scrolling. Watch ollama_num_ctx — that is the setting we come back to at §23.

"A chat box gives you words. Hermes gives you work."
§13 · WHAT HERMES ADDS

Why not just chat to the model?

Same model in both cases. Completely different day.

Tools it runs things, not just describes them Sessions walk away, come back, carry on Skills little files that teach it how you like jobs done Runs alone you do not have to sit there watching it the model thinks · Hermes does

What you're looking at: the four things a bare chat box cannot give you.

§14 · USE CASE 1 — OFFLINE

Turn your wifi off. It still works.

If you handle client files, medical notes or legal work, this is the version of AI you are actually allowed to use.

Read every file in this folder, give me a one-line summary of each, then tell me which three need my attention first.
YOUR MACHINE Your files clients, notes, numbers The model living on your disk answers back to you the internet gets nothing · needs nothing you can switch it off

What you're looking at: nothing crosses the dotted line. That is the whole privacy story, in one picture.

§15 · USE CASE 2 — IT CAN SEE

Hand it a screenshot.

A dashboard, a chart, a messy spreadsheet, a photo of the whiteboard after a meeting.

What am I looking at, and what should I do about it?
a screenshot you took It looks at it on your machine nothing uploaded "Here is what it says, and what to do next." plain English, straight back

What you're looking at: most free local models cannot do this at all. This one reads images out of the box.

§16 · USE CASE 3 — TOOLS

You stop being the hands.

It decides, it runs something, it reads what came back, and it goes round again until the job is done.

1 · It decides what needs doing next 2 · It runs it a real tool, for real 3 · It reads back what actually happened 4 · Round again until the job is done "rename every file to the date it was made" you say it once · it goes and does it

What you're looking at: the loop that turns a chatbot into a worker.

THINKING IT? "Doesn't running an Agent OS burn a fortune in tokens?"

This whole page is the answer to that. The everyday work runs on a free model on your own machine, with no meter at all.

Free APIs slot in alongside it, and for the hard jobs Agent OS drives the CLIs you already pay for — your Claude subscription already includes the Claude CLI, so you are not paying twice. Inside the Boardroom there are full token-efficiency tutorials on top.

§17 · USE CASE 4 — THE THINKING DIAL

Turn thinking down for quick jobs.

Thinking is on by default. For simple questions that is just slow.

off instant answers quick lookups low fast, still careful day-to-day work medium the sensible default most real tasks high let it chew hard problems most people never touch this, then say the model is slow turn it down and the same model feels twice as fast

What you're looking at: the dial nobody touches. Move it and the model feels like a different product.

§18 · USE CASE 5 — 256K CONTEXT

Roughly two long books, in one conversation.

Drop in a whole contract and ask what is hiding in clause forty.

How much it holds at once a short chat window 8K Qwen 3.8 27B 256K a whole contract · a year of notes · all of it at once

What you're looking at: it can spot things across the whole document instead of one page at a time. (Careful — see §23 before you actually turn this all the way up.)

"One is renting. The other is owning."
§19 · OLD WAY VS NEW WAY

The difference is bigger than it looks.

The old way every single month
  • Pick a plan and keep paying for it
  • Wait on somebody else's servers
  • Get rate-limited at the worst moment
  • Stop working when the internet drops
  • Your work sits on their machines
  • They change the model, you adapt
  • Ask less, because asking costs
The new way one download
  • 18 GB once, then nothing, ever
  • It answers from your own chip
  • No queue, no limit, no throttle
  • Works with the wifi switched off
  • Nothing you type ever leaves the room
  • The model only changes when you say so
  • Ask everything, because asking is free

What you're looking at: same work, two completely different relationships with it.

§20 · THREE BELIEFS TO DROP

The three things I hear every time.

Wrong: "Local models are rubbish compared to the big ones."

Right: That was true two years ago. This one is 27 billion parameters, reads images and uses tools — the gap closed while people were repeating the old line.

Wrong: "This is too technical for me."

Right: It is four commands — check, upgrade, download, launch. Every one of them is printed on this page.

Wrong: "I already pay for an AI, so there is no point."

Right: Keep it. This is a second worker who never sends an invoice — free one for the 90% that is grunt work, paid one for the hard 10%.

4,000+ founders inside AIPB
258 documented wins
400k YouTube subscribers
38 countries
163k X followers
Don't take my word for it

Members post their wins every day — agency owners, ecom founders, course creators and solo operators across 38 countries. Real businesses, real numbers, in their own words.

Read the 158-page wins doc →
§21 · GET IT BUILT FOR YOU Skip the setup

Get the free local AI system built for you.

You can wire all of this yourself from this page. Or get the whole thing done, inside the Agent Operating System.

The local brain, pre-wired — the free model and the Hermes profiles already set up exactly like mine
The full Agent OS pack — install-ready in an afternoon, not a year of trial and error
Every AI you already pay for, in one dashboard — Claude, Codex, Gemini and the rest, sharing one memory
Agents that work while you sleep — plan, build, review, without you sitting there
Four live coaching calls a week — get unstuck by people who have hit your exact error message
Daily tutorials as new models land — and they land constantly
4,000+ founders across 38 countries — running this exact stack right now
Get the Agent OS → Inside the AI Profit Boardroom · skool.com/ai-profit-lab
Set up in an afternoon · used in 38 countries · new tools added the week they ship
§22 · THE HONEST BIT

This thing is heavy. Here's what happened to me.

Eighteen gigabytes sits in your memory while the model is awake.

I set it up greedy, left everything else running, and my whole Mac crawled.

What 36 GB of memory actually holds GREEDY SETUP the model · 18 GB reserved context Chrome + apps over → your Mac starts swapping, and everything crawls LEAN SETUP (§23) the model · 18 GB ctx Chrome + apps room to breathe

What you're looking at: same model, same Mac. The only difference is two settings — and they are in the next section.

§23 · THE FIX — TWO SETTINGS

Ten seconds, and your Mac stays usable.

The model reserves memory for your whole context number the moment it wakes up, whether you use it or not.

So drop it, and tell the model to let go when you stop working.

1 · ollama_num_ctx 65536 · greedy 8192 plenty for normal work 2 · keep_alive holds your RAM all day 5m lets go when you stop

What you're looking at: put the context back up only when you actually need to feed it a book.

THINKING IT? "So the 256K context was a lie?"

No — the model really does hold it. Your Mac just has to be able to afford it.

Keep it small for daily work and raise it for the one job that needs it. That is a choice you only get to make because the model is yours.

§24 · THE EMERGENCY BRAKE

Give your memory back, instantly.

Two commands. One puts it to sleep, one proves it worked.

ollama stop qwen3.8:27b-mlx && ollama ps

What you're watching: the real unload. The table comes back empty and the RAM is yours again. The model is still on your disk — the next question wakes it up.

§25 · WHICH MAC

Be honest about which row you're in.

A smaller model that runs beautifully beats a big one that makes you hate your computer.

Running the 27B on your Mac 16 GB No it will swap and crawl — run a small model instead 24 GB Painful technically yes, practically not worth it 32–36 GB Yes with the lean settings from §23, and close some tabs ← mine 64 GB+ Comfortable leave it running all day and stop thinking about it

What you're looking at: my own verdict after running it on a 36 GB machine. I'm in row three, and row three needs the settings.

§26 · WHAT IT COSTS

Asking becomes free. That changes how you work.

Disk space and a bit of electricity. That is the whole bill.

Cost over twelve months a monthly plan · keeps climbing your own model · flat, forever £££ free when asking is free, you ask more — and asking more is the whole game

What you're looking at: no key, no account, no meter. Every question you ask for the rest of the year adds nothing.

§27 · THE SOURCES

Read it and run it yourself.

Everything on this page comes from the official pages. Click any of them and check me.

Official sources + resources ↓
§28 · THE RECAP

Four commands and two numbers.

i · you stopped rentingThe brain lives on your disk

One 18 GB download and it is yours. No key, no account, nobody to switch it off.

ii · you stopped waiting24.9 tokens a second

About three times faster than you read out loud, measured warm on an M4 Max.

iii · you stopped uploadingYour work never leaves

Turn the wifi off and it still answers. Client files stay client files.

iv · you stopped guessingOne line wires Hermes

ollama launch hermes --model qwen3.8

v · you stopped choking your MacContext 8192, keep_alive 5m

The two settings that decide whether this is a joy or a nightmare.

vi · you got a dialThinking off for quick jobs

Turn it down and the same model feels twice as fast.

§29 · YOUR MOVE Your move

Or get the whole Agent Operating System.

This page gives you one free brain on your own machine. The Agent Operating System gives you everything I built around it — the local model already wired in, Hermes profiles already made, and every AI you pay for and every AI that is free sitting in one dashboard, sharing one memory.

Four coaching calls a week where we set it up on your machine with you. Daily tutorials as new models land. 4,000+ founders across 38 countries running it right now.

Readers bookmark this page and never open the Terminal. Operators install it tonight and wake up with an AI employee that works for free.

Get the Agent OS → Inside the AI Profit Boardroom · skool.com/ai-profit-lab
258 documented member wins · 38 countries · 4 live calls a week · everything from this guide, pre-wired