sethserver.com Subscribe
Four colorful cartoon robots (orange, blue, pink, and lime green) sit in a row against a beige and purple background, each with speech bubbles above them containing various icons and symbols including emojis, arrows, houses, and geometric shapes.

Mistral Moves Closer to My Fantasy with Mistral Small 4

By Seth Black • Updated: March 20, 2026

AI · 4 min read

Like this kind of writing? Get one email a week with notes on startups, AI, and the occasional strong opinion about Python: subscribe to the newsletter.

I have a weird hobby: I actually read documentation. Like, for fun. I joke that my superpower is RTFM, but it's not really a joke. Manuals are where the truth lives. Marketing pages are where the vibes live.

That's why I perk up when a model release isn't just another model with more parameters than the last one, but instead looks like a real attempt to make one thing you can actually use that fits into a normal engineering stack. Mistral Small 4 is one of those.

Mistral Small 4 is basically my "make it run locally" fantasy

The headline is: Mistral Small 4 is their new top Small-series model, but it's trying to be the one model you can throw at a messy product and have it handle text, images, and code without breaking.

Not as three separate models duct-taped together. As one.

They're blending ideas from:

If you've ever built a pipeline where you had to route requests between "the vision model" and "the reasoning model" and "the code one," you already know how fast that turns into a spaghetti monster. Half your bugs are glue code bugs.

The MoE part is the part I care about

Small 4 is 119B total parameters, but it's a sparse Mixture-of-Experts model. Translation: not all 119B get used every time. Only a subset of experts fire per token.

This is the direction I want the industry to keep going.

Because I'm still stuck on the same dream: shrink these things down until they run on a phone, or at least on a small on-prem box without needing a small power plant. I don't need a model that can write a sonnet about my toaster. I need one that can read my docs, parse a screenshot, and stop lying about what it saw.

And yes, I learned the word hallucination the fun way: by watching ChatGPT 3.5 confidently invent facts while I stared at the output like, "Wait, what? That's not even close to true." Early days were wild. Context windows were tiny. Tokens were precious. You'd spend half your prompt budget just explaining the job.

MoE is one of the few "big model" tricks that can still help the small models solving boring, practical problems world.

Reasoning effort is a knob I actually want

Small 4 also has configurable reasoning effort. That's a fancy way of saying you can trade speed for depth.

I like this because it matches how real products work:

If you're building something like an AI support agent, a "quick skim" mode is fine for easy tickets. For the nasty ones, you want the model to burn more cycles and show its work (at least internally).

Why unified multimodal matters (and why I don't trust it yet)

Text + images in one model is the right direction. I have too many ideas that involve AI + robotics + Halloween decorations. Not the lame "pressure pad jumpscare skeleton" stuff. I want props that can see you, decide what you're doing, and adapt the puzzle. Like an escape room, but in your front yard.

To do that, I need vision that doesn't require a separate service and a separate prompt format and a separate set of failure modes.

That said, I'm always skeptical until I can break it myself.

I once built an AI survey system where generated personas answered questions. The persona would be: "janitor, $15k/year," and then you'd ask, "What's your job title?" and it would answer: "CEO." Salary? "$35k." Completely off the rails.

That experience burned one lesson into my brain: LLMs are token predictors, not tiny people. "Janitor" and "CEO" both live near "job." The model grabs what's statistically comfy, not what's logically consistent.

So if Small 4 can unify reasoning, vision, and coding, great. But I'm still going to poke at it until something breaks.

The self-hosting angle is the real selling point

Mistral is leaning into open weights and support for:

That matters if you're building a startup that can't ship customer data to OpenAI and hope they don't train on it. On-prem installs are real. Manufacturing is real. A Jetson-class GPU attached to small servers can do real work. You don't need AWS or Google Cloud to classify parts, read gauges, or guide a robot arm.

This is the lane I want: smaller models, tighter stacks, local control, fewer moving parts.

Mistral Small 4 feels closer to that than most releases this year.

Now I just need it to stop telling me the janitor is the CEO. I'll let you know how that goes.

-Sethers

Share this post
Newsletter

One email, once a week.

Notes on databases, systems, and the occasional strong opinion about Python. No spam, unsubscribe anytime.

Seth Black
Written by

Seth Black

Engineer and founder based in Texas. Writes about databases, AI, and running things in production. Embeds in small teams as lead engineer.

More from AI

View all →
AI

How to be a Good Farrier: What the Car Teaches Us About AI and Your Job

Nov 10, 2026
AI

Principle of Least Privilege in the AI Age

Apr 14, 2026
AI

How to Actually Secure MCP (Model Context Protocol)

Apr 14, 2026