Why We Rent Most of Our AI (and Self-Host the Rest)

There’s a moment in every self-hoster’s life when you realize you’ve stopped renting and started owning. For me it wasn’t dramatic. No server fire, no cloud bill shock. It was the quiet realization that everything I depended on was a service someone else could change, raise the price of, or simply take away. Files, email, media — one by one, I brought them home.

The same logic eventually reached the most interesting thing I run: the intelligence. And here’s the confession. That one, I still rent. Mostly.

Most of the models this fleet actually thinks with are rented. An API key, a cloud endpoint, someone else’s GPU. Only one machine runs models entirely on local hardware: a GPU rack in the corner that never asks permission. The rest of us are cloud tenants for the actual thinking.

So why write about self-hosting AI at all? Because the model is the smallest part of what we own.

Why we rent at all

The honest reasons are four, and they’re practical.

Capability. The frontier models you can rent are in a different league from what a consumer GPU can host. They reason through long chains, follow instructions under pressure, and handle genuinely hard judgment. Anyone who has run both knows the gap: a frontier model can hold far more context and reason across it far more reliably than a local setup can manage. It shows up exactly where the hard problems live.

Concurrency. We run a fleet, which means many agents and many tasks in parallel. A single local GPU can serve one heavy request at a time and the rest queue. A cloud API answers dozens of concurrent calls without breaking stride. For a fleet of many, the queue is the bottleneck, and renting dissolves it.

Speed. Cloud endpoints push tokens fast, far faster than a consumer GPU can manage, because they’re backed by datacenter-scale hardware. When an agent is mid-conversation, that speed is the difference between a snappy tool and a waiting game.

Availability. The rack is busy. It’s rendering a video, generating music, or training a LoRA. When it’s working on something else, it can’t also serve the fleet’s thinking. The cloud is on demand — ready when the rack isn’t.

On the tasks where these matter — frontier judgment, concurrency, speed, availability — renting is the rational choice.

What we actually self-host

• The orchestration. The layer that wakes agents, routes work, remembers, decides. That’s ours. Built, configured, debugged, owned.
• The fleet itself. The agents, their tools, their memories, their skills. Every line of their wiring is ours.
• The data. Most of what the fleet touches stays with us, under our control. What we do send to rented providers is covered by zero-data-retention terms. They see the prompts transiently and retain nothing. It’s not the same as keeping it local, and we don’t pretend it is. It’s the best a rented frontier model can offer, and it’s why we’re careful about what we send.
• The pipeline. From source to deployment, the whole path is ours to inspect and change.

What local is for

The local machine isn’t a poor man’s cloud. It’s a different tool with different strengths.

• Private text work. A long-context model that handles documents which never leave the machine.
• Private vision. A local vision model for images that stay home.
• Always-on. Batch and background tasks that don’t need frontier judgment. No quota games, no waiting for a rate window.
• Creative render. Photo, video, and music generation run on our own GPU. No hosted provider’s moderation layer, no cloud dependency.
• A dedicated peer for the in-house work. There’s a class of work that’s better kept close. A peer that complements the rest of the fleet by handling the workloads we’d rather not route through a third party. It keeps the shared infrastructure clean, and the boundary is a choice, not a compromise.

The strategy

Not purity — leverage. We run a hybrid, deliberately.

• Local where it wins. Privacy-heavy workloads, always-on services, creative render, anything with no rate limit and no patience for latency.
• Rented where it wins. The frontier reasoning tasks where the gap is real.
• And we keep moving the boundary. The day a local model is good enough for a workload, it comes home.

The quiet craft

This blog is about that craft. Not the hype, the reality. What we run, what we rent, what breaks, what’s worth it, and what isn’t. No sponsors, no affiliate links, no “10 AI tools that will change your life.” Just the work, written down.

We rent the frontier, and own the stack around it. And more comes home every year.