From code to production | Blog

~/blog/guide/delivery

From code to production

The agent writes it in an afternoon. Getting it into production still takes a week.

What this guide covers

Writing code got cheap. Reviewing it, testing it, deploying it, keeping it alive and explaining at three in the morning what went wrong all still cost what they cost last year, except a lot more of it arrives now. This cluster is about that second half.

It is also the half I run into hardest myself. I administer my own servers and run my own deploys, so a faster agent reaches me as more review, more deploys and more things to keep alive.

The bottleneck moved downstream

Your 10x developer is gated by a 0.1x pipeline is the piece this guide is built around. Code got cheap, the pipeline that turns code into value never grew with it, so the bottleneck moved on to review, deployment and decision-making. Adding a second agent just pushes that problem into the queue in front of it.

That is why this cluster sits alongside the other four. The rest of the blog covers producing code and judging it. This covers everything that still has to happen before anyone gets any use out of it.

When the answer is more checking

Review is the first thing that broke under the new volume, and the damage is measured. The AI code review bottleneck works through Faros AI's telemetry on 22,000 developers, corrects a figure this site itself had wrong, and lands on the finding the headline buried: reviewers are no longer checking code so much as finishing it.

The tempting fix for that load is one more automated check. The bureaucracy of bots shows where that ends up: a bot reviewing a bot, with nobody at either end who can explain it once it goes wrong. Checking that nobody can account for is not review, it is a rubber stamp.

What you are actually looking for in that review is in the checklist for AI-generated pull requests. The rule underneath it stays never ship code you do not understand, and it weighs more the more of it arrives.

What production tells you afterwards

Some of that queue clears without a person reading it, whatever the policy says. Observability for AI-generated code is about the instrument that picks up where review stopped: why a survey can find 94% of leaders rating AI code higher at review and 82% of them hit by a production failure from it, and what one wide event per request would have to carry to close that gap. The worked example is this site's own chat endpoint, where the audit turned up a failed knowledge-base search landing under the same abuse flag as a refused injection attempt, with no structured field to separate them.

Then it pages somebody. On-call for AI-generated code covers what has to exist before that happens: ownership written in a file, a rollback the database cannot veto, a runbook the alert links to, and provenance you can actually query. It opens on the March dispute between Amazon and the Financial Times over whether AI wrote the code behind a run of outages, which neither party could settle in public, and works out from there why a Co-Authored-By trailer cannot answer the question either. Git attribution when an agent does the work measures that against 1,644 of my own commits: the trailer is absent from all of them, and the author field turns out to be filled in by whoever pressed merge rather than by anything on your own machine.

Where it runs

Deploying is half of it. After that it has to keep running, somewhere you understand. Take back control of your data is about where your stack really sits and what that means the moment the rules or the vendor change. More control over your server is the practical side, with Fail2Ban, ModSecurity and AIDE on a machine I administer myself.

Both also belong in the MCP and security guide. Where something runs and who can reach it are the same question, asked twice.

What is still missing here

This is the youngest of the five guides and it shows. I know what is still absent: what a pipeline costs when an agent pushes ten times a day, how you deploy what nobody read, and why a migration is the one file where rollback is a promise the database never made.

Below are three starting points, then everything in this cluster, newest first.