Skip to content

Agent Infrastructure Is No Longer Research. It Is Production Engineering.

#llm-agents #agent-infrastructure #governance #agent-skills #agent-runtimes

Agent engineering stopped being research approximately six months ago.

Nobody announced this. There was no press release, no keynote, no watershed paper. It just quietly crossed the line. Today if you are building agents you do not need to invent architecture. You do not need to write a new loop. You do not need to prove the concept works.

You need to do production engineering. There are standard components. There are known failure modes. There are boring, proven pieces that work, and shiny new pieces that will burn you at 3am. This is the current state of the field as of July 2026.

The agent is the log

This is the single most important operational insight anyone has published about agents in the last twelve months.

Most people think an agent is the model, the runtime, or the loop executing the task. Those are just interpreters. The agent is its append-only event log. Every user input, model output, tool call, and tool result. Nothing else.

If you get this right, every other problem gets easier. If you get this wrong, nothing else will ever work reliably.

There is no other state. No in-memory session. No sticky worker. The runtime reads the log, advances exactly one step, writes the next event back, and exits. Any worker can pick up any log at any time and resume exactly where the last one left off.

This gives you fault tolerance, scalability, forking, migration, and audit for free. Every production agent system that has stayed up longer than three weeks has independently converged on this design.

The only meaningful disagreement is about sufficiency. The log is necessary. It is not sufficient. The model supplies today's competence. The log carries who the agent has been and what it owes.

Memory does not make models smarter

The single most replicated negative result in agent research right now: generic memory systems do not improve output quality.

A recent benchmark ran 250 tasks with and without a state of the art agent memory layer. The score difference was +0.12 on a 10 point scale. That is not measurement error. That is nothing.

Memory does not add general intelligence. The model already has all the general intelligence you are going to get baked into its weights. If you are recalling something the model already knows, you are just adding latency.

Memory only works when it holds contingent information. Information that is not true in general. Information that is true here.

Information typeValue as memory
Generic coding best practicesNegative value
How database migrations usually failNo measurable value
That this codebase failed the last migration because of a deprecated Redis keyExtremely high value
How to write concise technical answersNo measurable value
That this specific user hates polite filler and wants only raw factsExtremely high value
Standard customer support triage procedureNo measurable value
That this customer always reports billing bugs using the wrong product nameExtremely high value

Stop building generic memory layers. Stop doing semantic similarity search over everything. Build retrieval that triggers only when the answer is underdetermined by general knowledge.

Loop engineering is not a paradigm. It is a bug fix.

Loop engineering is the most overhyped and simultaneously most useful practice right now.

Ignore all the marketing. A loop is just: give the agent a goal and a verifiable stop condition, then let it run until it hits one or the other.

That is it.

Loops work extremely well when the stop condition lives outside the agent. CI test output is perfect. A linter exit code works. A human approval works.

Loops fail catastrophically when the agent is allowed to grade its own work. A confidently wrong answer will always pass its own check. The loop will halt on a false green, or run forever burning tokens.

The only hard part of loop engineering is designing the stop condition. Everything else is syntax.

You do not need to learn a new framework for this. You do not need a certification. You just need to never ask the agent to verify its own output.

Skills are the new standard interface

Agent Skills won. There is no longer any serious debate about the standard way to package capabilities for agents.

A skill is a folder with a SKILL.md file, optional scripts, reference material and templates. Agents load only the name and description at startup. They load the full instructions only when the skill is actually required.

This standard is implemented by Claude Code, Codex, Cursor, Windsurf, Aider, Kilo Code and every other major agent client. 350+ production ready skills are already available.

This is the first successful cross-vendor standard in agent infrastructure. Nobody planned it. Nobody announced it. It just emerged and everyone adopted it because it solved the exact right problem in the exact right way.

Fuzzing skill composition

Skill marketplaces have a silent failure mode. Individually benign skills can interact to produce unintended behaviour. This is not a theoretical risk.

SkillFuzz found over 1000 distinct implicit intents in public skill repositories. 80% of the highest risk compositions confirmed at execution time.

Nobody audits skill interactions today. Everyone audits skills in isolation. This is the same mistake the early app store made.

You will not solve this with prompt engineering. You will solve this with fuzzing. Contract guided MCTS over the composition space. Differential testing against a skill free baseline. This is boring, proven software engineering practice applied to agents.

Governance is done outside the prompt

Prompt level safety is not a control. It is a polite request to a stochastic system.

Every independent red team published in the last 12 months has achieved 100% attack success rate against every major model when given logprob access. You cannot win this fight inside the prompt.

Microsoft Agent Governance Toolkit got this right. Every tool call is intercepted in deterministic application code before it leaves the process. Denied actions are not unlikely. They are structurally impossible.

This is not controversial anymore. If you are running agents in production and you do not have an out of band policy enforcement layer, you will get breached. It is only a matter of time.

Program as weights changes the cost equation

PAW is the most interesting architecture paper published this quarter.

Instead of calling a large model every time you run a function, you call it once to compile a small reusable adapter. That adapter runs locally on a 0.6B interpreter. It matches the performance of the 32B base model while using 1/50th the memory and running at 30 tokens/s on a MacBook M3.

This reframes the foundation model from a per input problem solver into a tool builder. You invoke it once per function definition. Subsequent calls are cheap and offline.

This is not production ready today. But this is the direction everything will move over the next 12 months.

Modular decomposition beats sampling

Repeated sampling scales test time compute linearly with cost. RL improves single attempt accuracy at the expense of diversity. Both fail completely when the base model has near zero probability of producing a correct solution.

DecompRL takes a different approach. Instead of sampling harder, it decomposes the problem into smaller independently solvable sub functions. Recombining k implementations of n modules yields up to k^n candidate solutions. This shifts the bottleneck from GPU inference to cheap CPU evaluation and cuts GPU token cost by ~50x.

This is the correct way to solve hard problems with agents. Stop rolling the dice more times. Start making the problem smaller.

Uncertainty propagation stops hallucination cascades

Multi agent systems fail for one reason above all others: they assume all intermediate outputs are equally reliable. A hallucination generated in the first phase propagates unchanged through every downstream agent, and nobody ever checks.

UA-ChatDev fixes this. It attaches a token level uncertainty score to every agent output. When uncertainty exceeds a phase specific threshold it triggers verification. No magic. No new architecture. Just track confidence and stop when you are not sure.

This is such an obvious improvement it will be standard in every multi agent framework by the end of the year.

What you should build right now

If you are building agents in production today:

  1. Build everything around an append only event log. This is non negotiable.
  2. Do not build a generic memory layer. Build retrieval for contingent local state only.
  3. Use the Agent Skills standard. Do not invent your own capability format.
  4. Put a deterministic policy enforcement layer in front of all tool calls. Do not rely on prompts.
  5. For loops, always use an external stop condition. Never let the agent verify its own work.
  6. Track uncertainty. Stop and verify when confidence drops.

Everything else is optional. Everything else is hype.

Agent infrastructure is no longer exciting. That is good news. Exciting technology breaks. Boring technology works. We have finally reached the boring part.