Orchestration Is Where Agent Projects Die.
Most agent projects fail in production. The orchestration layer is why.
Deloitte’s Q3 2024 GenAI enterprise survey found that 68% of organisations had moved 30% or fewer of their GenAI experiments fully into production. McKinsey’s 2025 State of AI sharpens the diagnosis: only 21% of companies using GenAI have redesigned the workflows around it — and workflow redesign is the single biggest predictor of EBIT impact. The industry talks about pilot stall constantly. What it talks about far less is where the failure actually happens. It is not in the model. It is not in the data. It is not in the prompt.
It is in the orchestration layer — and that is where Loom builds.
Use this in your next architecture review
Before a pilot is allowed to call itself production-bound, ask the team for four artifacts:
- A replay path. Show one completed run, then replay it from the point of failure with the same state and policy context.
- A terminal-state map. Name every way a request can end: solved, escalated, refused, retried, timed out, or failed.
- An audit record. Produce the evidence a compliance reviewer would need without asking an engineer to reconstruct it from logs.
- A policy surface. Show where governance lives as enforceable configuration, not as prompt text or a wiki page.
If those artifacts do not exist, the risk is not that the agent will be wrong. The risk is that no one will be able to prove what happened when it is wrong.
The wrong autopsy
When an agent program fails in production, the post-mortem usually blames the most visible component. The model hallucinated. The prompt was brittle. The data was stale.
These are real problems. They are also rarely the reason the project gets canceled.
The orchestration layer — the layer that decides what runs when, retries what fails, enforces policy, and produces evidence of what happened — is where the failure often becomes visible. Every popular agent framework was built to optimize for fast prototyping. None of them were built for the conditions a regulated enterprise actually faces: deterministic replay, full audit trails, declarative policy enforcement, and survivable failure modes.
The result is predictable. The demo ships. The pilot launches. The first real incident exposes the orchestration layer as a thin wrapper around best-effort calls — and the program stalls inside a compliance review.
The number nobody is quoting
Gartner now predicts that over 40% of agentic AI projects will be canceled by end of 2027. The headline number gets the attention. The reason behind it does not.
Gartner names three causes: escalating costs, unclear business value, and inadequate risk controls. That last phrase carries the weight, and it is not describing a model problem. A model that hallucinates is a quality problem. A model with no controls around it is an orchestration problem.
When a regulated CIO halts an agent program, the post-mortem document does not read the model was wrong. It reads something closer to this: we could not tell what the system did, we could not reproduce the failure, we could not prove what data was used, we could not produce evidence the compliance team would accept.
Every one of those failures lives in the orchestration layer. Every one of them is solvable by design — but only if the orchestration layer was designed for it from the beginning.
What it costs you
In a Fortune 500 environment, we cannot prove what happened is not a developer-velocity problem. It is a board-level audit failure. It triggers procurement holds. It pulls compliance and legal into a conversation that was supposed to be technical. It freezes the surrounding program until the question is resolved — which it rarely is, because the system was never instrumented to answer it.
The companies that defer the orchestration question pay this cost later. And they pay it in quarters, not in sprints.
What enterprise orchestration actually requires
The agent framework debate is mostly a distraction. The question that matters is what your orchestration layer guarantees. There are five guarantees that earn the word enterprise.
Deterministic execution. The same inputs produce the same outputs by design, every run. Not by careful prompt engineering — by construction.
Declarative governance. Policy lives inside the system as enforceable artifacts. Not in pre-prompts. Not in code comments. Not in a Confluence page nobody reads.
Trace-first observability. Every decision, every model call, every retry, every refusal is recorded as primary evidence. Logs are a byproduct of the system, not an afterthought instrumented on top of it.
Replay. Any run can be resumed from any point, with full state restoration. The board can be shown what the system did. The regulator can be shown what the system would do.
Refusal over guessing. Missing or invalid inputs produce structured errors. The system declines to act when it cannot act correctly. Best-effort guessing is exactly the behaviour that fails a compliance review.
How we work
At Loom, we use these principles on engagements where the alternative — a popular framework prototype dropped into a Fortune 500 environment — will not survive the first compliance review.
The orchestration substrate we built and run on these engagements is designed for exactly that environment. It is the layer underneath the agent: the layer that takes a system from the demo worked to we ran it for ten years and proved every decision.
We deploy it as part of Forward-Deployed Engineering and Enterprise Transformation engagements. Our senior practitioners embed with your team, in your codebase, against your real infrastructure. We design the orchestration layer first, the agents second. The order matters.
This is not a framework we are selling. It is how we work. The substrate exists because the question we are paid to answer is not can we make a demo work, but can we run this for ten years and prove it.
When to talk to us
The first compliance review is the wrong moment to learn what your orchestration layer doesn’t do. Talk to us before the framework decision, not after the audit.
Once the layer is in place, the signals it exposes become the SLOs your reliability work writes against. The substrate question is not can this work? — it is can you prove it worked, ten years from now?
References
- Deloitte, Despite Increased Investment and Early Enthusiasm, Data and Risk Remain Key Challenges to Scaling Generative AI (2024). deloitte.com
- McKinsey, The State of AI (November 2025). mckinsey.com
- Gartner, Gartner Predicts Over 40% of Agentic AI Projects Will Be Canceled by End of 2027 (2025). gartner.com
About the author
Kevin Dickerson is a co-founder of Loom. His machine learning research predates the LLM era, and he has worked at the frontier of production AI across cloud platforms, semiconductor companies, and enterprise programs.
Continue reading
Build vs. Buy in the Agent Era: A Decision Framework.
The build-vs-buy decision is not about engineering capability. It is about whether you can sustain the thing you build.
Enterprise TransformationWhat Cloud Transformation Taught Me About Agentic Programs.
The hardest lessons of enterprise cloud transformation are about to be relearned in AI. Most of them are organisational, not technical.
CAIOThe Fractional CAIO Playbook.
Most full-time Chief AI Officer hires at this stage will fail. The work is real. The shape of the hire is wrong.