Agentic delivery 12 min read

Vibe Coding vs Orchestrated AI Engineering

Both use AI to create software. The difference is who owns the decisions, how the work is checked and what must be proven before a product reaches customers.

Several specialist AI workstreams converging through human review into one production release

Vibe coding and orchestrated AI engineering both use AI to create software quickly. The difference is not whether a person or a model typed the code. The difference is who owns the decisions, how independent checks work and what must be proven before customers, data or money depend on the result.

Vibe coding is excellent for exploring an idea and creating a tangible brief. Orchestrated AI engineering is the controlled process we use when the result needs to become a production product. It combines specialist agents, independent models, experienced engineering judgement, source control, automated tests, security review and an explicit release gate.

The first method creates possibility. The second creates accountable delivery.

The short comparison

QuestionVibe codingOrchestrated AI engineering
Who directs the work?A founder or maker prompts one platform towards the desired resultA lead engineer turns the outcome into bounded work for specialist agents and reviewers
What is the main goal?Make the idea tangible and iterate quicklyShip and operate software against defined product, quality and risk requirements
How much context is controlled?Usually the current conversation, connected files and whatever the platform retrievesRepository rules, product evidence, architecture, issue scope, source material and acceptance tests are assembled deliberately
Who checks the code?Often the same model or platform that wrote itDeterministic tests plus an independent reviewer that did not author the change
How are models used?Usually one product chooses and routes the modelDifferent models can be selected for research, architecture, implementation, challenge and review
How are changes isolated?Checkpoints or platform historyGit branches, worktrees, commits, pull requests and reversible deployments
What happens before release?The preview works and the maker decides to publishThe agreed tests pass, risks are triaged, the rendered product is checked and a named human authorises release
Who owns a failure?Often unclear once the prompt sequence becomes complexCode23 owns the delivery process, evidence and decision to ship

This is not a claim that every professional build must be slow or surrounded by meetings. Our process is agent-led precisely because we want the speed. The control layer exists so that speed survives contact with a real product.

Why one AI never has the complete answer

Frontier models are extremely capable, but each answer is produced from a bounded context. The model sees the files, instructions, tools and evidence available in that moment. It does not automatically know every earlier product decision, hidden operational constraint or future consequence.

Four problems follow:

  1. Context is incomplete. A model can implement the visible requirement while missing a business rule in another system or a decision that was never written down.
  2. Output is probabilistic. The same model can take different paths on the same task. Fluent code is not proof that the trade-offs were considered.
  3. Strengths differ. One model may be better at repository-wide implementation, another at research, another at adversarial review or visual reasoning.
  4. Self-review is weak evidence. Asking the authoring model whether its own work is correct often repeats the same assumptions in a more confident form.

That is why our orchestration layer is not simply a better prompt. It is a working system that supplies context, separates responsibilities and requires evidence at each handover.

What the orchestration layer actually does

The model names are less important than the job design, but clients should understand what changes behind the scenes.

1. Turn the idea into inspectable work

We start with the customer outcome, not the code. A founder’s prototype is welcome because it makes the intended product visible. We then identify the user journeys, business rules, risks and unresolved assumptions that the first production release must address.

The result is not an enormous specification. It is a set of bounded tasks with acceptance criteria and a known relationship to the product decision.

2. Assemble the right context

Agents receive the repository rules, relevant product notes, current issue, source evidence, architecture and tests required for their task. They do not need every document the company has ever produced. They need the smallest reliable context that prevents them inventing the missing pieces.

This matters because more context is not automatically better. A large, messy prompt can bury the one rule that should have controlled the change.

3. Split the work by responsibility

A typical build may use distinct roles for:

  • Researching current standards, APIs or platform behaviour
  • Mapping the architecture and change boundary
  • Building a feature in an isolated branch
  • Writing and running deterministic tests
  • Checking security, data handling and failure paths
  • Reviewing the finished change without inheriting the builder’s assumptions
  • Verifying the rendered product and production deployment

These can run in parallel where the work is genuinely independent. They come back together through code and evidence, not through a vague summary that asks the next model to trust the previous one.

4. Use a model council when the decision benefits from disagreement

For important architecture, risk or review decisions, we can ask several frontier models for independent assessments. Depending on the job, that council may include Codex, Claude, Grok, Kimi or Qwen. We do not ask five models to produce five versions of the same paragraph for decoration.

Each model gets a defined question. One may inspect architecture and migration risk. Another may challenge the security boundary. Another may look for product or usability gaps. The lead then reconciles the evidence, records disagreements and chooses the path.

Majority vote is not the goal. Three models can share the same missing context. A minority finding supported by the code or a failing test matters more than four confident opinions.

5. Keep changes isolated and reversible

Agents work through version control. Changes are tied to an issue, built away from unrelated work and committed in a form another person or model can inspect. Pull requests and previews make the effect visible before production.

That gives us an audit trail and a safe route back. It also stops parallel agents overwriting each other simply because they were both told to “improve the app”.

6. Make tests part of the build

A green preview proves that one path rendered once. It does not prove permissions, error handling, data integrity, accessibility or recovery.

We combine different kinds of checks:

  • Unit tests for important rules and calculations
  • Integration tests for services, storage and APIs
  • Contract tests for content, schemas and public promises
  • Browser and accessibility checks for real journeys
  • Security checks for dependencies, secrets and unsafe boundaries
  • Production checks against the deployed URLs and expected responses

The exact set depends on the risk. A brochure page and a platform moving customer money do not need the same test plan.

7. Put a human at the release boundary

Agents can build, test and review. A named person still owns the decision to release work that affects customers, money, sensitive data or something difficult to reverse.

That is not a ceremonial click. The release owner checks that the evidence matches the change, that open findings are understood and that production can be observed or rolled back. Low-risk reversible work can move quickly. Higher-risk work gets a proportionate gate.

How security changes when the prototype becomes a product

Security is not a final scan added after the product looks finished. It starts with what the software can access and what a mistake would do.

Our production pass considers:

  • Authentication and server-enforced permissions
  • Separation between customers, roles and organisations
  • Secret storage and removal of exposed credentials from history
  • Personal-data collection, minimisation and retention
  • Input validation and safe output handling
  • Dependency and supply-chain risk
  • Payment webhooks, retries, limits and duplicate actions
  • Logging that is useful without leaking confidential data
  • Backups, recovery, monitoring and ownership after launch
  • Human approval around customer communication, money and irreversible actions

AI can help inspect each of these areas. It cannot set the acceptable risk on behalf of the client, and it cannot prove a control merely by describing one.

What happens to client code and data?

Code23 does not use client code, private project material or customer data to train our own AI models. Repositories stay private, access is limited to the work being done and client material is only supplied to approved tools where it is needed for the task.

We use business or API access with the relevant provider data controls rather than treating a public consumer chat as a development environment. Provider choice can vary by task, so the tooling and data boundary should be confirmed for the project rather than hidden behind a blanket “AI-powered” claim.

We also minimise what each agent receives. A content reviewer does not need production credentials. A visual QA agent does not need a customer export. A model checking a migration plan may need the schema and constraints, not the confidential records inside it.

If a client has a stricter provider, location or retention requirement, that becomes an architecture constraint before the work starts.

What Code23 engineers still do

AI changes the amount of software one experienced person can direct. It does not remove the work of deciding what should exist and taking responsibility for the result.

Our engineers still:

  • Challenge the product and commercial assumptions
  • Choose the architecture and decide where complexity is justified
  • Define what evidence is needed before more money is committed
  • Decide what generated code can stay
  • Resolve conflicts between models and between requirements
  • Own security and data decisions with the client
  • Review the working product, not only the source files
  • Decide whether the release evidence is strong enough to ship
  • Support, monitor and improve the product after launch

This is where twenty years of product and engineering experience compounds with AI. The agents create far more implementation capacity. Experience directs that capacity and spots when a fast answer is solving the wrong problem.

Can a founder’s existing code enter this process?

Yes. That is now one of our preferred ways to receive a brief.

We do not begin with the assumption that vibe-coded code must be discarded. We audit the product and the repository, then give important areas a clear decision:

  • Retain: sound enough to continue with normal review and tests
  • Refactor: the behaviour is useful, but the structure or controls need work
  • Rebuild: the risk, lock-in or hidden assumptions make replacement safer
  • Defer: not needed for the first release or not supported by evidence yet

The founder’s guide to vibe coding explains how to build and hand over that first artefact. Our prototype vs MVP guide helps classify what you have actually built.

Where AI consultancy fits

Some businesses want the delivery system, not only one product. They want teams using AI across sales, operations, support, knowledge and software development without everybody inventing their own rules.

That is an AI consultancy question. Our AI Implementation Workshop is £2,500 + VAT, runs for four hours with up to four attendees and produces a written 90-day plan within five working days. The plan covers people, processes, tools, data, responsibilities, costs and success measures. It may recommend training, existing software, workflow changes, automation or custom development. It does not force every problem into a bespoke AI build.

For a founder with one working prototype, a product and code audit is usually the more direct conversation. For a leadership team that wants this way of working across the company, start with the workshop.

FAQ

Is orchestrated AI engineering just agentic coding?

Agentic coding is part of it. The orchestration also controls context, task ownership, independent review, test evidence, data access, release authority and the handover between agents and people.

Does every change go to several models?

No. That would add cost without improving every decision. We use multiple models when independent perspectives materially reduce uncertainty, such as architecture, security, unfamiliar systems or final review. Simple deterministic work should stay simple.

Are AI-generated tests trustworthy?

They are useful evidence, not automatic proof. A test can repeat the same misunderstanding as the implementation. Important acceptance criteria come from the product and risk, and independent review checks whether the tests cover the real failure modes.

Is this slower than using a single app builder?

It adds controls, but specialist agents can research, build and test in parallel. For production work it is usually faster than repairing a growing product after unreviewed assumptions have spread across the codebase.

Can Code23 work with Lovable, Bolt, Replit or v0 code?

Yes. We have used the main prompt-to-app platforms and can assess exported repositories from them. The platform is less important than access to the code, connected services, product evidence and the ability to test the result.

Does Code23 train models on client work?

No. We do not use client code, private project material or customer data to train our own models. We still confirm the external provider and data controls appropriate to each project because “not training a model” is only one part of protecting client information.

Sources

Next step

If you already have a working AI-built prototype, show us what you have. We will challenge the product, inspect the code and map what should be retained, refactored, rebuilt or left out of the first production release.

"We've recently completed Phase 1 of a bespoke business valuation tool with James at Code23, and I've been extremely impressed. He took the time to understand both the commercial and technical requirements, communicated clearly throughout, and delivered a well-thought-out system."

Jason Atkins Director, Lansley Commercial

Move beyond the demo

Turn your AI-built prototype into software people can depend on.

We'll audit the product and code, then give each part a clear retain, refactor or rebuild decision before planning the production release.

James Ansell

Written by

James Ansell

Founder & Director

James founded Code23 in 2005 and leads its AI, product and engineering work across marketplaces, SaaS platforms and websites.

Related

More from the blog

Engineering deep-dives, product updates, and notes from the team.

View all posts