Hunter Brennick AI Systems & Advisory ↗
AI Systems Orchestration
Part IV · Operating Agentic Systems/Chapter 15
15

Platform Engineering For Agentic Systems

From building agentic systems to operating them as a real platform: catalogs, contracts, evals, governance, and maturity.

10 min read2 figures
The gist
  • The agent is not the platform. The platform makes agent work repeatable, governed, and measurable.
  • Climb the maturity ladder L0 tool pile → L5 human gated self improvement. Each level makes the next safe.
  • Build the boring artifacts first: manifests, run-meta, eval bank, scorecards.
  • Metadata before portal. The interface is easy once the platform can describe itself.

The Better Name

"Agent platform" is useful shorthand. It is overloaded.

It can mean
  • a model provider's agent SDK
  • a runtime for agent workflows
  • a marketplace of agents
  • an internal developer platform used by agents
  • a local control plane for workflows and tools and artifacts and client installs

For this curriculum the cleaner term is:

agentic internal developer platform

That means a platform that makes agentic work repeatable and inspectable and governed and easier to improve.

Platform Engineering Is The Baseline

Platform engineering is not just infrastructure. The mature version treats the platform as a product. It has:

  • users
  • supported paths
  • interfaces
  • operations
  • measurement
  • a roadmap

And it improves based on feedback.

In normal software teams this often becomes an internal developer platform.

In agentic systems the same idea expands to:

  • workflow catalogs
  • knowledge and context and tool contracts
  • MCP servers and profiles
  • generated client-native surfaces
  • artifact and run metadata contracts
  • evals and guardrails
  • traces and provenance
  • human approval gates
  • platform scorecards

The platform is not the agent. The platform is the supported environment that makes agent work reliable.

The Agentic Platform Layers

THE AGENTIC PLATFORM LAYERS User goalthe work someone needs done Workflow catalogdiscoverable · supported Contractsknowledge · context · tools Runtimestate · durability Artifactsrun metadata · evidence Evals · traces · reviewcorrect · grounded · safe Measurementscorecards · cost · friction Improvement backlogrepeated friction · planned work EACH LAYER HAS A JOB catalog · make repeatable work discoverable. contracts · define authority and permissions. runtime · execute with the right durability. artifacts · preserve evidence. evals · decide whether work was correct. measurement · show whether the platform improves. the platform is not the agent · it is the supported environment that makes agent work reliable
FIG 15.1The agentic platform layers: from user goal back to improvement backlog.

Each layer has a job.

Layer Job
Workflow catalog Make repeatable work discoverable and supported.
Knowledge, context, and tool contracts Define which sources are authoritative, what the agent can see, and what it can do.
Runtime Execute the work with the right amount of state, branching, and durability.
Artifacts Preserve evidence and make results inspectable.
Evals and traces Decide whether the work was correct, grounded, and safe.
Measurement Show whether the platform is improving.
Improvement backlog Turn repeated friction into planned platform work.

The platform does not need to own every knowledge source. It needs to describe:

  • how workflows reach sources
  • which sources have authority
  • how context is selected
  • when memory must be revalidated

Connectors provide access; they do not become sources of truth merely because an agent can call them.

A Practical Maturity Ladder

Use this as the operating model.

Level Name What it looks like
0 Tool pile Prompts, scripts, and agent clients are disconnected.
1 Managed workflow library Reusable workflows exist, but validation and metadata are uneven.
2 Reproducible multi-client platform Workflows have canonical source, generated installs, artifacts, and basic checks.
3 Governed agentic platform Tool permissions, evals, run metadata, provenance, and human gates are first-class.
4 Measured platform product Adoption, quality, cost, reliability, and user friction guide roadmap decisions.
5 Human-gated self-improvement The platform detects drift, proposes changes, tests them safely, and asks before applying.

The goal is not to rush to Level 5.

The goal is to make each lower level real enough that the next level is safe.

THE MATURITY LADDER L0 · tool pile prompts · scripts · clients · disconnected L1 · managed workflow library reusable workflows · uneven validation L2 · reproducible platform canonical source · generated installs · artifacts L3 · governed platform permissions · evals · provenance · human gates L4 · measured product adoption · quality · cost guide the roadmap L5 · human gated self improvement detects drift · proposes · tests safely · asks first each level makes the next one safe the goal is not to rush to L5 · more autonomy on a shaky level mostly creates ambiguity
FIG 15.2The maturity ladder: from a tool pile to human gated self improvement, one safe level at a time.

Example: A Platform At Level 2

A platform at this stage typically already has several Level 2 traits:

  • canonical workflows
  • a client registry
  • adapters
  • manifests
  • generated client-native surfaces
  • state and artifact paths
  • workflow-sync
  • research and ideation workflows
  • validation concepts

It also tends to have early Level 3 traits. Generated files are treated as read-only outputs. Artifacts preserve evidence. Risky operations require approval. Workflow vocabulary separates source and generated data and state and cache. And local memory carries forward lessons while current sources remain authoritative.

The gaps are usually exactly the operating-layer gaps:

  • workflow evals
  • MCP and tool governance metadata
  • standardized run metadata
  • scorecards
  • self-service discovery
  • measured improvement loops

That means the next move is rarely "make agents more autonomous." It's usually "make the platform more inspectable and measurable."

What Mature Looks Like

A mature agentic internal developer platform can answer:

  • what workflows exist
  • which clients have each workflow installed
  • which tools each workflow can use
  • which tools can write or send or delete or publish
  • what a run read
  • what a run wrote
  • what sources support the conclusion
  • what checks passed
  • what the human approved
  • what failed repeatedly
  • which workflow should be improved next

If the platform cannot answer those questions more autonomy will mostly create more ambiguity.

Platform Artifacts To Build

These are the concrete artifacts that make maturity real:

workflow manifest
run-meta.json
tool capability catalog
eval bank
failure corpus
artifact index
client parity report
measurement scorecard
promotion checklist
improvement backlog

The names are boring on purpose. Boring artifacts are easy to inspect and diff and validate and hand to another agent.

The Portal Question

A developer portal is useful. It is not the platform.

For agentic systems a portal or command router should expose the platform:

  • list workflows
  • show required tools
  • show risk level
  • show recent runs
  • show failed checks
  • show artifacts
  • start a run
  • explain what needs approval

But the platform itself is deeper:

canonical source
  + generated installs
  + MCP/tool contracts
  + run state
  + artifacts
  + evals
  + governance
  + measurement

Build the metadata first. The interface gets much easier once the platform can describe itself.

What To Practice

Pick one workflow and write a maturity card:

workflow_id:
owner:
risk_level:
clients:
tools:
artifacts:
run_meta_required:
evals:
human_gates:
known_failure_modes:
measurement:
next_maturity_step:
Then ask
  • whether this workflow is safe to run unattended
  • whether it is safe to write files
  • whether it is safe to call external systems
  • what proof should exist after a run
  • what would make the next run better

That is platform engineering applied to agents.

What To Read With This Chapter

The short version:

The agent is not the platform. The platform is the system that makes agent work repeatable and governed and measurable and improvable.

Keep goingFurther Reading The annotated must reads behind the operating chapters. From Accelerate and Google SRE to MAPE-K and Deming.