Section 06

Operate and assure

Run the factory and its agents, respond to incidents, assure and measure.

6 pages · about 253 min of reading

  1. Operating Guide 41 min Operate the Agent Lifecycle Inventory, register, sign, zone, review, suspend, recover and retire agents through a six-stage lifecycle with named human ownership, zone-specific authority and evidence at every transition.
  2. Operating Guide 42 min Respond to Agent Incidents Sort an agent failure into one of four incident shapes, suspend it in three verified layers, keep humans on every classification and disclosure decision, route one playbook to every authority that needs a cover sheet, and close each incident with a named control change.
  3. Operating Guide 49 min Run the AI Delivery Factory Operate demand, capacity, the two worker classes, exceptions and evidence as one service: read two leading numbers, keep a handover backlog, gate construction on three conditions, run queues and alerts at agent volume, and count unused products as cost.
  4. Operating Guide 36 min Measure the Factory Read usage first, then the seven-dimension scorecard; emit a served-request event that separates human from agent callers; label every reported number by evidence tier; watch the two leading numbers of a control gap; treat an unexplained sharp improvement as an alarm; and never turn a participation metric into a target.
  5. Concept 35 min Agent-Driven Departments What an Agent-Driven Department is and how to test for one, the six-system stack it runs and the order to build it, the measured agent share, and the consolidation boundary: what moves into the department, what stays with the CISO, CRO, DPO and the business, and the order in which to move it.
  6. Operating Guide 50 min Evaluate, Assure and Test Agent Resilience Define a versioned evaluation contract, test the trajectory and the execution boundaries, run three assurance layers into one quarterly pack, map the OWASP Agentic Top 10 to controls that demonstrably fire, bring agents into threat-led penetration testing with a five-section scope, keep a continuous cadence between formal tests, land every finding as a live control-plane artefact, and engineer recovery down to a minimal AI service level on models you host.

← All AI Delivery Factory guidance