Body of Knowledge · Chapter 02

02. Why now

AI governance engineering is forming now because the thing being governed changed shape, the market renamed the role before the profession named itself, and the law began asking for engineered evidence — all inside the same eighteen months.

v0.2 · Updated 2026-09-14 · 15 min read · 2,934 words · CC BY 4.0

Disciplines do not appear on a schedule. They appear when an old way of working visibly stops holding and enough people, in enough places, start building the replacement at once. That is happening to AI governance now. The manifesto states five fundamental problems with legacy AI governance; this chapter takes each in turn, attaches the evidence, and then lays out the market, regulatory and technical signals that together explain the timing. The claim is narrow and falsifiable: not that governance suddenly matters, but that the engineering of governance has become the constraint, and that the data now says so.

The five problems, with the evidence

1. Governance written for systems that no longer exist

Legacy governance describes an AI system as it was on the day it was reviewed, while models retrain, prompts change and agents gain tools by the day; the artefact is stale before it is signed. The structural tell is where the function sits. In IAPP’s 2025 AI Governance Profession Report, the AI governance function is lodged mostly with privacy (22%), legal and compliance (22%) and IT (17%), and with only 5% in security 1 — far from the pipeline where the system changes. A function in the review layer, not the build layer, cannot keep its description of production true, because nothing wires it to the deploy.

2. Point-in-time review of a continuously changing thing

Annual assessments and committee sign-offs assume a system that holds still long enough to be judged. Frontier models and autonomous agents do not. Gartner expects more than 40% of agentic AI projects to be cancelled by the end of 2027, naming inadequate risk controls among the causes2, and predicts that by 2029 more than half of successful attacks on AI agents will exploit access-control weaknesses and prompt injection3. Both are runtime failure modes — the system misbehaving between reviews — and a once-a-year assessment is structurally blind to them. This is not the same work as model risk management in the SR 11-7 tradition, which validates a model at points in time; the object here never stops moving.

3. Governance as a gate at the end, not a property of the build

Governance still tends to arrive after the model is trained, as a checkpoint to clear before launch, and nothing it produces is wired back into how the system is built. A policy that can only recommend cannot stop a bad release; an eval wired into an eval gate that can fail the build can — the difference between a control that describes risk and one that prevents it.

4. Framework theatre

Mapping to NIST AI RMF or ISO/IEC 42001 becomes the end state instead of the starting point, and a green mapping matrix is mistaken for a working control. Yet as of 2026-09-10 no harmonised standard is cited in the EU’s Official Journal, so there is no Article 40 presumption of conformity for the AI Act4. Even EN ISO/IEC 42001, the AI management-system standard, is not the Article 17 quality management system the Act requires and confers no presumption of conformity on its own5. Coverage is not assurance. A crosswalk proves you have read the framework; it does not prove the control it points to actually fires.

5. No runtime data path

The registry does not know what is running. Most of the AI governance platform category “manages the program — inventories, assessments, framework mappings, evidence workflows — without any runtime data path”6. So the three questions that define the discipline — what AI is running, what is it allowed to do, what evidence proves it — go unanswered, because nothing is connected to production. Meanwhile roughly one in eight reported AI breaches now involves an autonomous agent7: exactly the layer the paper registry cannot see. A control with no telemetry is a claim, not a control.

The evidence

The profession is understaffed, and it knows it

The clearest signal that the work has outgrown its current form is that almost nobody thinks they have enough people to do it. In IAPP’s 2025 report, of 671 respondents only 10 — 1.5% — said they will not need additional AI governance staff in the next 12 months1. Some 77% of organisations report working on AI governance, rising to roughly nine in ten among those already using AI1. Demand is near-universal; capacity is not. When a function is wanted everywhere, under-resourced, and lodged outside the build layer, the gap is not closed by hiring more reviewers. It is closed by turning the governance into a system that scales — which is an engineering problem.

The market renamed the role before the profession did

The labour market is already pricing this shift, and it is doing so in the vocabulary of engineering. An analysis of United States AI-governance postings found the most common skill demanded was observability and monitoring, in roughly 41% of postings, with Python in about 28% — ahead of several named frameworks8. These are build-and-run skills, not review skills. Live “AI Governance Engineer” postings ask for the same substance under the new title: an enterprise agent registry, threat modelling, red teams, non-human-identity controls and NIST AI RMF alignment, at a large family office; AI intake and classification aligned to NIST AI RMF, at a global custodian bank; security controls, threat models and incident response for LLM systems, at a mid-market employer9. And at the frontier, Anthropic has advertised an Engineering Manager for GRC tasked with building an “AI-forward GRC engineering function”, translating “policies into policy-as-code”, and deploying agentic workflows that use Claude “to serve as a virtual GRC analyst”10. The market has been describing AI governance engineering for a year; it simply had not agreed on the name.

Registry versus runtime

The tooling market tells the same story from the supply side. Gartner published its first Magic Quadrant for AI Governance Platforms in June 2026, and its inclusion criteria are revealing: AI discovery and registry, compliance risk management, policy management, dynamic risk scoring, evidence collection, workflow and approvals, and an audit trail11. Every one of those sits at the program layer. The market for these platforms is real and growing fast — Gartner puts it at roughly USD 65 million in 2024, rising to more than USD 1.4 billion by 2030 12 — but growth in program-layer tooling does not close the runtime gap. As one review of the category puts it, most of it manages the program “without any runtime data path6. The category is maturing around inventories and evidence workflows precisely while the risk is migrating to runtime and to agents. That mismatch is the space the discipline occupies.

The standards gap

The framework-theatre problem has a hard deadline attached to it. As of 2026-09-10, zero harmonised standards are cited in the Official Journal, so Article 40’s presumption of conformity is not yet available to anyone4. EN 18286, the quality-management standard aimed at Article 17, was published in July 2026 — the first JTC 21 AI Act standard to reach publication — but it is not yet cited in the Official Journal, so it carries no presumption of conformity13. The Article 9 risk-management, Article 12 logging and Article 15 cybersecurity standards were still at the Enquiry stage, targeting the end of 202613. EN ISO/IEC 42001:2026, the European adoption of the AI management-system standard, is not the Article 17 QMS and does not by itself evidence conformity5. The practical consequence for a governance function: for the period covered by this edition, there is no standard you can certify against to buy a legal presumption. You have to build the controls and the evidence yourself and be ready to defend them on their merits.

The regulatory wave: the Omnibus and GPAI enforcement

The law moved twice in the same summer, in opposite directions, and both moves point at engineering. First, the Digital Omnibus — Regulation (EU) 2026/1744 — entered into force on 27 July 2026, six days before the 2 August high-risk deadline, and reset the clock: Annex III high-risk obligations moved from 2 August 2026 to 2 December 2027, and Annex I embedded high-risk from 2 August 2027 to 2 August 202814. The extra time is real, but it is not relief from the engineering; it is more runway to do it. Second, and unmoved by the Omnibus, GPAI enforcement went live on 2 August 2026: the AI Office can now demand documentation, evaluate models and require measures, and the Commission can fine providers of general-purpose models up to 3% of global annual turnover or EUR 15 million, whichever is higher, under Article 10115. Trade press reported that the AI Office sent its first Requests for Information to frontier labs on 29 August 2026, covering model security, external evaluations and post-market monitoring; that specific report is not independently confirmed in a primary source and is carried here only as reported16. What the enforceable obligations ask for — model evaluations, adversarial testing, incident reporting, weight security — is an engineering programme, not a policy binder.

The agent shift

The last signal is the object of governance itself. Agents that browse, execute code, call APIs and act under delegated authority are now the hardest and newest thing to govern, and the evidence that legacy controls cannot see them is mounting. Gartner’s forecast that by 2029 more than half of successful attacks on AI agents will exploit access-control weaknesses and prompt injection 3 names identity and injection — runtime concerns — as the dominant attack surface. The identity problem is concrete: NIST’s National Cybersecurity Center of Excellence published a 2026 concept paper on identity and authorisation for software and AI agents, which is reported to flag that agents today are commonly run on generic, shared service accounts rather than distinct, attributable identities 17 (reported) — the exact condition that makes an agent’s actions impossible to trace or revoke precisely. OWASP’s Top 10 for Agentic Applications 2026 catalogues the failure modes that follow, from agent goal hijack (ASI01) through tool misuse (ASI02) and agent identity and privilege abuse (ASI03) to rogue agents (ASI10)18. And HiddenLayer’s 2026 threat reporting puts roughly one in eight reported AI breaches at the feet of autonomous agents 7 (reported). The threat model has moved to the layer the paper registry cannot reach.

What changes when governance is engineered

The five problems share one root: governance that describes rather than runs. Engineering the governance changes the artefact, and changing the artefact changes what the function can promise. When the registry is fed by the deployment pipeline, “what AI is running?” is a live query, not a quarterly guess, and the staleness of problem 1 stops existing. When an eval gate fails the build on a dropped injection-resistance threshold and a policy compiled to code blocks an out-of-region deployment, the point-in-time review of problem 2 and the end-of-line gate of problem 3 give way to controls that fire where the system changes. When guardrail decisions, eval results and policy verdicts stream into an assurance store as machine-readable records, the framework theatre of problem 4 is answered by a measure that is a named failure mode’s falling rate, not a count of green cells. And when identity precedes autonomy and telemetry becomes a live control signal, the runtime data path of problem 5 is the spine rather than an afterthought — so the three questions become answerable on any given Tuesday, from live systems.

None of this is a claim that engineered governance guarantees compliance; no artefact does, and no standard yet confers a presumption. The claim is narrower and more useful: measured against realised risk reduction and audit-ready evidence, a governance function that runs beats one that is written, and the market, the regulator and the threat model have all, in the same window, started asking for the version that runs. That is why now.

Maps to: EU AI Act Art. 4/4a (literacy, bias-detection data), Art. 15 (robustness, cybersecurity), Art. 17 (QMS), Art. 53/55 (GPAI), Art. 101 (GPAI fines) · ISO/IEC 42001 · NIST AI RMF (Govern, Map, Measure, Manage) · OWASP Top 10 for Agentic Applications 2026 (ASI01–ASI03, ASI10) · five-layer stack, all layers. Mappings are illustrative, not a claim of conformity.

Sources

  1. [1] AI Governance Profession Report 2025 (with Credo AI; 671 respondents; only 1.5% will not need more staff; 77% working on AI governance; 5% of the function in Security). IAPP. 2025-04-16. https://iapp.org/resources/article/ai-governance-profession-report/ (verified: primary)
  2. [2] “Gartner Predicts Over 40% of Agentic AI Projects Will Be Canceled by End of 2027”. Gartner. 2025-06-25. https://www.gartner.com/en/newsroom/press-releases/2025-06-25-gartner-predicts-over-40-percent-of-agentic-ai-projects-will-be-canceled-by-end-of-2027 (verified: primary)
  3. [3] “Gartner Forecasts the Market for Securing AI Will Reach Almost $5 Billion in 2027” (by 2029, >50% of successful attacks on AI agents exploit access control and prompt injection). Gartner. 2026-08-26. https://www.gartner.com/en/newsroom/press-releases/2026-08-26-gartner-forecasts-the-market-for-securing-ai-will-reach-almost-5-billion-in-2027 (verified: primary)
  4. [4] CEN-CENELEC JTC 21 standards tracker (no harmonised standard cited in the OJ → no Art. 40 presumption). CEN-CENELEC JTC 21 (via kla.digital). 2026. https://kla.digital/blog/jtc-21-standards-tracker (verified: secondary)
  5. [5] “ISO/IEC 42001 and the AI Act: why certification is not yet a presumption of conformity” (ISO 42001 AIMS ≠ Art. 17 QMS). Law & Technology. 2026. https://lawandtechnology.eu/en/iso-iec-42001-and-the-ai-act-why-certification-is-not-yet-a-presumption-of-conformity/ (verified: secondary)
  6. [6] “Best AI Governance Platforms 2026” (category manages the program “without any runtime data path”). Kosmoy. 2026. https://www.kosmoy.com/resources/blog/best-ai-governance-platforms-2026/ (verified: secondary)
  7. [7] Threat Report 2026 (~1 in 8 reported AI breaches involve autonomous agents). HiddenLayer. 2026. https://www.hiddenlayer.com/report-and-guide/threatreport2026 (verified: reported)
  8. [8] “AI Governance Jobs” insights (US postings: observability/monitoring ~41%, Python ~28%). Axial Search. 2026-08-04. https://axialsearch.com/insights/ai-governance-jobs (verified: secondary)
  9. [9] Live “AI Governance Engineer” postings, Sept 2026 (Dalio Family Office; State Street; Bright Vision). SimplyHired. 2026. https://www.simplyhired.com/job/vKibNHPKReLf8h5PgcPxYjWZOx1ctDsml8sjzydKbSpd6ZoNoNvP-Q (verified: secondary)
  10. [10] “Engineering Manager, GRC” (build an “AI-forward GRC engineering function”; “translate policies into policy-as-code”; Claude “as a virtual GRC analyst”). Anthropic (via General Catalyst jobs). 2026. https://jobs.generalcatalyst.com/companies/anthropic/jobs/78167778-engineering-manager-grc (verified: primary)
  11. [11] “IBM recognized as a Leader in the Gartner Magic Quadrant for AI Governance Platforms” (first MQ, June 2026; inclusion criteria: discovery & registry, compliance risk mgmt, policy management, dynamic risk scoring, evidence collection, workflow & approvals, audit trail). IBM / Gartner. 2026-06. https://www.ibm.com/new/announcements/ibm-recognized-as-a-leader-in-gartner-magic-quadrant-for-ai-governance-platforms (verified: secondary)
  12. [12] “Global AI Regulations Fuel Billion-Dollar Market for AI Governance Platforms” (~$65M in 2024 → >$1.4B by 2030). Gartner. 2026-02-17. https://www.gartner.com/en/newsroom/press-releases/2026-02-17-gartner-global-ai-regulations-fuel-billion-dollar-market-for-ai-governance-platforms (verified: primary)
  13. [13] EN 18286:2026 (Art. 17 QMS) published July 2026, not yet cited in the OJ; risk/logging/cybersecurity standards at Enquiry (Q4 2026 target). CEN-CENELEC news / JTC 21 tracker. 2026-07-30. https://www.cencenelec.eu/news-events/news/2026/en-in-the-spotlight/2026-07-30-ai-quality-management/ (verified: secondary)
  14. [14] “AI Omnibus enters into force” (Reg. (EU) 2026/1744, in force 2026-07-27; Annex III high-risk → 2 Dec 2027; Annex I → 2 Aug 2028). European Commission. 2026-07-27. https://digital-strategy.ec.europa.eu/en/news/ai-omnibus-enters-force (verified: primary)
  15. [15] Commission enforcement powers over GPAI providers apply from 2 August 2026 (fines up to 3% of worldwide turnover or EUR 15M under Art. 101). European Commission — AI Act Service Desk. 2026-08-02. https://ai-act-service-desk.ec.europa.eu/en/ai-act/faq/commissions-enforcement-powers-related-ai-act-obligations-providers-most-advanced-models (verified: primary)
  16. [16] Reported first AI Office Requests for Information to GPAI providers on 29 Aug 2026 (model security, external evaluations, post-market monitoring); not independently confirmed in a primary source. Trade press. 2026-08-29. https://tokenstead.ai/guides/eu-ai-act-first-enforcement-security-rfis (verified: reported)
  17. [17] Concept paper “Software and AI Agent Identity and Authorization” (agents commonly run on generic/shared service accounts rather than distinct identities). NIST NCCoE. 2026-02-05. https://www.nccoe.nist.gov/news-insights/new-concept-paper-identity-and-authority-software-agents (verified: reported)
  18. [18] Top 10 for Agentic Applications 2026 (ASI01 Agent Goal Hijack, ASI02 Tool Misuse, ASI03 Agent Identity & Privilege Abuse, … ASI10 Rogue Agents). OWASP GenAI Security Project. 2025-12-09. https://genai.owasp.org/resource/owasp-top-10-for-agentic-applications-for-2026/ (verified: primary)
Edit this page on GitHub
Cite this chapter

García Aibar, J. (2026). Why now. In AI Governance Engineering: Manifesto & Body of Knowledge (v0.2). https://aigovernanceengineer.com/bok/why-now. CC BY 4.0