Assurance and Evidence Control Profile
Reference controls for testing an AI system before release, for the evidence every control writes and keeps, and for the integrity of the model artefacts and bill of materials a release ships with. Every control is a draft: it restates site material, carries no verification procedure yet and is open for technical review.
Scope
AI systems and models from the test plan to the release gate, the evidence records every control emits and how long they are kept, and the model artefacts and AI bill of materials of each build. The environment a model or agent is evaluated in is covered by the evaluation environment profile, and agent-specific runtime controls by the agent runtime profile.
12 controls, AIGE-CTL-ASSURE-001 to AIGE-CTL-ASSURE-012. Each one is anchored to a layer of the five-layer stack and to the patterns that implement it.
How to read a control
Every control has a stable id that never changes and is never reused, and the same record:
- Objective: the outcome the control secures, in one sentence.
- Failure modes: observable events that mean the control failed.
- Scope, enforcement points (on a pull request, at deploy, at runtime or on a schedule) and the failure response (deny, hold for approval or alert).
- Verification: how a third party would check it (inspect, test, observe or attest).
- Evidence: the artefact it leaves and the stack layer that keeps it.
- Mappings: obligations, ISO/IEC 42001 Annex A, the NIST AI RMF, OWASP and other references, each id checked against the site's registers.
Depth says how far a control is written. Specified: a verification procedure, evidence, implementation notes, two example observations and a page of its own. Derived from site material: restates existing site material (an agent control of chapter 23, a pattern, a record schema or a chapter, named on each control) and adds nothing that material does not say. Draft outline: objective, failure modes, scope and open questions only. This profile: 12 derived from site patterns, record schemas and chapters of the Body of Knowledge.
An observation is what a check of a control would emit: the control id, the subject checked, what was expected, what was observed, a status (pass, fail or not_applicable), a timestamp and the evidence behind it.
001 Test Plan Frozen Before Evaluation
Derived from the test-plan.v1 record schema, the Eval Gate in CI pattern and chapter 14, Governing AI development and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-001· v0.1 · Draft · Open for technical review - Objective
- The test plan (suites, metrics, thresholds with their link to the error appetite, datasets, subgroups, sample sizes and the number of repeated runs) is frozen in the repository before evaluation starts, and a change to it after results are known is a diff with an approver.
- Failure modes
-
- Evaluation starts before the plan's metrics, thresholds, datasets, subgroups, sample sizes and number of repeated runs are fixed.
- A metric or threshold changes after the results are known with no approved diff: metric shopping, choosing the metric that passes after seeing all of them.
- A planned suite names no failure mode, or its threshold has no link to the error appetite.
- A test category is missing from the plan with no reason given in its scope.
- Scope
- Every system or model tested before a release, and every change to its test plan. The suites themselves, and whether a result is valid, are covered by AIGE-CTL-ASSURE-002 and AIGE-CTL-EVAL-009.
- Enforcement points
-
- pre_merge: on every pull request
- Verification
- To be specified.
- Evidence
-
- Test plan frozen in the repository before the first run: suites with metric, threshold, failure mode and whether a failure blocks, exit criteria, owner and approver · Layer 03 · test-plan.v1
- Failure response
- require_approval: hold the action for a human decision. A change to the plan after results are known is a diff that needs an approver before it takes effect.
- Layer
- Layer 03 Evals & Red Teaming as Evidence
- Patterns
- Eval Gate in CI
- Mappings
-
- Obligations: EU AI Act Art. 9 risk management system; NIST AI RMF MEASURE; ISO/IEC 42001, A.6 AI system life cycle
- ISO/IEC 42001: A.6.2.4 AI system verification and validation
- NIST AI RMF: MEASURE 2.1 Test sets, metrics, and details about the tools used during TEVV are documented.
- References
-
- [1] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "A test plan before the first run")
- [2] Pattern: Eval Gate in CI (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them)
- [4] Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1 (MEASURE and MANAGE subcategories cited by id, mapped only where the official text matches the control)
- [5] ISO/IEC 42001:2023, AI management systems (Annex A control ids and clause numbers cited by number and short title only; the text of the standard was not opened)
- Implementation notes
-
- The EU AI Act asks for testing against "prior defined metrics and probabilistic thresholds" (Art. 9(8)); chapter 14 reads the operative words as prior defined and freezes the plan before evaluation starts.
- Build the plan from the chapter's test-type matrix: one suite per test type the system needs (validation, robustness, security and adversarial, bias and fairness, regression and the rest), each behind the eval gate; the schema asks for a reason in the scope for any category left out.
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- Which changes to a frozen plan (a new suite, a larger sample, a stricter threshold) may proceed without a new approval, and which reopen the plan?
002 Release Blocked Below the Eval Threshold
Derived from the Eval Gate in CI pattern, the eval-result.v1 record schema and chapter 14, Governing AI development and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-002· v0.1 · Draft · Open for technical review - Objective
- A model or agent ships only after a versioned eval suite, with at least one capability and one adversarial eval, passes in the pipeline above a documented threshold that traces to a named failure mode or obligation, and every run leaves a structured result filed against the registry entry of the version tested.
- Failure modes
-
- A model or agent is retrained, re-prompted or given a new tool and ships with no eval run for its version.
- A result below the threshold does not fail the pipeline, so the release ships and a finding is filed instead.
- A threshold traces to no named failure mode or obligation.
- A result exists only as a pasted score or a slide, not as a structured record (suite id, model version, score, threshold, result, timestamp) filed against the registry entry.
- Scope
- Models and agents that change (retrained, re-prompted or given a new tool) and ship through a pipeline that already runs functional tests. The trajectory evals of an agent are AIGE-CTL-AGENT-013, and the checks that a result is valid enough to gate a release are AIGE-CTL-EVAL-009.
- Enforcement points
-
- pre_merge: on every pull request
- Verification
- To be specified.
- Evidence
-
- Eval result of each run: suite id, model version, score, threshold, pass or fail and timestamp, filed against the registry entry · Layer 03 · eval-result.v1
- Failure response
- deny: block the action. A result below the threshold fails the pipeline, and the release does not ship until it is fixed.
- Layer
- Layer 03 Evals & Red Teaming as Evidence
- Patterns
- Eval Gate in CI, Adversarial Red-Team Suite
- Mappings
-
- Obligations: EU AI Act Art. 15 accuracy, robustness and cybersecurity; EU AI Act Art. 55 GPAI models with systemic risk; NIST AI RMF MEASURE; OWASP Top 10 for Agentic Applications 2026
- ISO/IEC 42001: A.6.2.4 AI system verification and validation
- NIST AI RMF: MEASURE 2.3 Performance or assurance criteria measured for deployment-like conditions
- OWASP: ASI01 Agent Goal Hijack; ASI02 Tool Misuse and Exploitation
- AIUC-1: C002
- References
-
- [2] Pattern: Eval Gate in CI (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [6] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "Statistical validity of evals")
- [7] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "Reproducibility and linked versioning")
- [8] OWASP Top 10 for Agentic Applications for 2026 (ASI01 Agent Goal Hijack to ASI10 Rogue Agents)
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them)
- [4] Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1 (MEASURE and MANAGE subcategories cited by id, mapped only where the official text matches the control)
- [5] ISO/IEC 42001:2023, AI management systems (Annex A control ids and clause numbers cited by number and short title only; the text of the standard was not opened)
- [9] AIUC-1 requirements (public requirement index, A001 to F002, each requirement on its own page (E007 and E014 marked retired); AIUC-1 is a standard of the Artificial Intelligence Underwriting Company; this site is not affiliated with AIUC, and a mapping here is not an AIUC-1 certificate or audit)
- Implementation notes
-
- Version the suite alongside the model and run it in CI (for example with Inspect, promptfoo, Garak or Giskard; illustrative); the security suite is the Adversarial Red-Team Suite.
- Size the suite from the threshold, not from the time available: chapter 14 shows a 0.96 pass rate on 200 cases with a 95% interval of about 0.933 to 0.987, which a 0.95 threshold sits inside, so the gate cannot tell a pass from a fail.
- Link the records both ways: model version to training record to eval results to release tag to the risk approvals that let it ship.
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- How should the gate treat a suite whose repeated runs straddle the threshold: rerun, enlarge the sample or block, given that the pattern warns against flaky gates?
003 Signed Test Report Against the Plan
Derived from the test-report.v1 record schema, the Eval Gate in CI pattern and chapter 14, Governing AI development and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-003· v0.1 · Draft · Open for technical review - Objective
- Each test campaign ends in a dated, signed test report that sets the eval result of every planned suite against the frozen plan, records deviations and waivers, and concludes against the plan's exit criteria; the release gate does not open without a current one.
- Failure modes
-
- A release goes ahead with no test report against the frozen plan, or with a stale one.
- A planned suite has no result in the report, or a deviation from the plan is not recorded.
- A failed suite is waived with no approving role recorded.
- The report is not signed off by the responsible role, or its conclusion does not follow from the results against the exit criteria.
- Scope
- Test campaigns whose results feed a release decision. The go/no-go record the release gate writes, and what else it reads, are out of scope; runs excluded or re-scored after validity checks are reported under AIGE-CTL-EVAL-009.
- Enforcement points
-
- deploy: before a version is deployed or released
- Verification
- To be specified.
- Evidence
-
- Test report: the test plan executed, the eval result per planned suite, counts passed, failed and waived, deviations and waivers, conclusion and a dated sign-off by role · Layer 03 · test-report.v1
- Failure response
- deny: block the action. The release gate refuses to open while the test report against the frozen plan is missing or stale.
- Layer
- Layer 03 Evals & Red Teaming as Evidence
- Patterns
- Eval Gate in CI
- Mappings
-
- Obligations: EU AI Act Art. 9 risk management system; EU AI Act Art. 11 technical documentation (Annex IV); ISO/IEC 42001, A.6 AI system life cycle; NIST AI RMF MEASURE
- ISO/IEC 42001: A.6.2.4 AI system verification and validation
- NIST AI RMF: MEASURE 2.3 Performance or assurance criteria measured for deployment-like conditions
- References
-
- [10] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "The go/no-go gate")
- [1] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "A test plan before the first run")
- [2] Pattern: Eval Gate in CI (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them)
- [4] Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1 (MEASURE and MANAGE subcategories cited by id, mapped only where the official text matches the control)
- [5] ISO/IEC 42001:2023, AI management systems (Annex A control ids and clause numbers cited by number and short title only; the text of the standard was not opened)
- Implementation notes
-
- The release gate reads the records the earlier gates produced; a test report against the frozen plan is one of them, and the gate writes a signed go/no-go record with its conditions, filed against the registry entry.
- Sign off by role, not by personal name, as the schema asks, and release in stages (shadow, canary, limited pilot, general availability), each with exit criteria from the test plan.
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- When a waiver in the report expires after release, is the release gated again or only the waived suite rerun?
004 Common Signed Evidence Record
Derived from the Continuous Assurance Telemetry pattern, the evidence-record.v1 record schema and chapter 5, Patterns and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-004· v0.1 · Draft · Open for technical review - Objective
- Every control writes a timestamped, signed record on one common schema (control id; subject as registry id and version; decision; metric, value and threshold; failure mode or obligation; input hash; actor; timestamp; signature) to one assurance store keyed on the registry id, and other tools' outputs are normalised into that shape on ingest.
- Failure modes
-
- A control's decision leaves no record in the assurance store, or its record lacks the control id, the subject's registry id and version, the decision, the actor, the timestamp or the signature.
- Records from different tools keep their own shapes and cannot be joined on the registry id.
- A record cannot be shown to be unchanged, because it carries no signature, or to come from a given input, because it carries no input hash.
- Scope
- Every control of an AI system that decides something (policy verdicts, eval results, guardrail actions, identity events, admissions, go/no-go decisions), whatever tool runs it. What each control decides is set by the control itself.
- Enforcement points
-
- runtime: at the point of action (gateway or guardrail)
- Verification
- To be specified.
- Evidence
-
- Evidence record of each control decision, signed and filed in the assurance store under the registry id · Layer 05 · evidence-record.v1
- Failure response
- alert: let the action through and raise an alert. To be specified: the source material states no failure response for this control.
- Layer
- Layer 05 Assurance & Continuous Compliance
- Patterns
- Continuous Assurance Telemetry
- Mappings
-
- Obligations: EU AI Act Art. 12 record-keeping and logging; EU AI Act Art. 17 quality management system; EU AI Act Art. 72 post-market monitoring; NIST AI RMF MANAGE
- ISO/IEC 42001:2023: 9.1 (Performance evaluation: monitoring and measurement (cited by the evidence-record and control-observation schemas))
- References
-
- [11] Pattern: Continuous Assurance Telemetry (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them)
- [5] ISO/IEC 42001:2023, AI management systems (Annex A control ids and clause numbers cited by number and short title only; the text of the standard was not opened)
- Implementation notes
-
- Fix the schema first, then normalise every tool's output into it on ingest, so heterogeneous sources compose into one store queryable by registry id.
- Where a record is a normalised copy of a fuller one (an eval result, a go/no-go record, an incident record), link the original with record_ref; keep evidence-bearing fields in the core record, not in extensions.
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- Which key signs a record that a third-party tool produced and the ingest pipeline normalised: the tool's, the pipeline's or both?
005 Live Control Status from the Assurance Store
Derived from the Continuous Assurance Telemetry pattern, the evidence-record.v1 record schema and chapter 18, The EU AI Act in one pass and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-005· v0.1 · Draft · Open for technical review - Objective
- The status of each control is a live query over the records it emits to the assurance store, not a point-in-time attestation, so a control that stops firing or starts failing is visible as it happens, not at the next audit.
- Failure modes
-
- A control's status rests on an attestation made when someone looked, although the model has since been retrained or an agent has gained a tool.
- A control stops firing and its status still shows it working until the next audit.
- The post-market monitoring plan of a high-risk system is a document, not the versioned configuration of the telemetry that collects the data.
- Scope
- Controls of AI systems in production whose decisions reach the assurance store, and, for high-risk systems, the post-market monitoring their provider runs under Art. 72. What a control decides, and the monitoring of model performance itself, are out of scope: the monitoring plan with its thresholds, owners and consequences is AIGE-CTL-DEPLOY-008.
- Enforcement points
-
- runtime: at the point of action (gateway or guardrail)
- periodic: on a schedule, over what is already running
- Verification
- To be specified.
- Evidence
-
- Evidence records each control emits to the assurance store, which the live status query of that control reads · Layer 05 · evidence-record.v1
- Failure response
- alert: let the action through and raise an alert. A control that stops firing shows as failing within minutes (the pattern's illustrative dashboard tile goes red), not at the next audit.
- Layer
- Layer 05 Assurance & Continuous Compliance
- Patterns
- Continuous Assurance Telemetry
- Mappings
-
- Obligations: EU AI Act Art. 72 post-market monitoring; NIST AI RMF MANAGE; NIST AI RMF GOVERN; CSA AI Controls Matrix (AICM) v1.1
- NIST AI RMF: MANAGE 4.1 Post-deployment monitoring plans are implemented
- References
-
- [11] Pattern: Continuous Assurance Telemetry (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [12] The EU AI Act in one pass (AI Governance Engineering Body of Knowledge v0.5.0, chapter 18, section "Post-market monitoring and serious incidents (Articles 72 and 73)")
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them)
- [4] Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1 (MEASURE and MANAGE subcategories cited by id, mapped only where the official text matches the control)
- Implementation notes
-
- Expose the current status of each control as a query over the store, for example a dashboard tile backed by a live query over the decisions the control emitted.
- For a high-risk system, chapter 18 treats Continuous Assurance Telemetry as the post-market monitoring system and the plan as its versioned configuration; the Commission's guidance and template for the plan are due by 2 Sep 2027 (Art. 72(3)).
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- How long may a control go without emitting a record before its status turns to failing, and should that window differ by control?
006 Control Observations Filed Against Control Ids
Derived from the control-observation.v1 record schema and the Continuous Assurance Telemetry pattern and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-006· v0.1 · Draft · Open for technical review - Objective
- Each observation of a reference control is filed as a record naming the control id and version, the subject and its kind, what the control expects, what was observed, whether it held and when, and the evidence records it rests on, so a third party can check it without trusting the observer.
- Failure modes
-
- An observation lists no evidence, so a third party has to trust the observer.
- An observation does not name the control version it was made against, so it cannot be read once the control changes.
- The observer is recorded as a person's name rather than a system or a role.
- A control that does not apply to a subject is recorded as passing, instead of not applicable with the reason in the notes.
- Scope
- Observations of the controls of the open control profiles on this site, whether an adapter, a test or a reviewer makes them.
- Enforcement points
-
- runtime: at the point of action (gateway or guardrail)
- periodic: on a schedule, over what is already running
- Verification
- To be specified.
- Evidence
-
- Control observation: control id and version, subject and kind, expected, observed, status, timestamp and the evidence it rests on · Layer 05 · control-observation.v1
- Failure response
- alert: let the action through and raise an alert. To be specified: the source material states no failure response for this control.
- Layers
- Layer 05 Assurance & Continuous Compliance, Layer 04 Runtime Controls & Observability
- Patterns
- Continuous Assurance Telemetry, Machine-Readable Evidence (OSCAL)
- Mappings
-
- Obligations: EU AI Act Art. 12 record-keeping and logging; EU AI Act Art. 15 accuracy, robustness and cybersecurity; EU AI Act Art. 17 quality management system
- ISO/IEC 42001:2023: 9.1 (Performance evaluation: monitoring and measurement (cited by the evidence-record and control-observation schemas))
- References
-
- [11] Pattern: Continuous Assurance Telemetry (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [13] Pattern: Machine-Readable Evidence (OSCAL) (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them)
- [5] ISO/IEC 42001:2023, AI management systems (Annex A control ids and clause numbers cited by number and short title only; the text of the standard was not opened)
- Implementation notes
-
- Make each piece of evidence checkable: where it is kept, a digest prefixed with the algorithm, and the schema it validates against when it is a structured record (for example evidence-record or eval-result).
- Sign the observation with a detached signature so it is tamper-evident in the evidence store; the evaluation environment profile publishes illustrative pass and fail observations of its specified controls.
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- Should an observation an adapter emits and one a reviewer records weigh the same when the status of a control is computed from them?
007 Machine-Readable Evidence in OSCAL
Derived from the Machine-Readable Evidence (OSCAL) pattern and chapter 5, Patterns and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-007· v0.1 · Draft · Open for technical review - Objective
- Control results are emitted in a machine-readable standard format, OSCAL first (component-definition and assessment-results artefacts that trace each result back to the control it tested), and stored so that an auditor's question is answered by a query, not by collecting the evidence again.
- Failure modes
-
- Evidence reaches an audit as a screenshot or as a document a person formatted and filed by hand.
- An assessment result cannot be traced back to the control it tested.
- Each audit collects the evidence again from scratch.
- Scope
- The results of the controls of an AI stack that already produces structured records, and the assurance function that answers auditors from them. The choice of AI-specific OSCAL extensions is left open.
- Enforcement points
-
- runtime: at the point of action (gateway or guardrail)
- periodic: on a schedule, over what is already running
- Verification
- To be specified.
- Evidence
-
- OSCAL assessment-results for each control result, with component definitions of the controls that produced them · Layer 05
- Structured records the controls already produce, the starting point the pattern assumes (for example evidence records) · Layer 05 · evidence-record.v1
- Failure response
- alert: let the action through and raise an alert. To be specified: the source material states no failure response for this control.
- Layer
- Layer 05 Assurance & Continuous Compliance
- Patterns
- Machine-Readable Evidence (OSCAL), Continuous Assurance Telemetry
- Mappings
- References
-
- [13] Pattern: Machine-Readable Evidence (OSCAL) (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [14] OSCAL Layers and Models (control layer (catalog, profile), implementation layer (component-definition, system-security-plan) and assessment layer (assessment-plan, assessment-results, POA&M), with traceability from a result to the control it tested)
- [15] Making AI Compliance Evidence Machine-Readable (arXiv 2604.13767) (one proposed approach, a single preprint: OSCAL with sixteen property extensions for AI)
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them)
- Implementation notes
-
- Build on OSCAL's native model first: the control layer (catalog, profile), the implementation layer (component-definition, system-security-plan) and the assessment layer (assessment-plan, assessment-results, POA&M), which traces a result back to the control it tested.
- AI-specific extensions are still forming: one 2026 preprint proposes sixteen property extensions; adopt them only where they fit, since the native assessment models carry most of the load today.
- An eval gate that writes an OSCAL assessment result on every run turns a request such as "all robustness evidence in Q3" into a filter over the store (the pattern's illustrative example).
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- Which OSCAL model should carry the result of an AI-specific control that no published catalogue defines: a local catalogue of these reference controls, or a property extension?
008 Evidence Retention as Code
Derived from the evidence-record.v1 record schema, chapter 14, Governing AI development and chapter 18, The EU AI Act in one pass and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-008· v0.1 · Draft · Open for technical review - Objective
- Each evidence class carries a retention rule keyed to its obligation (for a high-risk system, the technical documentation, QMS documentation and EU declaration for 10 years after placing on the market, and logs under the provider's control for at least six months, set by intended purpose); signed records go to write-once storage and a legal hold overrides deletion.
- Failure modes
-
- An evidence class has no retention rule, or its rule is not keyed to the obligation it evidences.
- Automatically generated logs are deleted before six months, or the six-month floor is applied as a default whatever the intended purpose.
- A signed record sits on storage where it can be overwritten, or is deleted while a legal hold applies.
- Personal data in the logs is kept without reconciling the log retention rule with the GDPR's storage limitation.
- Scope
- Evidence records, logs and documentation of AI systems, above all high-risk systems whose provider keeps documentation under Art. 18 and logs under Art. 19. The deployer's parallel log duty (Art. 26(6), chapter 15) is AIGE-CTL-DEPLOY-010.
- Enforcement points
-
- periodic: on a schedule, over what is already running
- Verification
- To be specified.
- Evidence
-
- Retention rule per evidence class, keyed to its obligation, with its storage and any legal hold · Layer 05
- Signed evidence records kept on write-once storage · Layer 05 · evidence-record.v1
- Failure response
- deny: block the action. A legal hold overrides deletion: a record under hold is not deleted when its retention period ends.
- Layer
- Layer 05 Assurance & Continuous Compliance
- Patterns
- Machine-Readable Evidence (OSCAL)
- Mappings
- References
-
- [16] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "Record keeping")
- [17] The EU AI Act in one pass (AI Governance Engineering Body of Knowledge v0.5.0, chapter 18, section "Conformity assessment, declaration, marking and registration")
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them)
- [9] AIUC-1 requirements (public requirement index, A001 to F002, each requirement on its own page (E007 and E014 marked retired); AIUC-1 is a standard of the Artificial Intelligence Underwriting Company; this site is not affiliated with AIUC, and a mapping here is not an AIUC-1 certificate or audit)
- Implementation notes
-
- Keep evidence in open formats (JSON, OSCAL): a 10-year horizon outlives most tools.
- Financial institutions keep the logs within their financial-services documentation (Art. 19); other law can set a period other than six months.
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- How should a write-once evidence store honour an erasure request for personal data inside a signed record without breaking the record's signature?
009 Internal Audit Answered from the Evidence Store
Derived from the Continuous Assurance Telemetry pattern, the Machine-Readable Evidence (OSCAL) pattern and chapter 22, Principles, soft law and standards and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-009· v0.1 · Draft · Open for technical review - Objective
- Internal audit of the AI management system is answered from one evidence store, the same one that answers internal audit for any management system run alongside ISO/IEC 42001, and each Annex A control listed as applicable points at the running control and the evidence stream that implement it.
- Failure modes
-
- Internal audit collects evidence by hand for each management system instead of querying one evidence store.
- An Annex A control listed as applicable in the Statement of Applicability points at no running control or evidence stream, or an exclusion carries no justification or owner.
- The internal audit programme does not cover the AI controls.
- Scope
- Organisations that run an AI management system to ISO/IEC 42001, alone or with ISO/IEC 27001, ISO/IEC 27701 or ISO 9001. What internal audit tests and how management review runs are not derived here: chapter 22 names clause 9 only as one evidence store answering internal audit.
- Enforcement points
-
- periodic: on a schedule, over what is already running
- Verification
- To be specified.
- Evidence
-
- Statement of Applicability generated from control metadata, each applicable control linked to its evidence stream, each exclusion with its justification and owner · Layer 05
- Evidence records internal audit queries, filed under the registry id · Layer 05 · evidence-record.v1
- Failure response
- alert: let the action through and raise an alert. To be specified: the source material states no failure response for this control.
- Layer
- Layer 05 Assurance & Continuous Compliance
- Patterns
- Continuous Assurance Telemetry, Machine-Readable Evidence (OSCAL)
- Mappings
-
- AIUC-1: E008
- ISO/IEC 42001:2023: 9 (Performance evaluation: one evidence store answering internal audit (clause heading as chapter 22 names it))
- References
-
- [18] Principles, soft law and standards (AI Governance Engineering Body of Knowledge v0.5.0, chapter 22, section "Integrating with 27001, 27701 and 9001")
- [19] Principles, soft law and standards (AI Governance Engineering Body of Knowledge v0.5.0, chapter 22, section "The management-system trio")
- [11] Pattern: Continuous Assurance Telemetry (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [13] Pattern: Machine-Readable Evidence (OSCAL) (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [5] ISO/IEC 42001:2023, AI management systems (Annex A control ids and clause numbers cited by number and short title only; the text of the standard was not opened)
- [9] AIUC-1 requirements (public requirement index, A001 to F002, each requirement on its own page (E007 and E014 marked retired); AIUC-1 is a standard of the Artificial Intelligence Underwriting Company; this site is not affiliated with AIUC, and a mapping here is not an AIUC-1 certificate or audit)
- Implementation notes
-
- Treat the Statement of Applicability as a generated file, not a document: each applicable Annex A control points at the running control and its evidence stream, and each exclusion carries its justification and an owner.
- Map each shared clause of the Harmonized Structure to one artefact serving every management system; for clause 9 that is one evidence store answering internal audit. In chapter 22's illustrative case, a team that held ISO/IEC 27001 added AI controls to its internal audit programme and generated the 42001 Statement of Applicability from the same control metadata.
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- Chapter 22 names clause 9 only at heading level: which inputs and outputs of internal audit and management review should this control cover once they are read against the standard?
010 Model Artefacts Signed at Build and Verified Before Load
Derived from the Model Artefact Integrity pattern, the evidence-record.v1 record schema and chapter 14, Governing AI development and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-010· v0.1 · Draft · Open for technical review - Objective
- Every model artefact is signed at build through a manifest of each file and its digest and carries build provenance (what built it, by what process, from which inputs), and a runtime loads it only after verifying the signature, the signer, the digests and the provenance against the registry entry of the version deployed, writing an evidence record either way.
- Failure modes
-
- A tampered or malicious model file loads with the privileges of the serving process.
- A model that skipped the eval gate reaches production through a manual copy or a moved tag.
- After an incident, nobody can prove which weights produced the outputs in question.
- A model is allowed or refused at load and no evidence record of the verification is written.
- Scope
- Model weights and their companion files, from training jobs to registries to serving clusters, including fine-tunes of bases pulled from public hubs. The artefacts an evaluation run loads are covered by AIGE-CTL-EVAL-008, and the admission of MCP servers by AIGE-CTL-AGENT-018.
- Enforcement points
-
- deploy: before a version is deployed or released
- runtime: at the point of action (gateway or guardrail)
- Verification
- To be specified.
- Evidence
-
- Signed manifest of every model file and its digest, with SLSA build provenance, recorded in the registry entry · Layer 02
- Verification at load: signature, signer, file digests and provenance checked against the registry entry, with the decision · Layer 04 · evidence-record.v1
- Failure response
- deny: block the action. The serving platform's admission control refuses a model whose signature, signer identity, file digests or provenance do not match the registry entry, and writes an evidence record either way.
- Layers
- Layer 02 Inventory & Transparency, Layer 04 Runtime Controls & Observability
- Patterns
- Model Artefact Integrity, AIBOM
- Mappings
-
- Obligations: EU AI Act Art. 15 accuracy, robustness and cybersecurity; EU AI Act Art. 55 GPAI models with systemic risk; ISO/IEC 42001, A.6 AI system life cycle; ISO/IEC 42001, A.10 Third-party and customer relationships; NIST AI RMF MANAGE; OWASP Top 10 for LLM Applications 2026; OWASP Top 10 for Agentic Applications 2026
- ISO/IEC 42001: A.6.2.5 AI system deployment; A.10.3 Suppliers
- NIST AI RMF: MANAGE 3.2 Pre-trained models which are used for development are monitored as part of AI system regular monitoring and maintenance.; MEASURE 2.7 Security and resilience are evaluated and documented
- OWASP: LLM04:2026 Supply Chain; ASI04 Agentic Supply Chain Vulnerabilities
- MITRE ATLAS: AML.T0010 AI Supply Chain Compromise
- MITRE ATLAS mitigation: AML.M0013 (Code Signing)
- MITRE ATLAS mitigation: AML.M0014 (Verify AI Artifacts)
- References
-
- [20] Pattern: Model Artefact Integrity (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [7] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "Reproducibility and linked versioning")
- [21] An Introduction to the OpenSSF Model Signing (OMS) Specification (detached signature over a manifest of file hashes, in the Sigstore bundle format; PKI-agnostic)
- [22] model-transparency: supply chain security for ML (signs a statement of file paths and digests through Sigstore or conventional keys; verification recomputes the hashes)
- [23] SLSA specification v1.2, Build track basics (Build L1 provenance exists, L2 hosted build platform, L3 hardened builds; provenance describes what built the artefact, by what process and from which top-level inputs)
- [24] OWASP GenAI LLM Top 10 2026 (LLM01:2026 Prompt Injection to LLM10:2026 Improper Output Handling; resource page dated 3 Aug 2026)
- [8] OWASP Top 10 for Agentic Applications for 2026 (ASI01 Agent Goal Hijack to ASI10 Rogue Agents)
- [25] MITRE ATLAS data, release v2026.09 (16 tactics, 120 techniques, 88 sub-techniques, 40 mitigations; technique names and technique-to-mitigation links read from dist/v6/ATLAS-2026.09.yaml)
- [4] Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1 (MEASURE and MANAGE subcategories cited by id, mapped only where the official text matches the control)
- [5] ISO/IEC 42001:2023, AI management systems (Annex A control ids and clause numbers cited by number and short title only; the text of the standard was not opened)
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them)
- Implementation notes
-
- Sign a manifest of file digests at build: the OpenSSF Model Signing (OMS) specification puts a detached signature over such a manifest in the Sigstore bundle format and is PKI-agnostic; its reference implementation, model-signing, recomputes the hashes on verification.
- Record provenance as SLSA provenance (https://slsa.dev/provenance/v1): Build L1 means provenance exists, L2 a hosted build platform and L3 hardened builds. Include the base model digest and the dataset admission records among the inputs, and list the same artefacts in the AIBOM.
- Budget for the verification latency at load, small next to model load times but real for fast scale-out; the pattern's example found a hand-copied model that had never passed the current eval gate, refused on a digest mismatch.
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- Which SLSA Build level should a model build reach before its provenance is trusted at load, and should that depend on the risk tier of the system?
011 Safe Model Formats and Digest-Pinned Third-Party Models
Derived from the Model Artefact Integrity pattern and chapter 14, Governing AI development and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-011· v0.1 · Draft · Open for technical review - Objective
- Model weights are stored in a format that cannot execute code on load (safetensors); every file in a code-executing format is scanned for code-executing imports before it reaches a registry and quarantined if it fails; third-party models are pulled by content digest, not by tag, re-hosted internally and recorded with their upstream source and digest in the registry entry.
- Failure modes
-
- A pickle file runs code when it is loaded: the Python documentation warns that the pickle module is not secure.
- A file in a code-executing format reaches a registry unscanned, or after a failed scan.
- A third-party model is pulled by name or tag, and the tag has since moved.
- Scope
- Every serialised model file admitted to an internal registry, and every third-party model or base model pulled from outside. Signature and provenance checks at load are AIGE-CTL-ASSURE-010.
- Enforcement points
-
- deploy: before a version is deployed or released
- Verification
- To be specified.
- Evidence
-
- Scan result for code-executing imports per serialised file, with the quarantine decision · Layer 02 · evidence-record.v1
- Upstream source and content digest of each third-party model, recorded in its registry entry · Layer 02
- Failure response
- deny: block the action. A serialised file that fails the scan for code-executing imports is quarantined and does not reach the registry.
- Layer
- Layer 02 Inventory & Transparency
- Patterns
- Model Artefact Integrity
- Mappings
-
- Obligations: EU AI Act Art. 15 accuracy, robustness and cybersecurity; ISO/IEC 42001, A.10 Third-party and customer relationships; OWASP Top 10 for LLM Applications 2026
- ISO/IEC 42001: A.10.3 Suppliers
- OWASP: LLM04:2026 Supply Chain; ASI04 Agentic Supply Chain Vulnerabilities
- MITRE ATLAS: AML.T0010 AI Supply Chain Compromise
- MITRE ATLAS mitigation: AML.M0016 (Vulnerability Scanning)
- References
-
- [20] Pattern: Model Artefact Integrity (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [7] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "Reproducibility and linked versioning")
- [26] pickle: Python object serialization ("The pickle module is not secure. Only unpickle data you trust.")
- [27] Pickle Scanning (arbitrary code execution when loading pickle files; the Hub's pickle-import scan "is not 100% foolproof")
- [28] Safetensors ("a new simple format for storing tensors safely (as opposed to pickle)")
- [29] torch.load (default weights_only=True; "Never load data from an untrusted source")
- [24] OWASP GenAI LLM Top 10 2026 (LLM01:2026 Prompt Injection to LLM10:2026 Improper Output Handling; resource page dated 3 Aug 2026)
- [8] OWASP Top 10 for Agentic Applications for 2026 (ASI01 Agent Goal Hijack to ASI10 Rogue Agents)
- [25] MITRE ATLAS data, release v2026.09 (16 tactics, 120 techniques, 88 sub-techniques, 40 mitigations; technique names and technique-to-mitigation links read from dist/v6/ATLAS-2026.09.yaml)
- [5] ISO/IEC 42001:2023, AI management systems (Annex A control ids and clause numbers cited by number and short title only; the text of the standard was not opened)
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them)
- Implementation notes
-
- Where a framework still loads pickle, keep its restrictions on: torch.load defaults to weights_only=True in its current documentation and warns "Never load data from an untrusted source".
- Do not rely on the scan alone: Hugging Face says of its own pickle-import scanner that it "is not 100% foolproof". Convert legacy checkpoints to safetensors, and verify the publisher's signature on a third-party model where one exists.
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- How should a legacy checkpoint that cannot be converted to safetensors be handled: blocked, or admitted after a scan with a named acceptor of the risk?
012 AI Bill of Materials per Build
Derived from the AIBOM pattern, the ai-system-register-entry.v1 record schema and chapter 14, Governing AI development and restated as a control; requires technical review.
- Id
-
AIGE-CTL-ASSURE-012· v0.1 · Draft · Open for technical review - Objective
- Each AI system has an AI bill of materials generated at build in a standard format (CycloneDX ML-BOM or the SPDX 3.0 AI profile), recording its models, datasets and weights with their provenance and licences, attached to its registry entry and regenerated on each build so it never drifts from the deployed system.
- Failure modes
-
- Nobody can say which model version, from which provenance, trained on which data, is inside a given system.
- The AIBOM was written once and no longer matches the deployed system.
- A licence or provenance change in a model or dataset does not show in the next build's AIBOM.
- The registry entry of the system links no AIBOM.
- Scope
- AI systems assembled from foundation models, fine-tunes, third-party datasets and libraries. The software dependencies a classic SBOM already captures are out of scope.
- Enforcement points
-
- deploy: before a version is deployed or released
- Verification
- To be specified.
- Evidence
-
- AIBOM of each build (CycloneDX ML-BOM or SPDX 3.0 AI profile), linked from the registry entry · Layer 02 · ai-system-register-entry.v1
- Failure response
- alert: let the action through and raise an alert. To be specified: the source material states no failure response for this control.
- Layer
- Layer 02 Inventory & Transparency
- Patterns
- AIBOM
- Mappings
-
- Obligations: EU AI Act Art. 11 technical documentation (Annex IV); EU AI Act Art. 53 GPAI provider obligations; OWASP AIBOM; NIST AI RMF MAP; CSA AI Controls Matrix (AICM) v1.1
- ISO/IEC 42001: A.7.5 Data provenance; A.10.3 Suppliers
- OWASP: LLM04:2026 Supply Chain
- MITRE ATLAS: AML.T0010 AI Supply Chain Compromise
- MITRE ATLAS mitigation: AML.M0023 (AI Bill of Materials)
- References
-
- [30] Pattern: AIBOM (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue)
- [31] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "Annex IV, element by element")
- [32] Evolving AI Transparency: the AIBOM generator's new home at OWASP (OWASP AIBOM generator, CycloneDX output)
- [24] OWASP GenAI LLM Top 10 2026 (LLM01:2026 Prompt Injection to LLM10:2026 Improper Output Handling; resource page dated 3 Aug 2026)
- [25] MITRE ATLAS data, release v2026.09 (16 tactics, 120 techniques, 88 sub-techniques, 40 mitigations; technique names and technique-to-mitigation links read from dist/v6/ATLAS-2026.09.yaml)
- [5] ISO/IEC 42001:2023, AI management systems (Annex A control ids and clause numbers cited by number and short title only; the text of the standard was not opened)
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them)
- Implementation notes
-
- Generate the AIBOM in the build, for example with the OWASP AIBOM generator (illustrative), covering models, datasets and weights with their provenance and licences.
- Transparency documents can be generated from the AIBOM, as the pattern notes; chapter 14 draws Annex IV items 1(b) and 1(c) (interaction with other systems; software versions) from it.
- Open questions
-
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review.
- Should a build fail when its AIBOM changes in a way nobody approved (a new model, dataset or licence), or only flag the difference for review?
Mappings
Every control against the obligations, standards and threats it answers. Mappings are illustrative, not a claim of conformity; an empty cell means no mapping has been verified yet. AIUC-1 ids point at the public requirement index of the Artificial Intelligence Underwriting Company, cited here as a reference; this project is not affiliated with AIUC, and each mapping is our own reading of the requirement text. The same mappings, read from the framework side and across every profile, are in the controls crosswalk.
| Control | Obligations | ISO/IEC 42001 | NIST AI RMF | OWASP | AIUC-1 | Layer |
|---|---|---|---|---|---|---|
| AIGE-CTL-ASSURE-001 Test Plan Frozen Before Evaluation | AIGE-OBL-EUAIA-ART9, AIGE-OBL-NISTRMF-MEASURE, AIGE-OBL-ISO42001-A6 | A.6.2.4 | MEASURE 2.1 | None yet | None yet | L3 |
| AIGE-CTL-ASSURE-002 Release Blocked Below the Eval Threshold | AIGE-OBL-EUAIA-ART15, AIGE-OBL-EUAIA-ART55, AIGE-OBL-NISTRMF-MEASURE, AIGE-OBL-OWASP-AGENTIC | A.6.2.4 | MEASURE 2.3 | ASI01, ASI02 | C002 | L3 |
| AIGE-CTL-ASSURE-003 Signed Test Report Against the Plan | AIGE-OBL-EUAIA-ART9, AIGE-OBL-EUAIA-ART11, AIGE-OBL-ISO42001-A6, AIGE-OBL-NISTRMF-MEASURE | A.6.2.4 | MEASURE 2.3 | None yet | None yet | L3 |
| AIGE-CTL-ASSURE-004 Common Signed Evidence Record | AIGE-OBL-EUAIA-ART12, AIGE-OBL-EUAIA-ART17, AIGE-OBL-EUAIA-ART72, AIGE-OBL-NISTRMF-MANAGE | None yet | None yet | None yet | None yet | L5 |
| AIGE-CTL-ASSURE-005 Live Control Status from the Assurance Store | AIGE-OBL-EUAIA-ART72, AIGE-OBL-NISTRMF-MANAGE, AIGE-OBL-NISTRMF-GOVERN, AIGE-OBL-CSA-AICM | None yet | MANAGE 4.1 | None yet | None yet | L5 |
| AIGE-CTL-ASSURE-006 Control Observations Filed Against Control Ids | AIGE-OBL-EUAIA-ART12, AIGE-OBL-EUAIA-ART15, AIGE-OBL-EUAIA-ART17 | None yet | None yet | None yet | None yet | L5, L4 |
| AIGE-CTL-ASSURE-007 Machine-Readable Evidence in OSCAL | AIGE-OBL-EUAIA-ART12, AIGE-OBL-EUAIA-ART17, AIGE-OBL-EUAIA-ART72, AIGE-OBL-NISTRMF-MANAGE, AIGE-OBL-NISTRMF-GOVERN | None yet | None yet | None yet | None yet | L5 |
| AIGE-CTL-ASSURE-008 Evidence Retention as Code | AIGE-OBL-EUAIA-ART18, AIGE-OBL-EUAIA-ART19, AIGE-OBL-EUAIA-ART12 | None yet | None yet | None yet | E015 | L5 |
| AIGE-CTL-ASSURE-009 Internal Audit Answered from the Evidence Store | None yet | None yet | None yet | None yet | E008 | L5 |
| AIGE-CTL-ASSURE-010 Model Artefacts Signed at Build and Verified Before Load | AIGE-OBL-EUAIA-ART15, AIGE-OBL-EUAIA-ART55, AIGE-OBL-ISO42001-A6, AIGE-OBL-ISO42001-A10, AIGE-OBL-NISTRMF-MANAGE, AIGE-OBL-OWASP-LLM, AIGE-OBL-OWASP-AGENTIC | A.6.2.5, A.10.3 | MANAGE 3.2, MEASURE 2.7 | LLM04:2026, ASI04 | None yet | L2, L4 |
| AIGE-CTL-ASSURE-011 Safe Model Formats and Digest-Pinned Third-Party Models | AIGE-OBL-EUAIA-ART15, AIGE-OBL-ISO42001-A10, AIGE-OBL-OWASP-LLM | A.10.3 | None yet | LLM04:2026, ASI04 | None yet | L2 |
| AIGE-CTL-ASSURE-012 AI Bill of Materials per Build | AIGE-OBL-EUAIA-ART11, AIGE-OBL-EUAIA-ART53, AIGE-OBL-OWASP-AIBOM, AIGE-OBL-NISTRMF-MAP, AIGE-OBL-CSA-AICM | A.7.5, A.10.3 | None yet | LLM04:2026 | None yet | L2 |
Open questions
The questions this draft leaves open, with the controls that raise each one.
- Verification procedure to be specified: the derivation adds no check its source material does not state; requires technical review. (001, 002, 003, 004, 005, 006, 007, 008, 009, 010, 011, 012)
- Which changes to a frozen plan (a new suite, a larger sample, a stricter threshold) may proceed without a new approval, and which reopen the plan? (001)
- How should the gate treat a suite whose repeated runs straddle the threshold: rerun, enlarge the sample or block, given that the pattern warns against flaky gates? (002)
- When a waiver in the report expires after release, is the release gated again or only the waived suite rerun? (003)
- Which key signs a record that a third-party tool produced and the ingest pipeline normalised: the tool's, the pipeline's or both? (004)
- How long may a control go without emitting a record before its status turns to failing, and should that window differ by control? (005)
- Should an observation an adapter emits and one a reviewer records weigh the same when the status of a control is computed from them? (006)
- Which OSCAL model should carry the result of an AI-specific control that no published catalogue defines: a local catalogue of these reference controls, or a property extension? (007)
- How should a write-once evidence store honour an erasure request for personal data inside a signed record without breaking the record's signature? (008)
- Chapter 22 names clause 9 only at heading level: which inputs and outputs of internal audit and management review should this control cover once they are read against the standard? (009)
- Which SLSA Build level should a model build reach before its provenance is trusted at load, and should that depend on the risk tier of the system? (010)
- How should a legacy checkpoint that cannot be converted to safetensors be handled: blocked, or admitted after a scan with a named acceptor of the risk? (011)
- Should a build fail when its AIBOM changes in a way nobody approved (a new model, dataset or licence), or only flag the difference for review? (012)
Changelog
- v0.1 (): First draft, derived from the Eval Gate in CI, Continuous Assurance Telemetry, Machine-Readable Evidence (OSCAL), Model Artefact Integrity and AIBOM patterns, six record schemas and chapters 14, 18 and 22: 12 controls, open for technical review.
Sources
- [1] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "A test plan before the first run"). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/bok/governing-development#a-test-plan-before-the-first-run (verified: primary)
- [2] Pattern: Eval Gate in CI (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/patterns/eval-gate-in-ci (verified: primary)
- [3] Regulation (EU) 2024/1689 (AI Act), consolidated text of 2026-07-27 as amended by Regulation (EU) 2026/1744 (the articles each control maps to, as chapters 14 and 18 restate them). Publications Office of the EU (EUR-Lex). 2026-07-27. https://eur-lex.europa.eu/eli/reg/2024/1689/2026-07-27/eng (verified: primary)
- [4] Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1 (MEASURE and MANAGE subcategories cited by id, mapped only where the official text matches the control). NIST. 2023-01-26. https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.100-1.pdf (verified: primary)
- [5] ISO/IEC 42001:2023, AI management systems (Annex A control ids and clause numbers cited by number and short title only; the text of the standard was not opened). ISO/IEC. 2023-12. https://www.iso.org/standard/81230.html (verified: secondary)
- [6] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "Statistical validity of evals"). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/bok/governing-development#statistical-validity-of-evals (verified: primary)
- [7] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "Reproducibility and linked versioning"). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/bok/governing-development#reproducibility-and-linked-versioning (verified: primary)
- [8] OWASP Top 10 for Agentic Applications for 2026 (ASI01 Agent Goal Hijack to ASI10 Rogue Agents). OWASP GenAI Security Project. 2025-12-09. https://genai.owasp.org/resource/owasp-top-10-for-agentic-applications-for-2026/ (verified: primary)
- [9] AIUC-1 requirements (public requirement index, A001 to F002, each requirement on its own page (E007 and E014 marked retired); AIUC-1 is a standard of the Artificial Intelligence Underwriting Company; this site is not affiliated with AIUC, and a mapping here is not an AIUC-1 certificate or audit). Artificial Intelligence Underwriting Company. 2026-09-24. https://standard.aiuc-1.com/llms.txt (verified: primary)
- [10] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "The go/no-go gate"). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/bok/governing-development#the-gono-go-gate (verified: primary)
- [11] Pattern: Continuous Assurance Telemetry (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/patterns/continuous-assurance-telemetry (verified: primary)
- [12] The EU AI Act in one pass (AI Governance Engineering Body of Knowledge v0.5.0, chapter 18, section "Post-market monitoring and serious incidents (Articles 72 and 73)"). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/bok/eu-ai-act#post-market-monitoring-and-serious-incidents-articles-72-and-73 (verified: primary)
- [13] Pattern: Machine-Readable Evidence (OSCAL) (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/patterns/machine-readable-evidence-oscal (verified: primary)
- [14] OSCAL Layers and Models (control layer (catalog, profile), implementation layer (component-definition, system-security-plan) and assessment layer (assessment-plan, assessment-results, POA&M), with traceability from a result to the control it tested). NIST. 2026. https://pages.nist.gov/OSCAL/learn/concepts/layer/ (verified: primary)
- [15] Making AI Compliance Evidence Machine-Readable (arXiv 2604.13767) (one proposed approach, a single preprint: OSCAL with sixteen property extensions for AI). UC3M. 2026-04-15. https://arxiv.org/abs/2604.13767 (verified: primary)
- [16] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "Record keeping"). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/bok/governing-development#record-keeping (verified: primary)
- [17] The EU AI Act in one pass (AI Governance Engineering Body of Knowledge v0.5.0, chapter 18, section "Conformity assessment, declaration, marking and registration"). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/bok/eu-ai-act#conformity-assessment-declaration-marking-and-registration (verified: primary)
- [18] Principles, soft law and standards (AI Governance Engineering Body of Knowledge v0.5.0, chapter 22, section "Integrating with 27001, 27701 and 9001"). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/bok/principles-and-standards#integrating-with-27001-27701-and-9001 (verified: primary)
- [19] Principles, soft law and standards (AI Governance Engineering Body of Knowledge v0.5.0, chapter 22, section "The management-system trio"). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/bok/principles-and-standards#the-management-system-trio (verified: primary)
- [20] Pattern: Model Artefact Integrity (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/patterns/model-artefact-integrity (verified: primary)
- [21] An Introduction to the OpenSSF Model Signing (OMS) Specification (detached signature over a manifest of file hashes, in the Sigstore bundle format; PKI-agnostic). OpenSSF. 2025-06-25. https://openssf.org/blog/2025/06/25/an-introduction-to-the-openssf-model-signing-oms-specification/ (verified: primary)
- [22] model-transparency: supply chain security for ML (signs a statement of file paths and digests through Sigstore or conventional keys; verification recomputes the hashes). Sigstore (GitHub). 2026. https://github.com/sigstore/model-transparency (verified: primary)
- [23] SLSA specification v1.2, Build track basics (Build L1 provenance exists, L2 hosted build platform, L3 hardened builds; provenance describes what built the artefact, by what process and from which top-level inputs). OpenSSF SLSA project. n.d. (accessed 2026-09-24). https://slsa.dev/spec/v1.2/build-track-basics (verified: primary)
- [24] OWASP GenAI LLM Top 10 2026 (LLM01:2026 Prompt Injection to LLM10:2026 Improper Output Handling; resource page dated 3 Aug 2026). OWASP GenAI Security Project. 2026-08-03. https://genai.owasp.org/resource/owasp-genai-llm-top-10-2026/ (verified: primary)
- [25] MITRE ATLAS data, release v2026.09 (16 tactics, 120 techniques, 88 sub-techniques, 40 mitigations; technique names and technique-to-mitigation links read from dist/v6/ATLAS-2026.09.yaml). MITRE. 2026-09-15. https://github.com/mitre-atlas/atlas-data/releases/tag/v2026.09 (verified: primary)
- [26] pickle: Python object serialization ("The pickle module is not secure. Only unpickle data you trust."). Python Software Foundation. 2026. https://docs.python.org/3/library/pickle.html (verified: primary)
- [27] Pickle Scanning (arbitrary code execution when loading pickle files; the Hub's pickle-import scan "is not 100% foolproof"). Hugging Face Hub documentation. n.d. (accessed 2026-09-24). https://huggingface.co/docs/hub/security-pickle (verified: primary)
- [28] Safetensors ("a new simple format for storing tensors safely (as opposed to pickle)"). Hugging Face documentation. n.d. (accessed 2026-09-24). https://huggingface.co/docs/safetensors/index (verified: primary)
- [29] torch.load (default weights_only=True; "Never load data from an untrusted source"). PyTorch documentation (2.14). n.d. (accessed 2026-09-24). https://docs.pytorch.org/docs/stable/generated/torch.load.html (verified: primary)
- [30] Pattern: AIBOM (AI Governance Engineering Body of Knowledge v0.5.0, chapter 05 pattern catalogue). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/patterns/aibom (verified: primary)
- [31] Governing AI development (AI Governance Engineering Body of Knowledge v0.5.0, chapter 14, section "Annex IV, element by element"). AI Governance Engineer (Jorge García Aibar). 2026-09. https://aigovernanceengineer.com/bok/governing-development#annex-iv-element-by-element (verified: primary)
- [32] Evolving AI Transparency: the AIBOM generator's new home at OWASP (OWASP AIBOM generator, CycloneDX output). OWASP GenAI Security Project. 2025-12-18. https://genai.owasp.org/2025/12/18/evolving-ai-transparency-the-journey-of-the-aibom-generator-and-its-new-home-at-owasp/ (verified: primary)
Machine-readable
- Each control as JSON, for example AIGE-CTL-ASSURE-001: the link sits at the foot of every control above.
- All controls as JSON: every control of every profile, in the envelope of the open data API.
- JSON Schema of the controls dataset: generated from the same registry.
- Control observation schema: the record a check of a control emits: control_id, subject, expected, observed, status, timestamp, evidence.
- Observation example: a filled record that validates against the schema.
- Observation template: the same fields in Markdown, with short guidance.
- This page as Markdown: /controls/assurance-and-evidence.md. Every dataset of the site is in the open data API.
Review this profile
Review happens in the open, on GitHub. Pick a control, check it against a system you run or know, and say what is wrong or missing: an objective that cannot be verified, a failure mode that is not observable, a mapping that does not hold. Each control has its own button above; this one reviews the profile as a whole, through the control review form.
This profile has no DOI of its own yet: it is cited with the project concept DOI, 10.5281/zenodo.22857084, which resolves to the latest archived version of the whole project.
Cite this page
García Aibar, J. (2026). Assurance and Evidence Control Profile v0.1 (draft). In AI Governance Engineering: The Thesis & Body of Knowledge (v0.5.0). https://doi.org/10.5281/zenodo.22857084. https://aigovernanceengineer.com/controls/assurance-and-evidence. CC BY 4.0
BibTeX
@misc{aige2026page,
author = {Jorge García Aibar},
title = {{Assurance and Evidence Control Profile v0.1 (draft)}},
howpublished = {In AI Governance Engineering: The Thesis \& Body of Knowledge},
year = {2026},
version = {0.5.0},
doi = {10.5281/zenodo.22857084},
url = {https://aigovernanceengineer.com/controls/assurance-and-evidence},
note = {Version 0.5.0}
}