Council of Europe Convention Art. 16(2)(g): testing before first use and on significant modification

Test systems before first use and when they are significantly modified, where appropriate

By Jorge García Aibar Reviewed 2026-09-24

From clause to evidence Build the artefact, then file every output it produces as a record that names AIGE-OBL-COE-ART16-2G. Drawn from chapter 08.

Text alternative

Clause: CoE Convention, Art. 16.
Duty holder: Parties.
Applies from: No date, Draft or proposed.
Artefact: Eval gate on release….
Layer: Layer 03 Evals & Red Teaming as Evidence.
Evidence record: Evidence record v1.
Record schema: Evidence record.
The same topic in 19 other frameworks; the crosswalk section below links each clause.

Id: AIGE-OBL-COE-ART16-2G
Instrument: Council of Europe Framework Convention on AI (CETS No. 225) law
Clause: Art. 16(2)(g)
In scope: Parties (states and the EU); private actors through national measures
Applies from: No date Draft or proposed · Not in force as of 2026-09-24; binds Parties once in force, and the EU implements it through the AI Act

The artefact that evidences it

Eval gate on release and on material change.

L3 Evals & Red Teaming as Evidence

What this obligation connects to Solid edges are direct relations, dashed ones looser (a case that cites the same article, a framework whose clauses only touch the topic); patterns and controls take the colour of their stack layer. Select a node to open it; the lists below give every relation in full.

Data table: every relation

Relations of AIGE-OBL-COE-ART16-2G
Family	Item	Relation
Same crosswalk topic	AI Verify 4.1.1, 6.1.1, 5.2.1, 5.9.1, 9.4.1, 5.14.1, 6.5.1, 4.6.1	Core clause
Same crosswalk topic	CSA AICM MDS-06, MDS-07, AIS-05, AIS-06, CCC-01, DSP-02	Core clause
Same crosswalk topic	China Deep Synthesis DeepSyn Art. 15, DeepSyn Art. 20	Core clause
Same crosswalk topic	EU AI Act Art. 15, Art. 55, Art. 60, Art. 15(3), Art. 9, Art. 42(3), Art. 26, Art. 25, Art. 43(4), Art. 20, Art. 79, Art. 86	Core clause
Same crosswalk topic	G7 Code G7 Action 1	Core clause
Same crosswalk topic	GAO AI Accountability 3.7, 3.2, 4.4, 4.5	Core clause
Same crosswalk topic	GB/T 45654 GB/T 45654 Security assessment	Core clause
Same crosswalk topic	GPAI Code Safety 3.2, Safety C6	Core clause
Same crosswalk topic	ISO 42001 A.6, 9.1, A.6.2.5, A.6.2.6, A.9	Core clause
Same crosswalk topic	NIST AI RMF MEASURE 2, MEASURE 2.7, MEASURE 2.1, MEASURE 1, MANAGE 2.4, MANAGE 4.1, GOVERN 1.7	Core clause
Same crosswalk topic	OECD AI Principles OECD 1.4	Core clause
Same crosswalk topic	Singapore Agentic Agentic 2.3.2, Agentic 2.3.3	Core clause
Same crosswalk topic	Singapore GenAI GenAI 5, GenAI 6	Core clause
Same crosswalk topic	TC260 Framework 3.0 TC260 3, TC260 App. 2 II.6, TC260 5.3.14, TC260 5.3, TC260 5.3.19	Core clause
Same crosswalk topic	China GenAI Measures GenAI Art. 17	Related clause
Same crosswalk topic	GDPR Art. 32	Related clause
Same crosswalk topic	Korea AI Act Art. 32(1)	Related clause
Same crosswalk topic	OWASP Agentic ASI05	Related clause
Same crosswalk topic	OWASP LLM LLM01:2026	Related clause

Patterns that build it

No pattern in the catalogue names this clause on its "Maps to" line yet; the artefact above is the engineering answer.

The same topic in other frameworks

From the topic crosswalk: the clauses filed under the same topics as this one. Mappings are illustrative, not a claim of conformity.

Robustness, security and evaluations

EU AI Act Art. 15 Accuracy, robustness and cybersecurity (core)
EU AI Act Art. 55 Obligations for providers of general-purpose AI models with systemic risk (core)
ISO 42001 A.6 AI system life cycle (core)
NIST AI RMF MEASURE 2 MEASURE 2: AI systems are evaluated for trustworthy characteristics (core)
TC260 Framework 3.0 TC260 3 Technological countermeasures (core)
TC260 Framework 3.0 TC260 App. 2 II.6 Sandbox validation and red teaming (core)
China Deep Synthesis DeepSyn Art. 15 Technology management and algorithm verification (core)
China Deep Synthesis DeepSyn Art. 20 Security assessment of new products (core)
GB/T 45654 GB/T 45654 Security assessment Security-assessment requirements for generative AI services (core) (clause not verified)
GPAI Code Safety 3.2 Measure 3.2: Model evaluations (core)
NIST AI RMF MEASURE 2.7 MEASURE 2.7: AI system security and resilience as identified in the MAP function are evaluated and documented (core)
CSA AICM MDS-06 Adversarial Attack Analysis (core)
CSA AICM MDS-07 Robustness against Adversarial Attack / Model Hardening (core)
Singapore GenAI GenAI 5 Testing and Assurance (core)
Singapore GenAI GenAI 6 Security (core)
Singapore Agentic Agentic 2.3.2 Before deploying, test agents (core)
OECD AI Principles OECD 1.4 Robustness, security and safety (core)
G7 Code G7 Action 1 Identify, evaluate and mitigate risks across the lifecycle, including testing (core)
GAO AI Accountability 3.7 Assessment: assess performance against defined metrics to ensure the AI system functions as intended and is sufficiently robust (core)
AI Verify 4.1.1 Safety (technical test): run use-case benchmarks and red-teaming to evaluate for safety and possible harms (e.g. hallucination, toxicity) (core)
AI Verify 6.1.1 Robustness (technical test): compare accuracy with and without added noise to document and monitor performance (core)
AI Verify 5.2.1 Security: conduct security risk assessments that model threats and risks to the AI system (core)
EU AI Act Art. 60 Testing of high-risk AI systems in real-world conditions outside AI regulatory sandboxes
ISO 42001 9.1 Monitoring, measurement, analysis and evaluation
TC260 Framework 3.0 TC260 5.3.14 Resilience
China GenAI Measures GenAI Art. 17 Security assessment
EU AI Act Art. 15(3) Declared accuracy levels and metrics
EU AI Act Art. 9 Risk management system
EU AI Act Art. 42(3) Presumption of conformity for cybersecurity (Cyber Resilience Act)
GPAI Code Safety C6 Commitment 6: Security mitigations
GDPR Art. 32 Security of processing
NIST AI RMF MEASURE 2.1 MEASURE 2.1: Test sets, metrics, and details about the tools used during TEVV are documented
NIST AI RMF MEASURE 1 MEASURE 1: Appropriate methods and metrics are identified and applied
CSA AICM AIS-05 Application Security Testing
OWASP LLM LLM01:2026 Prompt Injection
OWASP Agentic ASI05 Unexpected Code Execution (RCE)
Korea AI Act Art. 32(1) Safety duties for AI above the compute threshold
GAO AI Accountability 3.2 Metrics: define performance metrics that are precise, consistent, and reproducible
AI Verify 5.9.1 Security: release AI systems only after appropriate and effective security checks and evaluation

Deployment, change and decommissioning

EU AI Act Art. 26 Obligations of deployers of high-risk AI systems (core)
ISO 42001 A.6.2.5 AI system deployment (core) (clause not verified)
ISO 42001 A.6.2.6 AI system operation and monitoring (core) (clause not verified)
NIST AI RMF MANAGE 2.4 MANAGE 2.4: Mechanisms are in place and applied, and responsibilities are assigned and understood, to supersede, disengage, or deactivate AI systems that demonstrate performance or outcomes inconsistent with intended use (core)
NIST AI RMF MANAGE 4.1 MANAGE 4.1: Post-deployment AI system monitoring plans are implemented, including mechanisms for capturing and evaluating input from users and other relevant AI actors, appeal and override, decommissioning, incident response, recovery, and change management (core)
NIST AI RMF GOVERN 1.7 GOVERN 1.7: Processes and procedures are in place for decommissioning and phasing out AI systems safely and in a manner that does not increase risks or decrease the organization's trustworthiness (core)
CSA AICM AIS-06 Secure Application Deployment (core)
AI Verify 9.4.1 Accountability: a policy to deactivate, decommission and phase out AI systems safely (core)
AI Verify 5.14.1 Security: proper and secure disposal of data and models (core)
AI Verify 6.5.1 Robustness: review changes in code, input data and output data to decide when a new robustness review is due (core)
EU AI Act Art. 25 Responsibilities along the AI value chain
EU AI Act Art. 43(4) New conformity assessment on substantial modification
EU AI Act Art. 20 Corrective actions and duty of information
EU AI Act Art. 79 Procedure at national level for dealing with AI systems presenting a risk
EU AI Act Art. 86 Right to explanation of individual decision-making
ISO 42001 A.9 Use of AI systems
CSA AICM CCC-01 Change Management Policy and Procedures
CSA AICM DSP-02 Secure Disposal
Singapore Agentic Agentic 2.3.3 When deploying, continuously monitor and test
OECD AI Principles OECD 1.4 Robustness, security and safety
TC260 Framework 3.0 TC260 5.3 Operators' safety guidelines
TC260 Framework 3.0 TC260 5.3.19 Re-assessment on material change
GAO AI Accountability 4.4 Ongoing assessment: assess the utility of the AI system to ensure its relevance to the current context
GAO AI Accountability 4.5 Scaling: identify conditions, if any, under which the AI system may be scaled or expanded beyond its current use
AI Verify 4.6.1 Safety: deployment strategies such as blue-green and canary deployments

Source

Chapter 08, section Treaty and international soft law, checked against its sources on the review date above.

Machine-readable

This obligation: /api/v1/obligations/aige-obl-coe-art16-2g.json
The register: /api/v1/obligations.json · CSV
Schema and stability promise: open data and API

Cite this obligation

García Aibar, J. (2026). Council of Europe Convention Art. 16(2)(g): testing before first use and on significant modification (AIGE-OBL-COE-ART16-2G). In AI Governance Engineering: The Thesis & Body of Knowledge (v0.5.0). https://doi.org/10.5281/zenodo.22956197. https://aigovernanceengineer.com/obligations/aige-obl-coe-art16-2g. CC BY 4.0

BibTeX

@misc{aige2026obligation,
  author       = {Jorge García Aibar},
  title        = {{Council of Europe Convention Art. 16(2)(g): testing before first use and on significant modification (AIGE-OBL-COE-ART16-2G)}},
  howpublished = {In AI Governance Engineering: The Thesis \& Body of Knowledge},
  year         = {2026},
  version      = {0.5.0},
  doi          = {10.5281/zenodo.22956197},
  url          = {https://aigovernanceengineer.com/obligations/aige-obl-coe-art16-2g},
  note         = {Version 0.5.0}
}