The inability of a person to follow how a system reached an output. It has three sources (secrecy, technical illiteracy, and the nature and scale of machine learning) 1, each with a different fix: disclosure, literacy, and explanation methods plus behavioural evals.
- Developed in
- ch. 11, Eight characteristics that break classic IT governance
ch. 11, Contrast pairs - Chapters
- ch. 11, AI Defined
- Contrast with
- Explainability
- Source
- 1 numbered reference, listed below
Where it is used
4 chapters of the Body of Knowledge use the term. Each link opens the first section that does.
Mentions as a table
| Chapter | Mentions | Cross-referenced |
|---|---|---|
| 00 Preface | 0 | No |
| 01 Definition | 0 | No |
| 02 Why Now | 0 | No |
| 03 Values & Principles | 0 | No |
| 04 The Stack | 0 | No |
| 05 Patterns | 0 | No |
| 06 The Role | 0 | No |
| 07 Maturity Model | 0 | No |
| 08 Regulatory Map | 0 | No |
| 10 Reading List | 2 | No |
| 11 AI Defined | 9 | Yes |
| 12 Governance Program | 0 | No |
| 13 Risk Management | 3 | No |
| 14 Development | 0 | No |
| 15 Deployment | 0 | No |
| 16 Fairness & XAI | 1 | No |
| 17 Incidents | 0 | No |
| 18 EU AI Act | 0 | No |
| 19 Privacy & AI | 0 | No |
| 20 Existing Law | 0 | No |
| 21 AI Laws Worldwide | 0 | No |
| 22 Principles & Standards | 0 | No |
| 23 AI Agents | 0 | No |
- 10 · Reading List Canonical papers: documentation, audit and accountability 2 mentions
- 11 · AI Defined Kinds of AI that change the governance problem 9 mentions
- 13 · Risk Management Risk, defined for engineers 3 mentions
- 16 · Fairness & XAI Transparency, interpretability and explainability 1 mention
Related terms
Neighbourhood as a table
| Family | Item | Relation |
|---|---|---|
| Related terms | Catastrophic forgetting | Related |
| Related terms | Concept drift | Related |
| Related terms | Contributing factor | Related |
| Related terms | Data drift | Related |
| Related terms | Dual use | Related |
| Related terms | Machine learning | Related |
| Related terms | Transparency | Related |
| Contrast with | Explainability | Contrast |
Sources
- [1] "How the machine thinks: Understanding opacity in machine learning algorithms" (three forms of opacity; Big Data & Society 3(1)). SAGE (Jenna Burrell). 2016-01-06. https://doi.org/10.1177/2053951715622512 (verified: primary)
Definitions of legal terms paraphrase the cited text, which governs. Dated statements are as of .