Right to Explanation
Right to Explanation is the legal and ethical principle that individuals affected by automated decisions have the right to receive meaningful information about the logic, significance, and consequences of those decisions — codified in regulations like the EU's GDPR (Article 22 and Recitals 71), this right creates legal obligations for organizations to provide understandable explanations of AI-driven decisions in areas like credit scoring, hiring, insurance, and criminal justice.
What Is the Right to Explanation?
- Definition: The legal entitlement of individuals to receive an explanation when they are subject to automated decision-making that significantly affects them.
- Core Legal Basis: GDPR Article 22 grants the right not to be subject to solely automated decisions with legal or significant effects, with Recital 71 specifying the right to "obtain an explanation."
- Key Debate: Legal scholars disagree on whether GDPR mandates explanations of specific decisions (individual) or just general system descriptions (systemic).
- Scope: Applies to credit decisions, hiring algorithms, insurance underwriting, content recommendations, and any AI system with significant personal impact.
Why Right to Explanation Matters
- Individual Agency: People cannot challenge or appeal decisions they don't understand.
- Accountability: Organizations must be able to justify their AI systems' decisions to affected individuals.
- Trust: Transparency in automated decisions builds public trust in AI systems.
- Bias Detection: Explanations can reveal discriminatory patterns that are invisible in aggregate metrics.
- Legal Compliance: Non-compliance with GDPR can result in fines up to 4% of global annual revenue or €20 million.
Legal Framework
| Regulation | Provision | Scope |
|---|---|---|
| EU GDPR | Articles 13-15, 22, Recitals 60, 71 | Automated decisions with significant effects |
| EU AI Act | Transparency requirements for high-risk AI | AI systems in listed high-risk domains |
| US ECOA | Adverse action notices | Credit decisions |
| US FCRA | Disclosure of factors in credit scoring | Credit reporting |
| CCPA/CPRA | Right to know about automated decision-making | California residents |
Types of Explanations
- Global Explanations: Describe how the model works overall (feature importance, decision rules).
- Local Explanations: Explain why a specific decision was made for a specific individual.
- Counterfactual Explanations: "Your loan was denied; it would have been approved if your income were $5,000 higher."
- Contrastive Explanations: "You were rejected because of X, while similar approved applicants had Y."
Technical Implementation
| Method | Type | Explanation |
|---|---|---|
| LIME | Local | Approximates model locally with interpretable model |
| SHAP | Both | Computes feature contribution using Shapley values |
| Counterfactual | Local | Finds minimal input changes that change the decision |
| Decision Rules | Global | Extracts if-then rules from model behavior |
| Attention Maps | Local | Highlights input features the model focused on |
Challenges
- Fidelity vs. Simplicity: Accurate explanations may be too complex; simple explanations may be inaccurate.
- Trade Secrets: Full model disclosure may reveal proprietary algorithms or enable gaming.
- Technical Literacy: Explanations must be understandable to non-technical individuals.
- Manipulation: Knowledge of decision logic can be exploited to game the system.
Right to Explanation is the legal foundation for accountable AI governance — establishing that automated decisions affecting people's lives must be transparent and explainable, driving the entire field of Explainable AI (XAI) and reshaping how organizations design, deploy, and document their AI systems.