Title
Data-driven AI development: An integrated and iterative bias mitigation approach
Author
Ennali, Y.
van Engers, T.
Publication year
2021
Abstract
This paper presents an explanatory case study aimed at exploring bias leading to discriminatory decisions generated by artificial intelligence decision making systems (AI-DMS). Particularly machine learning-based AI-DMS depends on data concealing bias emerging from society. This bias could be transitioned to AI-DMS models and consequently lead to undesirable biased predictions. Preventing bias is an actual theme both in academia and industry. Academic literature generally seems to be focused on particular bias mitigation methods, while integrating these methods in the development process of AI-DMS models remains underexposed. In this study, the concepts of bias identification and bias mitigation methods are explored to conceive an integrated approach of bias identification and mitigation in the AI-DMS model development process. Reviewing this approach with a case study showed that its application contributes to the development of fair and accurate AI-DMS models. The proposed iterative approach enables the combination of multiple bias mitigation methods. Additionally, its step-by-step design empowers designers to be aware of bias pitfalls in AI, opening doors for an “unbiased by design” model development. From a governance perspective, the proposed approach might serve as an instrument for AI-DMS models’ internal auditing purposes.
Subject
Artificial intelligence decision-making systems
Bias
Bias mitigation
Explainable artificial intelligence
IT-audit
Legal compliance
Decision making
Iterative methods
Academic literature
Development process
Integrated approach
Intelligence decision
Internal auditing
Iterative approach
Mitigation methods
Model development
Artificial intelligence
To reference this document use:
http://resolver.tudelft.nl/uuid:c009bd64-f5b1-4677-a372-3ce7cb8cc004
TNO identifier
968191
Publisher
CEUR-WS
ISSN
1613-0073
Source
CEUR Workshop Proceedings, 3rd EXplainable AI in Law Workshop, XAILA 2020, 9 December 2020
Document type
conference paper