Medizinische Universität Graz Austria/Österreich - Forschungsportal - Medical University of Graz
Gewählte Publikation:
SHR Neuro Krebs Kardio Lipid Stoffw Microb
Del Ser, J; Barredo-Arrieta, A; Díaz-Rodríguez, N; Herrera, F; Saranti, A; Holzinger, A.
On generating trustworthy counterfactual explanations
INFORM SCIENCES. 2024; 655: 119898
Doi: 10.1016/j.ins.2023.119898
Web of Science
FullText
FullText_MUG
- Führende Autor*innen der Med Uni Graz
- Holzinger Andreas
- Co-Autor*innen der Med Uni Graz
- Saranti Anna
- Altmetrics:
- Dimensions Citations:
- Plum Analytics:
- Scite (citation analytics):
- Abstract:
- Deep learning models like chatGPT exemplify AI success but necessitate a deeper understanding of trust in critical sectors. Trust can be achieved using counterfactual explanations, which is how humans become familiar with unknown processes; by understanding the hypothetical input circumstances under which the output changes. We argue that the generation of counterfactual explanations requires several aspects of the generated counterfactual instances, not just their counterfactual ability. We present a framework for generating counterfactual explanations that formulate its goal as a multiobjective optimization problem balancing three objectives: plausibility; the intensity of changes; and adversarial power. We use a generative adversarial network to model the distribution of the input, along with a multiobjective counterfactual discovery solver balancing these objectives. We demonstrate the usefulness of six classification tasks with image and 3D data confirming with evidence the existence of a trade-off between the objectives, the consistency of the produced counterfactual explanations with human knowledge, and the capability of the framework to unveil the existence of concept -based biases and misrepresented attributes in the input domain of the audited model. Our pioneering effort shall inspire further work on the generation of plausible counterfactual explanations in real -world scenarios where attribute -/concept -based annotations are available for the domain under analysis.
- Find related publications in this database (Keywords)
- Explainable artificial intelligence
- Deep learning
- Counterfactual explanations
- Generative adversarial networks
- Multi-objective optimization