Medizinische Universität Graz Austria/Österreich - Forschungsportal - Medical University of Graz
Gewählte Publikation:
SHR Neuro Krebs Kardio Lipid Stoffw Microb
Metsch, JM; Saranti, A; Angerschmid, A; Pfeifer, B; Klemt, V; Holzinger, A; Hauschild, AC.
CLARUS: An interactive explainable AI platform for manual counterfactuals in graph neural networks.
J Biomed Inform. 2024; 150:104600
Doi: 10.1016/j.jbi.2024.104600
Web of Science
PubMed
FullText
FullText_MUG
- Co-Autor*innen der Med Uni Graz
- Angerschmid Alessa
- Holzinger Andreas
- Pfeifer Bastian
- Saranti Anna
- Altmetrics:
- Dimensions Citations:
- Plum Analytics:
- Scite (citation analytics):
- Abstract:
- BACKGROUND: Lack of trust in artificial intelligence (AI) models in medicine is still the key blockage for the use of AI in clinical decision support systems (CDSS). Although AI models are already performing excellently in systems medicine, their black-box nature entails that patient-specific decisions are incomprehensible for the physician. Explainable AI (XAI) algorithms aim to "explain" to a human domain expert, which input features influenced a specific recommendation. However, in the clinical domain, these explanations must lead to some degree of causal understanding by a clinician. RESULTS: We developed the CLARUS platform, aiming to promote human understanding of graph neural network (GNN) predictions. CLARUS enables the visualisation of patient-specific networks, as well as, relevance values for genes and interactions, computed by XAI methods, such as GNNExplainer. This enables domain experts to gain deeper insights into the network and more importantly, the expert can interactively alter the patient-specific network based on the acquired understanding and initiate re-prediction or retraining. This interactivity allows us to ask manual counterfactual questions and analyse the effects on the GNN prediction. CONCLUSION: We present the first interactive XAI platform prototype, CLARUS, that allows not only the evaluation of specific human counterfactual questions based on user-defined alterations of patient networks and a re-prediction of the clinical outcome but also a retraining of the entire GNN after changing the underlying graph structures. The platform is currently hosted by the GWDG on https://rshiny.gwdg.de/apps/clarus/.
- Find related publications in this database (using NLM MeSH Indexing)
- Humans - administration & dosage
- Artificial Intelligence - administration & dosage
- Neural Networks, Computer - administration & dosage
- Algorithms - administration & dosage
- Decision Support Systems, Clinical - administration & dosage
- Physicians - administration & dosage
- Tolnaftate - administration & dosage
- Find related publications in this database (Keywords)
- Explainable AI
- Platform
- Graph neural networks
- Counterfactuals
- Human-in-the-loop
- Causability