Projekt
Cognitive Friction in Clinical Decision Support: A Comparative Study of Judicial and Adjunct Human–AI Interaction Protocols
Artificial intelligence is increasingly used to support clinical decision making, yet concerns remain regarding algorithmic aversion, automation bias and the preservation of meaningful human oversight; while explainable AI aims to improve transparency, less attention has been devoted to the design of human–AI interact…
Artificial intelligence is increasingly used to support clinical decision making, yet concerns remain regarding algorithmic aversion, automation bias and the preservation of meaningful human oversight; while explainable AI aims to improve transparency, less attention has been devoted to the design of human–AI interaction protocols. This study investigates Frictional AI, an interaction paradigm that introduces cognitive friction to encourage critical engagement with AI recommendations. First, semi-structured interviews were conducted with a legal expert and a psychologist and analyzed through thematic analysis to identify legal, ethical, and cognitive requirements for AI-assisted decision support. Second, a user study involving 96 medical residents compared three interaction protocols: a conventional explainable AI-first design (XAI) and two friction-based protocols, namely a judicial protocol based on juxtaposed explanations (Judicial AI, JAI) and an adjunct protocol requiring an initial unsupported decision before AI exposure (AAI). Diagnostic accuracy and confidence, perceived usefulness, completion time, and reliance patterns were evaluated. The interviews highlighted the importance of human-centered explanations, contrastive reasoning, preservation of professional responsibility, and the role of user studies in evaluating human–AI interaction. The quantitative results showed that none of the AI-assisted conditions improved diagnostic accuracy relative to the no-support baseline. However, JAI achieved performance comparable to the baseline, outperforming XAI and AAI, and exhibited the lowest level of over-reliance. Overall findings suggest that the effectiveness of decision-support systems depends not only on model performance and explanation quality but also on interaction design. In conclusion, while preserving diagnostic performance, judicial protocols showed promise in mitigating automation bias and promoting active cognitive engagement in clinical decision support.
Technologien
- Carbon Capture Carbon Capture – Überblick über Forschungsprojekte, Förderprojekte und Akteure im TechnologieAtlas.
Themengebiete
- Gesundheit Gesundheit – Überblick über Forschungsprojekte, Patente und Akteure im TechnologieAtlas.
- Künstliche Intelligenz Künstliche Intelligenz – Überblick über Forschungsprojekte, Förderprojekte und Akteure im TechnologieAtlas.
Hochschulen
- University of Pavia University of Pavia – Hochschule bzw. Forschungseinrichtung mit Aktivitäten in Forschung und Innovation.
- University of Bergen University of Bergen – Hochschule bzw. Forschungseinrichtung mit Aktivitäten in Forschung und Innovation.
- University of Ottawa University of Ottawa – Hochschule bzw. Forschungseinrichtung mit Aktivitäten in Forschung und Innovation.