English
Related papers

Related papers: Towards Uncertainty Aware Task Delegation and Huma…

200 papers

Trustworthy artificial intelligence (AI) is essential in healthcare, particularly for high-stakes tasks like medical image segmentation. Explainable AI and uncertainty quantification significantly enhance AI reliability by addressing key…

Providing well-calibrated AI confidence can help promote users' appropriate trust in and reliance on AI, which are essential for AI-assisted decision-making. However, calibrating AI confidence -- providing confidence score that accurately…

Artificial Intelligence · Computer Science 2025-09-30 Jingshu Li , Yitian Yang , Renwen Zhang , Q. Vera Liao , Tianqi Song , Zhengtao Xu , Yi-chieh Lee

Artificial intelligence (AI) provides considerable opportunities to assist human work. However, one crucial challenge of human-AI collaboration is that many AI algorithms operate in a black-box manner where the way how the AI makes…

Human-Computer Interaction · Computer Science 2024-06-13 Julian Senoner , Simon Schallmoser , Bernhard Kratzwald , Stefan Feuerriegel , Torbjørn Netland

Augmented analytics has transformed how business intelligence (BI) systems support managerial decision-making. This is especially true for users without technical backgrounds, who increasingly rely on automated insights rather than manual…

Human-Computer Interaction · Computer Science 2026-05-21 Thuy Pham Thi Phuong , Ha Nguyen Manh , Ngan Nguyen Thi Thuy , Lan Hoang Thi

Placing a human in the loop may abate the risks of deploying AI systems in safety-critical settings (e.g., a clinician working with a medical AI system). However, mitigating risks arising from human error and uncertainty within such…

Decision support systems enhanced by Artificial Intelligence (AI) are increasingly being used in high-stakes scenarios where errors or biased outcomes can have significant consequences. In this work, we explore the conditions under which…

Human-Computer Interaction · Computer Science 2025-05-20 Marina Estévez-Almenzar , Ricardo Baeza-Yates , Carlos Castillo

AI systems are increasingly tasked to complete responsibilities with decreasing oversight. This delegation requires users to accept certain risks, typically mitigated by perceived or actual alignment of values between humans and AI, leading…

Computers and Society · Computer Science 2025-01-29 Jennifer Chien , David Danks

In AI-assisted decision-making, it is crucial but challenging for humans to appropriately rely on AI, especially in high-stakes domains such as finance and healthcare. This paper addresses this problem from a human-centered perspective by…

Human-Computer Interaction · Computer Science 2025-02-21 Takehiro Takayanagi , Ryuji Hashimoto , Chung-Chi Chen , Kiyoshi Izumi

While human-AI decision-making research has primarily used trust measurements to assess the practical usage of AI systems by their end-users, recent empirical evidence suggests that trust measurements do not inform users' appropriate…

Human-Computer Interaction · Computer Science 2026-04-28 Muhammad Raees , Konstantinos Papangelis

AI systems are fallible, and humans can make mistakes in deciding whether to trust AI over their own judgment. Thus, improving human-AI collaboration requires understanding when, why, and how humans decide to rely on AI. We study two…

Artificial Intelligence · Computer Science 2026-05-28 Maharshi Gor , Yoo Yeon Sung , Yu Hou , Eve Fleisig , Irene Ying , Tianyi Zhou , Jordan Boyd-Graber

The promise of human-AI teaming lies in humans and AI working together to achieve performance levels neither could accomplish alone. Effective communication between AI and humans is crucial for teamwork, enabling users to efficiently…

Human-Computer Interaction · Computer Science 2025-08-13 Tina Behzad , Nikolos Gurney , Ning Wang , David V. Pynadath

A particularly challenging problem in AI safety is providing guarantees on the behavior of high-dimensional autonomous systems. Verification approaches centered around reachability analysis fail to scale, and purely statistical approaches…

Artificial Intelligence · Computer Science 2025-03-11 Souradeep Dutta , Michele Caprio , Vivian Lin , Matthew Cleaveland , Kuk Jin Jang , Ivan Ruchkin , Oleg Sokolsky , Insup Lee

Initially considered as low-power units with limited autonomous processing, Edge IoT devices have seen a paradigm shift with the introduction of FPGAs and AI accelerators. This advancement has vastly amplified their computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-14 Gleb Radchenko , Victoria Andrea Fill

In recent years, the rapid development of AI systems has brought about the benefits of intelligent services but also concerns about security and reliability. By fostering appropriate user reliance on an AI system, both complementary team…

Artificial Intelligence · Computer Science 2025-01-22 Gaole He , Patrick Hemmer , Michael Vössing , Max Schemmer , Ujwal Gadiraju

While artificial intelligence (AI) holds promise for addressing societal challenges, issues of exactly which tasks to automate and to what extent to do so remain understudied. We approach this problem of task delegability from a…

Artificial Intelligence · Computer Science 2019-11-05 Brian Lubars , Chenhao Tan

AI tools are increasingly integrated into real-world workflows. However, existing measures of reliance on these tools focus on AI output adoption or on self-reported indicators, rather than how task effort is distributed between users and…

Software Engineering · Computer Science 2026-05-29 Vishakh Padmakumar , Lujain Ibrahim , Zora Zhiruo Wang , Jennifer Wang , Q. Vera Liao , Diyi Yang

Although AI holds promise for improving human decision making in societally critical domains, it remains an open question how human-AI teams can reliably outperform AI alone and human alone in challenging prediction tasks (also known as…

Artificial Intelligence · Computer Science 2021-10-07 Han Liu , Vivian Lai , Chenhao Tan

Explainable AI has become a common term in the literature, scrutinized by computer scientists and statisticians and highlighted by psychological or philosophical researchers. One major effort many researchers tackle is constructing general…

Artificial Intelligence · Computer Science 2025-09-12 Carina Newen , Daniel Bodemer , Sonja Glantz , Emmanuel Müller , Magdalena Wischnewski , Lenka Schnaubert

We address the problem of uncertainty quantification and propose measures of total, aleatoric, and epistemic uncertainty based on a known decomposition of (strictly) proper scoring rules, a specific type of loss function, into a divergence…

Machine Learning · Computer Science 2025-05-29 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

Artificial Intelligence (AI) has demonstrated potential in healthcare, particularly in enhancing diagnostic accuracy and decision-making through Clinical Decision Support Systems (CDSSs). However, the successful implementation of these…

Human-Computer Interaction · Computer Science 2025-01-29 Olya Rezaeian , Alparslan Emrah Bayrak , Onur Asan