English
Related papers

Related papers: Learning to Advise Humans in High-Stakes Settings

200 papers

AI agents deployed in assistive roles often have to collaborate with other agents (humans, AI systems) without prior coordination. Methods considered state of the art for such ad hoc teamwork often pursue a data-driven approach that needs a…

Artificial Intelligence · Computer Science 2025-08-07 Hasra Dodampegama , Mohan Sridharan

In AI alignment, extensive latitude must be granted to annotators, either human or algorithmic, to judge which model outputs are `better' or `safer.' We refer to this latitude as alignment discretion. Such discretion remains largely…

Artificial Intelligence · Computer Science 2025-02-18 Maarten Buyl , Hadi Khalaf , Claudio Mayrink Verdun , Lucas Monteiro Paes , Caio C. Vieira Machado , Flavio du Pin Calmon

In this work, we develop a game-theoretic modeling of the interaction between a human operator and an autonomous decision aid when they collaborate in a multi-agent task allocation setting. In this setting, we propose a decision aid that is…

Multiagent Systems · Computer Science 2021-12-21 Larkin Heintzman , Ryan K. Williams

As artificial intelligence (AI) assistants become more widely adopted in safety-critical domains, it becomes important to develop safeguards against potential failures or adversarial attacks. A key prerequisite to developing these…

Human-Computer Interaction · Computer Science 2025-04-04 Abed Kareem Musaffar , Anand Gokhale , Sirui Zeng , Rasta Tadayon , Xifeng Yan , Ambuj Singh , Francesco Bullo

Artificial Intelligence (AI) is advancing at an unprecedented pace, with clear potential to enhance decision-making and productivity. Yet, the collaborative decision-making process between humans and AI remains underdeveloped, often falling…

Human-Computer Interaction · Computer Science 2025-04-10 Bowen Lou , Tian Lu , T. S. Raghu , Yingjie Zhang

Several strands of research have aimed to bridge the gap between artificial intelligence (AI) and human decision-makers in AI-assisted decision-making, where humans are the consumers of AI model predictions and the ultimate decision-makers…

Human-Computer Interaction · Computer Science 2022-04-06 Charvi Rastogi , Yunfeng Zhang , Dennis Wei , Kush R. Varshney , Amit Dhurandhar , Richard Tomsett

Today, AI is being increasingly used to help human experts make decisions in high-stakes scenarios. In these scenarios, full automation is often undesirable, not only due to the significance of the outcome, but also because human experts…

Artificial Intelligence · Computer Science 2020-01-08 Yunfeng Zhang , Q. Vera Liao , Rachel K. E. Bellamy

Human decision-making is strongly influenced by cognitive biases, particularly under conditions of uncertainty and risk. While prior work has examined bias in single-step decisions with immediate outcomes and in human interaction with a…

Human-Computer Interaction · Computer Science 2026-03-25 Teerthaa Parakh , Karen M. Feigh

Design optimizations in human-AI collaboration often focus on cognitive aspects like attention and task load. Drawing on work design literature, we propose that effective human-AI collaboration requires broader consideration of human needs…

Human-Computer Interaction · Computer Science 2024-10-11 Cedric Faas , Richard Bergs , Sarah Sterz , Markus Langer , Anna Maria Feit

Classification algorithms based on Artificial Intelligence (AI) are nowadays applied in high-stakes decisions in finance, healthcare, criminal justice, or education. Individuals can strategically adapt to the information gathered about…

Computer Science and Game Theory · Computer Science 2025-08-14 Marta C. Couto , Flavia Barsotti , Fernando P. Santos

Large Language Models (LLMs) have demonstrated their capabilities across various tasks, from language translation to complex reasoning. Understanding and predicting human behavior and biases are crucial for artificial intelligence (AI)…

Artificial Intelligence · Computer Science 2024-08-06 Thuy Ngoc Nguyen , Kasturi Jamale , Cleotilde Gonzalez

Recent advances in AI models have increased the integration of AI-based decision aids into the human decision making process. To fully unlock the potential of AI-assisted decision making, researchers have computationally modeled how humans…

Human-Computer Interaction · Computer Science 2024-11-19 Zhuoyan Li , Ming Yin

Human-robot interactive decision-making is increasingly becoming ubiquitous, and trust is an influential factor in determining the reliance on autonomy. However, it is not reasonable to trust systems that are beyond our comprehension, and…

Machine Learning · Computer Science 2021-08-16 Daoming Lyu , Fangkai Yang , Hugh Kwon , Wen Dong , Levent Yilmaz , Bo Liu

This paper introduces A2C, a multi-stage collaborative decision framework designed to enable robust decision-making within human-AI teams. Drawing inspiration from concepts such as rejection learning and learning to defer, A2C incorporates…

Human-Computer Interaction · Computer Science 2024-01-29 Shahroz Tariq , Mohan Baruwal Chhetri , Surya Nepal , Cecile Paris

Despite impressive performance in many benchmark datasets, AI models can still make mistakes, especially among out-of-distribution examples. It remains an open question how such imperfect models can be used effectively in collaboration with…

Artificial Intelligence · Computer Science 2022-04-26 Vivian Lai , Samuel Carton , Rajat Bhatnagar , Q. Vera Liao , Yunfeng Zhang , Chenhao Tan

In settings where users both need high accuracy and are time-pressured, such as doctors working in emergency rooms, we want to provide AI assistance that both increases decision accuracy and reduces decision-making time. Current literature…

Human-Computer Interaction · Computer Science 2024-02-13 Siddharth Swaroop , Zana Buçinca , Krzysztof Z. Gajos , Finale Doshi-Velez

Multi-drone systems have become transformative technologies across various industries, offering innovative applications. However, despite significant advancements, their autonomous capabilities remain inherently limited. As a result, human…

Human-Computer Interaction · Computer Science 2025-02-26 Hodaya Barr , Dror Levy , Ariel Rosenfeld , Oleg Maksimov , Sarit Kraus

The integration of Artificial Intelligence (AI) necessitates determining whether systems function as tools or collaborative teammates. In this study, by synthesizing Human-AI Interaction (HAI) literature, we analyze this distinction across…

Human-Computer Interaction · Computer Science 2026-02-19 Most. Sharmin Sultana Samu , Nafisa Khan , Kazi Toufique Elahi , Tasnuva Binte Rahman , Md. Rakibul Islam , Farig Sadeque

There are many unknowns regarding the characteristics and dynamics of human-AI teams, including a lack of understanding of how certain human-human teaming concepts may or may not apply to human-AI teams and how this composition affects team…

Human-Computer Interaction · Computer Science 2021-05-25 Nathan J. McNeese , Beau G. Schelble , Lorenzo Barberis Canonico , Mustafa Demir

As reliance on AI systems for decision-making grows, it becomes critical to ensure that human users can appropriately balance trust in AI suggestions with their own judgment, especially in high-stakes domains like healthcare. However, human…

Human-Computer Interaction · Computer Science 2025-01-29 Zichen Chen , Yunhao Luo , Misha Sra