中文
相关论文

相关论文: Learning to Advise Humans in High-Stakes Settings

200 篇论文

AI agents deployed in assistive roles often have to collaborate with other agents (humans, AI systems) without prior coordination. Methods considered state of the art for such ad hoc teamwork often pursue a data-driven approach that needs a…

人工智能 · 计算机科学 2025-08-07 Hasra Dodampegama , Mohan Sridharan

In AI alignment, extensive latitude must be granted to annotators, either human or algorithmic, to judge which model outputs are `better' or `safer.' We refer to this latitude as alignment discretion. Such discretion remains largely…

In this work, we develop a game-theoretic modeling of the interaction between a human operator and an autonomous decision aid when they collaborate in a multi-agent task allocation setting. In this setting, we propose a decision aid that is…

多智能体系统 · 计算机科学 2021-12-21 Larkin Heintzman , Ryan K. Williams

As artificial intelligence (AI) assistants become more widely adopted in safety-critical domains, it becomes important to develop safeguards against potential failures or adversarial attacks. A key prerequisite to developing these…

人机交互 · 计算机科学 2025-04-04 Abed Kareem Musaffar , Anand Gokhale , Sirui Zeng , Rasta Tadayon , Xifeng Yan , Ambuj Singh , Francesco Bullo

Artificial Intelligence (AI) is advancing at an unprecedented pace, with clear potential to enhance decision-making and productivity. Yet, the collaborative decision-making process between humans and AI remains underdeveloped, often falling…

人机交互 · 计算机科学 2025-04-10 Bowen Lou , Tian Lu , T. S. Raghu , Yingjie Zhang

Several strands of research have aimed to bridge the gap between artificial intelligence (AI) and human decision-makers in AI-assisted decision-making, where humans are the consumers of AI model predictions and the ultimate decision-makers…

人机交互 · 计算机科学 2022-04-06 Charvi Rastogi , Yunfeng Zhang , Dennis Wei , Kush R. Varshney , Amit Dhurandhar , Richard Tomsett

Today, AI is being increasingly used to help human experts make decisions in high-stakes scenarios. In these scenarios, full automation is often undesirable, not only due to the significance of the outcome, but also because human experts…

人工智能 · 计算机科学 2020-01-08 Yunfeng Zhang , Q. Vera Liao , Rachel K. E. Bellamy

Human decision-making is strongly influenced by cognitive biases, particularly under conditions of uncertainty and risk. While prior work has examined bias in single-step decisions with immediate outcomes and in human interaction with a…

人机交互 · 计算机科学 2026-03-25 Teerthaa Parakh , Karen M. Feigh

Design optimizations in human-AI collaboration often focus on cognitive aspects like attention and task load. Drawing on work design literature, we propose that effective human-AI collaboration requires broader consideration of human needs…

人机交互 · 计算机科学 2024-10-11 Cedric Faas , Richard Bergs , Sarah Sterz , Markus Langer , Anna Maria Feit

Classification algorithms based on Artificial Intelligence (AI) are nowadays applied in high-stakes decisions in finance, healthcare, criminal justice, or education. Individuals can strategically adapt to the information gathered about…

计算机科学与博弈论 · 计算机科学 2025-08-14 Marta C. Couto , Flavia Barsotti , Fernando P. Santos

Large Language Models (LLMs) have demonstrated their capabilities across various tasks, from language translation to complex reasoning. Understanding and predicting human behavior and biases are crucial for artificial intelligence (AI)…

人工智能 · 计算机科学 2024-08-06 Thuy Ngoc Nguyen , Kasturi Jamale , Cleotilde Gonzalez

Recent advances in AI models have increased the integration of AI-based decision aids into the human decision making process. To fully unlock the potential of AI-assisted decision making, researchers have computationally modeled how humans…

人机交互 · 计算机科学 2024-11-19 Zhuoyan Li , Ming Yin

Human-robot interactive decision-making is increasingly becoming ubiquitous, and trust is an influential factor in determining the reliance on autonomy. However, it is not reasonable to trust systems that are beyond our comprehension, and…

机器学习 · 计算机科学 2021-08-16 Daoming Lyu , Fangkai Yang , Hugh Kwon , Wen Dong , Levent Yilmaz , Bo Liu

This paper introduces A2C, a multi-stage collaborative decision framework designed to enable robust decision-making within human-AI teams. Drawing inspiration from concepts such as rejection learning and learning to defer, A2C incorporates…

人机交互 · 计算机科学 2024-01-29 Shahroz Tariq , Mohan Baruwal Chhetri , Surya Nepal , Cecile Paris

Despite impressive performance in many benchmark datasets, AI models can still make mistakes, especially among out-of-distribution examples. It remains an open question how such imperfect models can be used effectively in collaboration with…

人工智能 · 计算机科学 2022-04-26 Vivian Lai , Samuel Carton , Rajat Bhatnagar , Q. Vera Liao , Yunfeng Zhang , Chenhao Tan

In settings where users both need high accuracy and are time-pressured, such as doctors working in emergency rooms, we want to provide AI assistance that both increases decision accuracy and reduces decision-making time. Current literature…

人机交互 · 计算机科学 2024-02-13 Siddharth Swaroop , Zana Buçinca , Krzysztof Z. Gajos , Finale Doshi-Velez

Multi-drone systems have become transformative technologies across various industries, offering innovative applications. However, despite significant advancements, their autonomous capabilities remain inherently limited. As a result, human…

人机交互 · 计算机科学 2025-02-26 Hodaya Barr , Dror Levy , Ariel Rosenfeld , Oleg Maksimov , Sarit Kraus

The integration of Artificial Intelligence (AI) necessitates determining whether systems function as tools or collaborative teammates. In this study, by synthesizing Human-AI Interaction (HAI) literature, we analyze this distinction across…

There are many unknowns regarding the characteristics and dynamics of human-AI teams, including a lack of understanding of how certain human-human teaming concepts may or may not apply to human-AI teams and how this composition affects team…

人机交互 · 计算机科学 2021-05-25 Nathan J. McNeese , Beau G. Schelble , Lorenzo Barberis Canonico , Mustafa Demir

As reliance on AI systems for decision-making grows, it becomes critical to ensure that human users can appropriately balance trust in AI suggestions with their own judgment, especially in high-stakes domains like healthcare. However, human…

人机交互 · 计算机科学 2025-01-29 Zichen Chen , Yunhao Luo , Misha Sra