English
Related papers

Related papers: Human-AI Collaboration with Bandit Feedback

200 papers

When an AI system interacts with multiple users, it frequently needs to make allocation decisions. For instance, a virtual agent decides whom to pay attention to in a group setting, or a factory robot selects a worker to deliver a part.…

Machine Learning · Computer Science 2019-12-18 Yifang Chen , Alex Cuellar , Haipeng Luo , Jignesh Modi , Heramb Nemlekar , Stefanos Nikolaidis

We introduce a novel framework for human-AI collaboration in prediction and decision tasks. Our approach leverages human judgment to distinguish inputs which are algorithmically indistinguishable, or "look the same" to any feasible…

Machine Learning · Computer Science 2024-10-21 Rohan Alur , Loren Laine , Darrick K. Li , Dennis Shung , Manish Raghavan , Devavrat Shah

Effective human-AI collaboration for physical task completion has significant potential in both everyday activities and professional domains. AI agents equipped with informative guidance can enhance human performance, but evaluating such…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Filippos Bellos , Yayuan Li , Cary Shu , Ruey Day , Jeffrey M. Siskind , Jason J. Corso

Interactive preference elicitation (IPE) aims to substantially reduce human effort while acquiring human preferences in wide personalization systems. Dueling bandit (DB) algorithms enable optimal decision-making in IPE building on pairwise…

Machine Learning · Computer Science 2025-11-13 Shengbo Wang , Hong Sun , Ke Li

In AI-assisted decision-making, effective hybrid (human-AI) teamwork is not solely dependent on AI performance alone, but also on its impact on human decision-making. While prior work studies the effects of model accuracy on humans, we…

Human-Computer Interaction · Computer Science 2022-02-25 Andi Peng , Besmira Nushi , Emre Kiciman , Kori Inkpen , Ece Kamar

Recommendation systems when employed in markets play a dual role: they assist users in selecting their most desired items from a large pool and they help in allocating a limited number of items to the users who desire them the most. Despite…

Machine Learning · Computer Science 2022-08-01 Yigit Efe Erginbas , Soham Phade , Kannan Ramchandran

Humans and AIs are often paired on decision tasks with the expectation of achieving complementary performance -- where the combination of human and AI outperforms either one alone. However, how to improve performance of a human-AI team is…

Human-Computer Interaction · Computer Science 2025-02-26 Ziyang Guo , Yifan Wu , Jason Hartline , Jessica Hullman

Inspired by the increasing use of AI to augment humans, researchers have studied human-AI systems involving different tasks, systems, and populations. Despite such a large body of work, we lack a broad conceptual understanding of when…

Human-Computer Interaction · Computer Science 2024-10-30 Michelle Vaccaro , Abdullah Almaatouq , Thomas Malone

Joint human-AI inference holds immense potential to improve outcomes in human-supervised robot missions. Current day missions are generally in the AI-assisted setting, where the human operator makes the final inference based on the AI…

Human-Computer Interaction · Computer Science 2025-08-06 Duc-An Nguyen , Clara Colombatto , Steve Fleming , Ingmar Posner , Nick Hawes , Raunak Bhattacharyya

While sequential task assignment for a single agent has been widely studied, such problems in a multi-agent setting, where the agents have heterogeneous task preferences or capabilities, remain less well-characterized. We study a…

Multiagent Systems · Computer Science 2025-10-21 Qinshuang Wei , Vaibhav Srivastava , Vijay Gupta

We develop a decision-theoretic model of human-AI interaction to study when AI assistance improves or impairs human decision-making. A human decision-maker observes private information and receives a recommendation from an AI system, but…

Computer Science and Game Theory · Computer Science 2026-02-17 Saurabh Amin , Amine Bennouna , Daniel Huttenlocher , Dingwen Kong , Liang Lyu , Asuman Ozdaglar

We study the problem of information sharing and cooperation in Multi-Player Multi-Armed bandits. We propose the first algorithm that achieves logarithmic regret for this problem when the collision reward is unknown. Our results are based on…

Machine Learning · Computer Science 2022-10-04 Aldo Pacchiano , Peter Bartlett , Michael I. Jordan

This paper offers a concise, 60-year synthesis of human-AI collaboration, from Licklider's ``man-computer symbiosis" (AI as colleague) and Engelbart's ``augmenting human intellect" (AI as tool) to contemporary poles: Human-Centered AI's…

Human-Computer Interaction · Computer Science 2026-01-13 Richard Jiarui Tong

Although AI holds promise for improving human decision making in societally critical domains, it remains an open question how human-AI teams can reliably outperform AI alone and human alone in challenging prediction tasks (also known as…

Artificial Intelligence · Computer Science 2021-10-07 Han Liu , Vivian Lai , Chenhao Tan

We study the sequential resource allocation problem where a decision maker repeatedly allocates budgets between resources. Motivating examples include allocating limited computing time or wireless spectrum bands to multiple users (i.e.,…

Machine Learning · Computer Science 2021-05-11 Jinhang Zuo , Carlee Joe-Wong

We study the mixed human-robot team design in a system theoretic setting using the context of a surveillance mission. The three key coupled components of a mixed team design are (i) policies for the human operator, (ii) policies to account…

Optimization and Control · Mathematics 2013-11-13 Vaibhav Srivastava , Amit Surana , Miguel P. Eckstein , Francesco Bullo

Despite the growing interest in collaborative AI, designing systems that seamlessly integrate human input remains a major challenge. In this study, we developed a task to systematically examine human preferences for collaborative agents. We…

Artificial Intelligence · Computer Science 2025-10-28 Lukas William Mayer , Sheer Karny , Jackie Ayoub , Miao Song , Danyang Tian , Ehsan Moradi-Pari , Mark Steyvers

Multi-armed bandit problems are receiving a great deal of attention because they adequately formalize the exploration-exploitation trade-offs arising in several industrially relevant applications, such as online advertisement and, more…

Machine Learning · Computer Science 2013-11-05 Nicolò Cesa-Bianchi , Claudio Gentile , Giovanni Zappella

Shared autonomy integrates user input with robot autonomy in order to control a robot and help the user to complete a task. Our work aims to improve the performance of such a human-robot team: the robot tries to guide the human towards an…

Robotics · Computer Science 2017-06-15 Stefanos Nikolaidis , Yu Xiang Zhu , David Hsu , Siddhartha Srinivasa

Adapting machine translation systems in the real world is a difficult problem. In contrast to offline training, users cannot provide the type of fine-grained feedback (such as correct translations) typically used for improving the system.…

Computation and Language · Computer Science 2020-09-03 Jason Naradowsky , Xuan Zhang , Kevin Duh