English
Related papers

Related papers: Warmth and competence in human-agent cooperation

200 papers

For sophisticated reinforcement learning (RL) systems to interact usefully with real-world environments, we need to communicate complex goals to these systems. In this work, we explore goals defined in terms of (non-expert) human…

Machine Learning · Statistics 2023-02-20 Paul Christiano , Jan Leike , Tom B. Brown , Miljan Martic , Shane Legg , Dario Amodei

Recent advances in reinforcement learning (RL) and Human-in-the-Loop (HitL) learning have made human-AI collaboration easier for humans to team with AI agents. Leveraging human expertise and experience with AI in intelligent systems can be…

In scenarios where a single player cannot control other players, cooperative AI is a recent technology that takes advantage of deep learning to assess whether cooperation might occur. One main difficulty of this approach is that it requires…

Multiagent Systems · Computer Science 2023-04-03 Xavier Marjou , Arnaud Braud , Gaël Fromentoux

Cooperation is a fundamental social mechanism, whose effects on human performance have been investigated in several environments. Online games are modern-days natural settings in which cooperation strongly affects human behavior. Every day,…

Social and Information Networks · Computer Science 2019-08-22 Anna Sapienza , Palash Goyal , Emilio Ferrara

The development of autonomous agents which can interact with other agents to accomplish a given task is a core area of research in artificial intelligence and machine learning. Towards this goal, the Autonomous Agents Research Group…

Human-AI collaboration is typically offered in one of two of user control levels: guidance, where the AI provides suggestions and the human makes the final decision, and delegation, where the AI acts autonomously within user-defined…

Human-Computer Interaction · Computer Science 2025-09-26 Avinash Ajit Nargund , Arthur Caetano , Kevin Yang , Rose Yiwei Liu , Philip Tezaur , Kriteen Shrestha , Qisen Pan , Tobias Höllerer , Misha Sra

In complex tasks where the reward function is not straightforward and consists of a set of objectives, multiple reinforcement learning (RL) policies that perform task adequately, but employ different strategies can be trained by adjusting…

Artificial Intelligence · Computer Science 2021-12-20 Jasmina Gajcin , Rahul Nair , Tejaswini Pedapati , Radu Marinescu , Elizabeth Daly , Ivana Dusparic

Improving our understanding of how humans perceive AI teammates is an important foundation for our general understanding of human-AI teams. Extending relevant work from cognitive science, we propose a framework based on item response theory…

Machine Learning · Computer Science 2023-05-17 Markelle Kelly , Aakriti Kumar , Padhraic Smyth , Mark Steyvers

This paper describes a research study that aims to investigate changes in effective communication during human-AI collaboration with special attention to the perception of competence among team members and varying levels of task load placed…

Human-Computer Interaction · Computer Science 2021-10-08 Andres Rosero , Faustina Dinh , Ewart J. de Visser , Tyler Shaw , Elizabeth Phillips

Reinforcement Learning from Human Feedback has recently achieved significant success in various fields, and its performance is highly related to feedback quality. While much prior work acknowledged that human teachers' characteristics would…

Robotics · Computer Science 2025-12-30 Qidi Fang , Hang Yu , Shijie Fang , Jindan Huang , Qiuyu Chen , Reuben M. Aronson , Elaine S. Short

The human-agent team, which is a problem in which humans and autonomous agents collaborate to achieve one task, is typical in human-AI collaboration. For effective collaboration, humans want to have an effective plan, but in realistic…

Artificial Intelligence · Computer Science 2021-09-02 Ryo Nakahashi , Seiji Yamada

In AI-assisted decision-making, effective hybrid (human-AI) teamwork is not solely dependent on AI performance alone, but also on its impact on human decision-making. While prior work studies the effects of model accuracy on humans, we…

Human-Computer Interaction · Computer Science 2022-02-25 Andi Peng , Besmira Nushi , Emre Kiciman , Kori Inkpen , Ece Kamar

While Machine learning gives rise to astonishing results in automated systems, it is usually at the cost of large data requirements. This makes many successful algorithms from machine learning unsuitable for human-machine interaction, where…

Human-Computer Interaction · Computer Science 2021-09-30 Jan Philip Göpfert , Ulrike Kuhl , Lukas Hindemith , Heiko Wersing , Barbara Hammer

In order perform a large variety of tasks and to achieve human-level performance in complex real-world environments, Artificial Intelligence (AI) Agents must be able to learn from their past experiences and gain both knowledge and an…

Machine Learning · Computer Science 2019-05-13 Andrei Claudiu Roibu

With the growing utility of today's conversational virtual assistants, the importance of user motivation in human-AI interaction is becoming more obvious. However, previous studies in this and related fields, such as human-computer…

Human-Computer Interaction · Computer Science 2021-05-12 Chang Li , Hideyoshi Yanagisawa

Preference-based reinforcement learning has gained prominence as a strategy for training agents in environments where the reward signal is difficult to specify or misaligned with human intent. However, its effectiveness is often limited by…

Machine Learning · Computer Science 2025-08-27 Jonathan Erskine , Taku Yamagata , Raúl Santos-Rodríguez

Over the past decades, cognitive neuroscientists and behavioral economists have recognized the value of describing the process of decision making in detail and modeling the emergence of decisions over time. For example, the time it takes to…

Neurons and Cognition · Quantitative Biology 2025-07-24 Mrugsen Nagsen Gopnarayan , Jaan Aru , Sebastian Gluth

For machine agents to successfully interact with humans in real-world settings, they will need to develop an understanding of human mental life. Intuitive psychology, the ability to reason about hidden mental variables that drive observable…

Agent-based modelling is a powerful tool when simulating human systems, yet when human behaviour cannot be described by simple rules or maximising one's own profit, we quickly reach the limits of this methodology. Machine learning has the…

Multiagent Systems · Computer Science 2022-01-21 Georg Jäger , Daniel Reisinger

As AI closely interacts with human society, it is crucial to ensure that its behavior is safe, altruistic, and aligned with human ethical and moral values. However, existing research on embedding ethical considerations into AI remains…

Artificial Intelligence · Computer Science 2025-11-07 Feifei Zhao , Hui Feng , Haibo Tong , Zhengqiang Han , Erliang Lin , Enmeng Lu , Yinqian Sun , Yi Zeng