English
Related papers

Related papers: HCMD-zero: Learning Value Aligned Mechanisms from …

200 papers

We introduce Unsupervised Partner Design (UPD) - a population-free, multi-agent reinforcement learning framework for robust ad-hoc teamwork that adaptively generates training partners without requiring pretrained partners or manual…

Machine Learning · Computer Science 2025-08-11 Constantin Ruhdorfer , Matteo Bortoletto , Victor Oei , Anna Penzkofer , Andreas Bulling

AI alignment is about ensuring AI systems only pursue goals and activities that are beneficial to humans. Most of the current approach to AI alignment is to learn what humans value from their behavioural data. This paper proposes a…

Artificial Intelligence · Computer Science 2023-10-06 Pei-Yu Chen , Myrthe L. Tielman , Dirk K. J. Heylen , Catholijn M. Jonker , M. Birna van Riemsdijk

A learning dialogue agent can infer its behaviour from interactions with the users. These interactions can be taken from either human-to-human or human-machine conversations. However, human interactions are scarce and costly, making…

Computation and Language · Computer Science 2020-12-10 Thibault Cordier , Tanguy Urvoy , Lina M. Rojas-Barahona , Fabrice Lefèvre

In this paper we present a fully autonomous and intrinsically motivated robot usable for HRI experiments. We argue that an intrinsically motivated approach based on the Predictive Information formalism, like the one presented here, could…

Human-Computer Interaction · Computer Science 2019-07-19 Marcus M. Scheunemann , Christoph Salge , Kerstin Dautenhahn

Large language models (LLMs) have shown promising abilities as cost-effective and reference-free evaluators for assessing language generation quality. In particular, pairwise LLM evaluators, which compare two generated texts and determine…

Computation and Language · Computer Science 2024-10-15 Han Zhou , Xingchen Wan , Yinhong Liu , Nigel Collier , Ivan Vulić , Anna Korhonen

As AI systems become embedded in everyday practice, value misalignment has emerged as a pressing concern. Yet, dominant alignment approaches remain model centric, treating users as passive recipients of prespecified values rather than as…

Human-Computer Interaction · Computer Science 2026-04-22 Anne Arzberger , Enrico Liscio , Maria Luce Lupetti , Inigo Martinez de Rituerto de Troya , Jie Yang

Federated learning is typically considered a beneficial technology which allows multiple agents to collaborate with each other, improve the accuracy of their models, and solve problems which are otherwise too data-intensive / expensive to…

Computer Science and Game Theory · Computer Science 2022-07-12 Sai Praneeth Karimireddy , Wenshuo Guo , Michael I. Jordan

Modeling interaction dynamics to generate robot trajectories that enable a robot to adapt and react to a human's actions and intentions is critical for efficient and effective collaborative Human-Robot Interactions (HRI). Learning from…

Robotics · Computer Science 2023-01-24 Vignesh Prasad , Dorothea Koert , Ruth Stock-Homburg , Jan Peters , Georgia Chalvatzaki

Multi-agent systems (MAS) leveraging the impressive capabilities of Large Language Models (LLMs) hold significant potential for tackling complex tasks. However, most current MAS depend on manually designed agent roles and communication…

Computation and Language · Computer Science 2026-03-10 Zixuan Ke , Austin Xu , Yifei Ming , Xuan-Phi Nguyen , Ryan Chin , Caiming Xiong , Shafiq Joty

Experience-driven learning has emerged as a promising paradigm for enabling agents to improve from interaction trajectories by accumulating and reusing past experience. However, existing approaches are predominantly developed in textual…

Artificial Intelligence · Computer Science 2026-05-19 Xingyu Sui , Weixiang Zhao , Yongxin Tang , Yanyan Zhao , Yang Wu , Dandan Tu , Bing Qin

Everyday we increasingly rely on machine learning models to automate and support high-stake tasks and decisions. This growing presence means that humans are now constantly interacting with machine learning-based systems, training and using…

Machine Learning · Computer Science 2026-04-21 Clara Punzi , Roberto Pellungrini , Mattia Setzu , Fosca Giannotti , Dino Pedreschi

Current large language models (LLMs) are constrained by human-derived training data and limited by a single level of abstraction that impedes definitive truth judgments. This paper introduces a novel framework in which AI models…

Prior studies report that partial driving automation can increase the cognitive demands on human drivers. This effect largely arises from human drivers' lack of transparent insight into the vehicle's intentions and decision logic, as well…

Artificial Intelligence · Computer Science 2026-05-12 Jiyao Wang , Yunbiao Wang , Yubo Jiao , Xiao Yang , Dengbo He , Sasan Jafarnejad , Luis Miranda-Moreno , Raphael Frank , Jiangbo Yu

Understanding how humans collaborate and communicate in teams is essential for improving human-agent teaming and AI-assisted decision-making. However, relying solely on data from large-scale user studies is impractical due to logistical,…

Artificially intelligent agents are increasingly being integrated into human decision-making: from large language model (LLM) assistants to autonomous vehicles. These systems often optimize their individual objective, leading to conflicts,…

Machine Learning · Computer Science 2025-02-07 Juan Agustin Duque , Milad Aghajohari , Tim Cooijmans , Razvan Ciuca , Tianyu Zhang , Gauthier Gidel , Aaron Courville

When training artificial intelligence (AI) to perform tasks, humans often care not only about whether a task is completed but also how it is performed. As AI agents tackle increasingly complex tasks, aligning their behavior with…

Artificial Intelligence · Computer Science 2026-02-24 Zhiqin Qian , Ryan Diaz , Sangwon Seo , Vaibhav Unhelkar

In AI-assisted decision-making, humans often passively review AI's suggestion and decide whether to accept or reject it as a whole. In such a paradigm, humans are found to rarely trigger analytical thinking and face difficulties in…

Human-Computer Interaction · Computer Science 2025-03-13 Shuai Ma , Qiaoyi Chen , Xinru Wang , Chengbo Zheng , Zhenhui Peng , Ming Yin , Xiaojuan Ma

Can large language model (LLM) agents reproduce the complex social dynamics that characterize human online behavior -- shaped by homophily, reciprocity, and social validation -- and what memory and learning mechanisms enable such dynamics…

Artificial Intelligence · Computer Science 2025-10-23 Philipp J. Schneider , Lin Tian , Marian-Andrei Rizoiu

In collaborative tasks, autonomous agents fall short of humans in their capability to quickly adapt to new and unfamiliar teammates. We posit that a limiting factor for zero-shot coordination is the lack of shared task abstractions, a…

Multiagent Systems · Computer Science 2025-05-08 Stéphane Aroca-Ouellette , Miguel Aroca-Ouellette , Katharina von der Wense , Alessandro Roncone

A dynamic autonomy allocation framework automatically shifts how much control lies with the human versus the robotics autonomy, for example based on factors such as environmental safety or user preference. To investigate the question of…

Robotics · Computer Science 2021-08-04 Christopher X. Miller , Temesgen Gebrekristos , Michael Young , Enid Montague , Brenna Argall