English
Related papers

Related papers: Flexible Agent Alignment with Goal Inference from …

200 papers

User simulators serve as the critical interactive environment for agent post-training, and an ideal user simulator generalizes across domains and proactively engages in negotiation by challenging or bargaining. However, current methods…

Computation and Language · Computer Science 2026-01-15 Feng Zhang , Shijia Li , Chunmao Zhang , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He , Jingwen Xu , Han Liu

As large language models (LLMs) become integral to intelligent user interfaces (IUIs), their role as decision-making agents raises critical concerns about alignment. Although extensive research has addressed issues such as factuality, bias,…

Artificial Intelligence · Computer Science 2025-04-23 Anna Karnysheva , Christian Drescher , Dietrich Klakow

We explore the idea of aligning an AI assistant by inverting a model of users' (unknown) preferences from observed interactions. To validate our proposal, we run proof-of-concept simulations in the economic ultimatum game, formalizing user…

Computation and Language · Computer Science 2023-12-05 Jan-Philipp Fränken , Sam Kwok , Peixuan Ye , Kanishk Gandhi , Dilip Arumugam , Jared Moore , Alex Tamkin , Tobias Gerstenberg , Noah D. Goodman

The rapid rise of large language models (LLMs) has shifted artificial intelligence (AI) research toward agentic systems, motivating the use of weaker and more flexible notions of agency. However, this shift raises key questions about the…

Artificial Intelligence · Computer Science 2025-10-27 Vince Trencsenyi , Agnieszka Mensfelt , Kostas Stathis

Mathematical models of interactions among rational agents have long been studied in game theory. However these interactions are often over a small set of discrete game actions which is very different from how humans communicate in natural…

Computation and Language · Computer Science 2024-12-17 Ian Gemp , Roma Patel , Yoram Bachrach , Marc Lanctot , Vibhavari Dasagi , Luke Marris , Georgios Piliouras , Siqi Liu , Karl Tuyls

Object manipulation for rearrangement into a specific goal state is a significant task for collaborative robots. Accurately determining object placement is a key challenge, as misalignment can increase task complexity and the risk of…

Robotics · Computer Science 2025-03-06 Guanqun Cao , Ryan Mckenna , Erich Graf , John Oyekan

This research examines the use of Reinforcement Learning from AI Feedback (RLAIF) techniques to improve healthcare dialogue models, with the aim of tackling the challenges of preference-aligned data annotation while reducing the reliance on…

Computation and Language · Computer Science 2024-10-08 Chengfeng Dou , Ying Zhang , Zhi Jin , Wenpin Jiao , Haiyan Zhao , Yongqiang Zhao , Zhengwei Tao

Decision-making agents based on pre-trained Large Language Models (LLMs) are increasingly being deployed across various domains of human activity. While their applications are currently rather specialized, several research efforts are…

Machine Learning · Computer Science 2025-05-13 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

The success of AI assistants based on language models (LLMs) hinges crucially on Reinforcement Learning from Human Feedback (RLHF), which enables the generation of responses more aligned with human preferences. As universal AI assistants,…

Machine Learning · Computer Science 2023-12-27 Rui Zheng , Wei Shen , Yuan Hua , Wenbin Lai , Shihan Dou , Yuhao Zhou , Zhiheng Xi , Xiao Wang , Haoran Huang , Tao Gui , Qi Zhang , Xuanjing Huang

Traditionally, offline datasets have been used to evaluate task-oriented dialogue (TOD) models. These datasets lack context awareness, making them suboptimal benchmarks for conversational systems. In contrast, user-agents, which are…

Computation and Language · Computer Science 2024-11-18 Taaha Kazi , Ruiliang Lyu , Sizhe Zhou , Dilek Hakkani-Tur , Gokhan Tur

Bargaining, a critical aspect of real-world interactions, presents challenges for large language models (LLMs) due to limitations in strategic depth and adaptation to complex human factors. Existing benchmarks often fail to capture this…

Machine Learning · Computer Science 2025-07-15 Jihwan Oh

As large language models (LLMs) demonstrate increasingly advanced capabilities, aligning their behaviors with human values and preferences becomes crucial for their wide adoption. While previous research focuses on general alignment to…

Computation and Language · Computer Science 2024-12-17 Shujin Wu , May Fung , Cheng Qian , Jeonghwan Kim , Dilek Hakkani-Tur , Heng Ji

The growing popularity of social deduction games has created an increasing need for intelligent frameworks where humans can collaborate with AI agents, particularly in post-pandemic contexts with heightened psychological and social…

Computation and Language · Computer Science 2025-08-12 Qihui Fan , Wenbo Li , Enfu Nan , Yixiao Chen , Lei Lu , Pu Zhao , Yanzhi Wang

Collaboration is an integral part of human dialogue. Typical task-oriented dialogue games assign asymmetric roles to the participants, which limits their ability to elicit naturalistic role-taking in collaboration and its negotiation. We…

Computation and Language · Computer Science 2025-05-22 Isidora Jeknić , David Schlangen , Alexander Koller

Ideal or real - that is the question.In this work, we explore whether principles from game theory can be effectively applied to the evaluation of large language models (LLMs). This inquiry is motivated by the growing inadequacy of…

Computation and Language · Computer Science 2026-04-07 Gao Yang , Yuhang Liu , Siyu Miao , Xinyue Liang , Zhengyang Liu , Heyan Huang

As AI agents become increasingly capable of tool use and long-horizon tasks, they have begun to be deployed in settings where multiple agents can interact. However, whereas prior work has mostly focused on human-AI interactions, there is an…

Artificial Intelligence · Computer Science 2025-08-27 Olivia Long , Carter Teplica

Open-domain dialogue systems have seen remarkable advancements with the development of large language models (LLMs). Nonetheless, most existing dialogue systems predominantly focus on brief single-session interactions, neglecting the…

Computation and Language · Computer Science 2025-02-14 Hao Li , Chenghao Yang , An Zhang , Yang Deng , Xiang Wang , Tat-Seng Chua

Goal-directed interactive agents, which autonomously complete tasks through interactions with their environment, can assist humans in various domains of their daily lives. Recent advances in large language models (LLMs) led to a surge of…

Computation and Language · Computer Science 2024-09-30 Mareike Hartmann , Alexander Koller

Recent advancements in large language models (LLMs) focus on aligning to heterogeneous human expectations and values via multi-objective preference alignment. However, existing methods are dependent on the policy model parameters, which…

Computation and Language · Computer Science 2025-07-22 Kailai Yang , Zhiwei Liu , Qianqian Xie , Jimin Huang , Tianlin Zhang , Sophia Ananiadou

Effective communication between humans and intelligent agents has promising applications for solving complex problems. One such approach is visual dialogue, which leverages multimodal context to assist humans. However, real-world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Ryosuke Oshima , Seitaro Shinagawa , Hideki Tsunashima , Qi Feng , Shigeo Morishima