English
Related papers

Related papers: Interaction Dynamics as a Reward Signal for LLMs

200 papers

Reward design plays a pivotal role in aligning large language models (LLMs) with human values, serving as the bridge between feedback signals and model optimization. This survey provides a structured organization of reward modeling and…

Computation and Language · Computer Science 2025-09-03 Miaomiao Ji , Yanqiu Wu , Zhibin Wu , Shoujin Wang , Jian Yang , Mark Dras , Usman Naseem

Achieving seamless, human-like interaction remains a key challenge for full-duplex spoken dialogue models (SDMs). Reinforcement learning (RL) has substantially enhanced text- and vision-language models, while well-designed reward signals…

Artificial Intelligence · Computer Science 2026-04-17 Yifu Chen , Shengpeng Ji , Zhengqing Liu , Qian Chen , Wen Wang , Ziqing Wang , Yangzhuo Li , Tianle Liang , Zhou Zhao

To improve user engagement during conversations with dialogue systems, we must improve individual dialogue responses and dialogue impressions such as consistency, personality, and empathy throughout the entire dialogue. While such dialogue…

Computation and Language · Computer Science 2025-01-28 Kai Yoshida , Masahiro Mizukami , Seiya Kawano , Canasai Kruengkrai , Hiroaki Sugiyama , Koichiro Yoshino

Self-evolution is a central research topic in enabling large language model (LLM)-based agents to continually improve their capabilities after pretraining. Recent research has witnessed a transition from reinforcement learning (RL)-free to…

Computation and Language · Computer Science 2026-02-10 Xiangyuan Xue , Yifan Zhou , Guibin Zhang , Zaibin Zhang , Yijiang Li , Chen Zhang , Zhenfei Yin , Philip Torr , Wanli Ouyang , Lei Bai

We propose a large language model based reward decomposition framework for aligning dialogue agents using only a single session-level feedback signal. We leverage the reasoning capabilities of a frozen, pretrained large language model (LLM)…

Computation and Language · Computer Science 2026-02-12 Dong Won Lee , Hae Won Park , Cynthia Breazeal , Louis-Philippe Morency

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

Computation and Language · Computer Science 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

While a multi-agent approach based on large language models (LLMs) represents a promising strategy to surpass the capabilities of single models, its success is critically dependent on synergistic team composition. However, forming optimal…

Computation and Language · Computer Science 2026-03-20 Kotaro Furuya , Yuichi Kitagawa

Can large language model (LLM) agents reproduce the complex social dynamics that characterize human online behavior -- shaped by homophily, reciprocity, and social validation -- and what memory and learning mechanisms enable such dynamics…

Artificial Intelligence · Computer Science 2025-10-23 Philipp J. Schneider , Lin Tian , Marian-Andrei Rizoiu

Large language models (LLMs) are increasingly used as conversational partners for learning, yet the interactional dynamics supporting users' learning and engagement are understudied. We analyze the linguistic and interactional features from…

Computation and Language · Computer Science 2026-03-13 Shaz Furniturewala , Gerard Christopher Yeo , Kokil Jaidka

Large Language Models are typically trained with next-turn rewards, limiting their ability to optimize for long-term interaction. As a result, they often respond passively to ambiguous or open-ended user requests, failing to help users…

Artificial Intelligence · Computer Science 2025-07-31 Shirley Wu , Michel Galley , Baolin Peng , Hao Cheng , Gavin Li , Yao Dou , Weixin Cai , James Zou , Jure Leskovec , Jianfeng Gao

Conversational human-likeness plays a central role in human-AI interaction, yet it has remained difficult to define, measure, and optimize. As a result, improvements in human-like behavior are largely driven by scale or broad supervised…

Artificial Intelligence · Computer Science 2026-01-08 Masum Hasan , Junjie Zhao , Ehsan Hoque

Dialogue systems have long supported learner reflections, with theoretically grounded, rule-based designs offering structured scaffolding but often struggling to respond to shifts in engagement. Large Language Models (LLMs), in contrast,…

Learning suitable and well-performing dialogue behaviour in statistical spoken dialogue systems has been in the focus of research for many years. While most work which is based on reinforcement learning employs an objective measure like…

Computation and Language · Computer Science 2020-01-22 Stefan Ultes

For task-oriented dialog systems, training a Reinforcement Learning (RL) based Dialog Management module suffers from low sample efficiency and slow convergence speed due to the sparse rewards in RL.To solve this problem, many strategies…

Computation and Language · Computer Science 2021-04-13 Zhengxu Hou , Bang Liu , Ruihui Zhao , Zijing Ou , Yafei Liu , Xi Chen , Yefeng Zheng

Human communication depends on implicit social signals where effectiveness is shaped by tone, context, and conversational norms rather than semantic content alone. We introduce KARMA (Karma-Aligned Reward Model Adaptation), a framework for…

Computation and Language · Computer Science 2026-05-27 Jared Scott , Jesse Roberts

Predicting the near-term behavior of a reactive agent is crucial in many robotic scenarios, yet remains challenging when observations of that agent are sparse or intermittent. Vision-Language Models (VLMs) offer a promising avenue by…

As Large Language Models (LLMs) evolve into interactive agents, understanding their behavioral alignment within human social dynamics becomes essential. While behavioral game theory offers a framework to study these interactions, previous…

Multiagent Systems · Computer Science 2026-05-26 Inseo Jung , Yoonseok Oh , Kyungryul Back , Jinkyu Kim , Jungbeom Lee

Effective conversational agents like large language models (LLMs) must personalize their interactions to adapt to user preferences, personalities, and attributes across diverse domains like education and healthcare. Current methods like…

Computation and Language · Computer Science 2025-10-03 Yanming Wan , Jiaxing Wu , Marwa Abdulhai , Lior Shani , Natasha Jaques

Reinforcement learning systems rely on environment interfaces that specify observations and reward functions, yet constructing these interfaces for new tasks often requires substantial manual effort. While recent work has automated reward…

Machine Learning · Computer Science 2026-05-06 Akshat Singh Jaswal , Ashish Baghel , Paras Chopra

As large language model (LLM) agents evolve from isolated tool users into coordinated teams, reinforcement learning (RL) must optimize not only individual actions but also how work is spawned, delegated, communicated, aggregated, and…

Computation and Language · Computer Science 2026-05-05 Chenchen Zhang
‹ Prev 1 2 3 10 Next ›