English
Related papers

Related papers: Reinforcement Learning for Long-Horizon Multi-Turn…

200 papers

In the era of Large Language Models (LLMs), alignment has emerged as a fundamental yet challenging problem in the pursuit of more reliable, controllable, and capable machine intelligence. The recent success of reasoning models and…

Machine Learning · Computer Science 2025-07-18 Hao Sun , Mihaela van der Schaar

In complex multi-agent environments, achieving efficient learning and desirable behaviours is a significant challenge for Multi-Agent Reinforcement Learning (MARL) systems. This work explores the potential of combining MARL with Large…

Multiagent Systems · Computer Science 2026-02-12 Philipp D. Siedler , Ian Gemp

We show that iterative deployment of large language models (LLMs), each fine-tuned on data carefully curated by users from the previous models' deployment, can significantly change the properties of the resultant models. By testing this…

Artificial Intelligence · Computer Science 2026-01-01 Augusto B. Corrêa , Yoav Gelberg , Luckeciano C. Melo , Ilia Shumailov , André G. Pereira , Yarin Gal

Applying Reinforcement learning (RL) following maximum likelihood estimation (MLE) pre-training is a versatile method for enhancing neural machine translation (NMT) performance. However, recent work has argued that the gains produced by RL…

Computation and Language · Computer Science 2022-10-07 Asaf Yehudai , Leshem Choshen , Lior Fox , Omri Abend

A central goal of cognitive modeling is to develop models that not only predict human behavior but also provide insight into the underlying cognitive mechanisms. While neural network models trained on large-scale behavioral data often…

Artificial Intelligence · Computer Science 2026-02-03 Jian-Qiao Zhu , Hanbo Xie , Dilip Arumugam , Robert C. Wilson , Thomas L. Griffiths

While large language models (LLMs) have advanced the development of general-purpose agents, achieving robust generalization to unseen tasks remains a significant challenge. Current approaches typically rely on either fine-tuning or…

Artificial Intelligence · Computer Science 2026-03-20 Thomas Palmeira Ferraz , Romain Deffayet , Vassilina Nikoulina , Hervé Déjean , Stéphane Clinchant

Recent advances in reasoning capabilities of large language models (LLMs) are largely driven by reinforcement learning (RL), yet the underlying parameter dynamics during RL training remain poorly understood. This work identifies two…

Machine Learning · Computer Science 2026-02-24 Yuchen Cai , Ding Cao , Xin Xu , Zijun Yao , Yuqing Huang , Zhenyu Tan , Benyi Zhang , Guangzhong Sun , Guiquan Liu , Junfeng Fang

The advancement of large language model (LLM) based agents has shifted AI evaluation from single-turn response assessment to multi-step task completion in interactive environments. We present an empirical study evaluating frontier AI models…

Artificial Intelligence · Computer Science 2026-01-15 Logan Ritchie , Sushant Mehta , Nick Heiner , Mason Yu , Edwin Chen

Bus holding control is a widely-adopted strategy for maintaining stability and improving the operational efficiency of bus systems. Traditional model-based methods often face challenges with the low accuracy of bus state prediction and…

Artificial Intelligence · Computer Science 2025-04-15 Jiajie Yu , Yuhong Wang , Wei Ma

The inherent uncertainty in the environmental transition model of Reinforcement Learning (RL) necessitates a delicate balance between exploration and exploitation. This balance is crucial for optimizing computational resources to accurately…

Machine Learning · Computer Science 2025-05-21 Yongxin Deng , Xihe Qiu , Jue Chen , Xiaoyu Tan

Reinforcement fine-tuning (RFT) has shown promise for training LLM agents to perform multi-turn decision-making based on environment feedback. However, most existing evaluations remain largely in-domain: training and testing are conducted…

Recent works successfully leveraged Large Language Models' (LLM) abilities to capture abstract knowledge about world's physics to solve decision-making problems. Yet, the alignment between LLMs' knowledge and the environment can be wrong…

Machine Learning · Computer Science 2026-02-02 Thomas Carta , Clément Romac , Thomas Wolf , Sylvain Lamprier , Olivier Sigaud , Pierre-Yves Oudeyer

Real-world sequential decision making is characterized by sparse rewards and large decision spaces, posing significant difficulty for experiential learning systems like $\textit{tabula rasa}$ reinforcement learning (RL) agents. Large…

Computation and Language · Computer Science 2024-03-06 Hitesh Golchha , Sahil Yerawar , Dhruvesh Patel , Soham Dan , Keerthiram Murugesan

Reinforcement Learning (RL) plays a crucial role in advancing autonomous driving technologies by maximizing reward functions to achieve the optimal policy. However, crafting these reward functions has been a complex, manual process in many…

Artificial Intelligence · Computer Science 2024-06-18 Xu Han , Qiannan Yang , Xianda Chen , Xiaowen Chu , Meixin Zhu

Recent research looks to harness the general knowledge and reasoning of large language models (LLMs) into agents that accomplish user-specified goals in interactive environments. Vision-language models (VLMs) extend LLMs to multi-modal data…

Machine Learning · Computer Science 2025-05-07 Jake Grigsby , Yuke Zhu , Michael Ryoo , Juan Carlos Niebles

Enhancing future wireless networks presents a significant challenge for networking systems due to diverse user demands and the emergence of 6G technology. While reinforcement learning (RL) is a powerful framework, it often encounters…

Networking and Internet Architecture · Computer Science 2026-02-17 Jie Zheng , Ruichen Zhang , Dusit Niyato , Haijun Zhang , Jiacheng Wang , Hongyang Du , Jiawen Kang , Zehui Xiong

Reinforcement learning (RL) has achieved remarkable success in fields like robotics and autonomous driving, but adversarial attacks designed to mislead RL systems remain challenging. Existing approaches often rely on modifying the…

Machine Learning · Computer Science 2025-07-25 Junyong Jiang , Buwei Tian , Chenxing Xu , Songze Li , Lu Dong

Models and games are simplified representations of the world. There are many different kinds of models, all differing in complexity and which aspect of the world they allow us to further our understanding of. In this paper we focus on a…

Artificial Intelligence · Computer Science 2022-04-07 Joseph Christian G. Noel

Large Language Models (LLMs) can serve as world models to enhance agent decision-making in digital environments by simulating future states and predicting action outcomes, potentially eliminating costly trial-and-error exploration. However,…

Computation and Language · Computer Science 2026-03-10 Kai Mei , Jiang Guo , Shuaichen Chang , Mingwen Dong , Dongkyu Lee , Xing Niu , Jiarong Jiang

Agentic reinforcement learning (RL) for Large Language Models (LLMs) critically depends on the exploration capability of the base policy, as training signals emerge only within its in-capability region. For tasks where the base policy…

Computation and Language · Computer Science 2026-05-13 Yuxiang Ji , Zengbin Wang , Yong Wang , Shidong Yang , Ziyu Ma , Guanhua Chen , Zonghua Sun , Liaoni Wu , Xiangxiang Chu