English
Related papers

Related papers: HRM-Agent: Training a recurrent reasoning model in…

200 papers

Hierarchical reinforcement learning (HRL) has seen widespread interest as an approach to tractable learning of complex modular behaviors. However, existing work either assume access to expert-constructed hierarchies, or use…

Machine Learning · Computer Science 2021-10-19 Kurtland Chua , Qi Lei , Jason D. Lee

Hindsight Experience Replay (HER) is a technique used in reinforcement learning (RL) that has proven to be very efficient for training off-policy RL-based agents to solve goal-based robotic manipulation tasks using sparse rewards. Even…

We design a simple reinforcement learning (RL) agent that implements an optimistic version of $Q$-learning and establish through regret analysis that this agent can operate with some level of competence in any environment. While we leverage…

Machine Learning · Computer Science 2021-07-13 Shi Dong , Benjamin Van Roy , Zhengyuan Zhou

Large Language Model (LLM) agents trained with reinforcement learning (RL) show great promise for solving complex, multi-step tasks. However, their performance is often crippled by "Context Explosion", where the accumulation of long text…

Computation and Language · Computer Science 2025-12-16 Xuanzhang Liu , Jianglun Feng , Zhuoran Zhuang , Junzhe Zhao , Maofei Que , Jieting Li , Dianlei Wang , Hao Tong , Ye Chen , Pan Li

Recent progress on large language models (LLMs) has enabled dialogue agents to generate highly naturalistic and plausible text. However, current LLM language generation focuses on responding accurately to questions and requests with a…

Machine Learning · Computer Science 2024-11-11 Joey Hong , Jessica Lin , Anca Dragan , Sergey Levine

Language-guided robots must be able to both ask humans questions and understand answers. Much existing work focuses only on the latter. In this paper, we go beyond instruction following and introduce a two-agent task where one agent…

Computation and Language · Computer Science 2020-10-07 Homero Roman Roman , Yonatan Bisk , Jesse Thomason , Asli Celikyilmaz , Jianfeng Gao

Recent breakthroughs in Go play and strategic games have witnessed the great potential of reinforcement learning in intelligently scheduling in uncertain environment, but some bottlenecks are also encountered when we generalize this…

Machine Learning · Computer Science 2018-12-27 Xingxing Liang , Qi Wang , Yanghe Feng , Zhong Liu , Jincai Huang

The relationship between a reinforcement learning (RL) agent and an asynchronous environment is often ignored. Frequently used models of the interaction between an agent and its environment, such as Markov Decision Processes (MDP) or…

Artificial Intelligence · Computer Science 2018-06-29 Jaden B. Travnik , Kory W. Mathewson , Richard S. Sutton , Patrick M. Pilarski

Reinforcement learning (RL) has become an increasingly active area of research in recent years. Although there are many algorithms that allow an agent to solve tasks efficiently, they often ignore the possibility that prior experience…

Artificial Intelligence · Computer Science 2020-01-07 Francisco M. Garcia , Chris Nota , Philip S. Thomas

In reinforcement learning (RL), agents often operate in partially observed and uncertain environments. Model-based RL suggests that this is best achieved by learning and exploiting a probabilistic model of the world. 'Active inference' is…

Machine Learning · Computer Science 2019-11-26 Alexander Tschantz , Manuel Baltieri , Anil. K. Seth , Christopher L. Buckley

Many potential applications of reinforcement learning in the real world involve interacting with other agents whose numbers vary over time. We propose new neural policy architectures for these multi-agent problems. In contrast to other…

Machine Learning · Computer Science 2019-06-03 Matthew A. Wright , Roberto Horowitz

We propose a novel Reinforcement Learning model for discrete environments, which is inherently interpretable and supports the discovery of deep subgoal hierarchies. In the model, an agent learns information about environment in the form of…

Artificial Intelligence · Computer Science 2022-02-16 Alexander Demin , Denis Ponomaryov

This paper explores the mechanistic interpretability of reinforcement learning (RL) agents through an analysis of a neural network trained on procedural maze environments. By dissecting the network's inner workings, we identified…

Machine Learning · Computer Science 2024-11-05 Tristan Trim , Triston Grayston

A common challenge in reinforcement learning is how to convert the agent's interactions with an environment into fast and robust learning. For instance, earlier work makes use of domain knowledge to improve existing reinforcement learning…

Machine Learning · Computer Science 2020-04-01 Yannis Flet-Berliac , Philippe Preux

Large Language Models (LLMs) have shown remarkable reasoning capabilities in mathematical and scientific tasks. To enhance complex reasoning, multi-agent systems have been proposed to harness the collective intelligence of LLM agents.…

Artificial Intelligence · Computer Science 2025-10-22 Zhenyu Bi , Meng Lu , Yang Li , Swastik Roy , Weijie Guan , Morteza Ziyadi , Xuan Wang

Agent-based models (ABMs) are simulation models used in economics to overcome some of the limitations of traditional frameworks based on general equilibrium assumptions. However, agents within an ABM follow predetermined 'bounded rational'…

Machine Learning · Computer Science 2024-10-23 Simone Brusatin , Tommaso Padoan , Andrea Coletta , Domenico Delli Gatti , Aldo Glielmo

Model-based reinforcement learning algorithms make decisions by building and utilizing a model of the environment. However, none of the existing algorithms attempts to infer the dynamics of any state-action pair from known state-action…

Machine Learning · Computer Science 2020-02-25 Yanchao Sun , Furong Huang

The advent of large language models (LLMs) has transformed information access and reasoning through open-ended natural language interaction. However, LLMs remain limited by static knowledge, factual hallucinations, and the inability to…

Artificial Intelligence · Computer Science 2025-10-29 Minhua Lin , Zongyu Wu , Zhichao Xu , Hui Liu , Xianfeng Tang , Qi He , Charu Aggarwal , Hui Liu , Xiang Zhang , Suhang Wang

Owing to recent advancements, Large Language Models (LLMs) can now be deployed as agents for increasingly complex decision-making applications in areas including robotics, gaming, and API integration. However, reflecting past experiences in…

Reinforcement learning algorithms describe how an agent can learn an optimal action policy in a sequential decision process, through repeated experience. In a given environment, the agent policy provides him some running and terminal…

Theoretical Economics · Economics 2020-03-24 Arthur Charpentier , Romuald Elie , Carl Remlinger