English
Related papers

Related papers: Self-Paced Context Evaluation for Contextual Reinf…

200 papers

Large Language Model (LLM) agents are increasingly deployed in complex, multi-step workflows involving planning, tool use, reflection, and interaction with external knowledge systems. These workflows generate rapidly expanding contexts that…

Artificial Intelligence · Computer Science 2025-12-22 Kamer Ali Yuksel

Robotic manipulation in unstructured environments requires reliable execution under diverse conditions, yet many state-of-the-art systems still struggle with high-dimensional action spaces, sparse rewards, and slow generalization beyond…

Robotics · Computer Science 2026-01-30 Leonidas Askianakis , Aleksandr Artemov

Reinforcement learning (RL) has become the dominant paradigm for improving the performance of language models on complex reasoning tasks. Despite the substantial empirical gains demonstrated by RL-based training methods like GRPO, a…

Artificial Intelligence · Computer Science 2025-10-27 Jiayu Wang , Yifei Ming , Zixuan Ke , Caiming Xiong , Shafiq Joty , Aws Albarghouthi , Frederic Sala

Reinforcement Learning (RL) techniques have drawn great attention in many challenging tasks, but their performance deteriorates dramatically when applied to real-world problems. Various methods, such as domain randomization, have been…

Machine Learning · Computer Science 2022-08-05 Wangyang Yue , Yuan Zhou , Xiaochuan Zhang , Yuchen Hua , Zhiyuan Wang , Guang Kou

Reinforcement Learning (RL) is an area of growing interest in the field of artificial intelligence due to its many notable applications in diverse fields. Particularly within the context of intelligent vehicle control, RL has made…

Machine Learning · Computer Science 2023-11-07 Rafael Pina , Corentin Artaud , Xiaolan Liu , Varuna De Silva

In complex tasks, such as those with large combinatorial action spaces, random exploration may be too inefficient to achieve meaningful learning progress. In this work, we use a curriculum of progressively growing action spaces to…

Machine Learning · Computer Science 2019-07-01 Gregory Farquhar , Laura Gustafson , Zeming Lin , Shimon Whiteson , Nicolas Usunier , Gabriel Synnaeve

Many reinforcement learning (RL) environments consist of independent entities that interact sparsely. In such environments, RL agents have only limited influence over other entities in any particular situation. Our idea in this work is that…

Machine Learning · Computer Science 2021-12-03 Maximilian Seitzer , Bernhard Schölkopf , Georg Martius

Large language model (LLM) applications such as agents and domain-specific reasoning increasingly rely on context adaptation: modifying inputs with instructions, strategies, or evidence, rather than weight updates. Prior approaches improve…

In-Context Reinforcement Learning (ICRL) has emerged as a promising paradigm for developing agents that can rapidly adapt to new tasks by leveraging past experiences as context, without updating their parameters. Recent approaches train…

Machine Learning · Computer Science 2025-09-30 Wenhao Zhang , Shao Zhang , Xihuai Wang , Yang Li , Ying Wen

Deep reinforcement learning (DRL) has achieved remarkable success across multiple domains, including competitive games, natural language processing, and robotics. Despite these advancements, policies trained via DRL often struggle to…

Machine Learning · Computer Science 2025-12-30 James Chapman , Kedar Karhadkar , Guido Montufar

Recent research using Reinforcement Learning (RL) to learn autonomous control for spacecraft operations has shown great success. However, a recent study showed their performance could be improved by changing the action space, i.e. control…

Machine Learning · Computer Science 2025-01-13 Nathaniel Hamilton , Kyle Dunlap , Kerianne L Hobbs

Recent advancements in long-context large language models have attracted significant attention, yet their practical applications often suffer from suboptimal context utilization. This study investigates structuring training data to enhance…

Computation and Language · Computer Science 2025-03-03 Konrad Staniszewski , Szymon Tworkowski , Sebastian Jaszczur , Yu Zhao , Henryk Michalewski , Łukasz Kuciński , Piotr Miłoś

General intelligence requires quick adaption across tasks. While existing reinforcement learning (RL) methods have made progress in generalization, they typically assume only distribution changes between source and target domains. In this…

Machine Learning · Computer Science 2025-03-07 Yupei Yang , Biwei Huang , Fan Feng , Xinyue Wang , Shikui Tu , Lei Xu

Reinforcement learning is able to solve complex sequential decision-making tasks but is currently limited by sample efficiency and required computation. To improve sample efficiency, recent work focuses on model-based RL which interleaves…

Machine Learning · Computer Science 2023-06-19 Yi Zhao , Wenshuai Zhao , Rinu Boney , Juho Kannala , Joni Pajarinen

In this paper we consider self-supervised representation learning to improve sample efficiency in reinforcement learning (RL). We propose a forward prediction objective for simultaneously learning embeddings of states and action sequences.…

Machine Learning · Computer Science 2020-01-15 William Whitney , Rajat Agarwal , Kyunghyun Cho , Abhinav Gupta

Structured state space sequence (S4) models have recently achieved state-of-the-art performance on long-range sequence modeling tasks. These models also have fast inference speeds and parallelisable training, making them potentially useful…

Machine Learning · Computer Science 2023-11-27 Chris Lu , Yannick Schroecker , Albert Gu , Emilio Parisotto , Jakob Foerster , Satinder Singh , Feryal Behbahani

Model-free Reinforcement Learning (RL) generally suffers from poor sample complexity, mostly due to the need to exhaustively explore the state-action space to find well-performing policies. On the other hand, we postulate that expert…

Machine Learning · Computer Science 2023-09-13 Loris Di Natale , Bratislav Svetozarevic , Philipp Heer , Colin N. Jones

The relationship between a reinforcement learning (RL) agent and an asynchronous environment is often ignored. Frequently used models of the interaction between an agent and its environment, such as Markov Decision Processes (MDP) or…

Artificial Intelligence · Computer Science 2018-06-29 Jaden B. Travnik , Kory W. Mathewson , Richard S. Sutton , Patrick M. Pilarski

Across machine learning, the use of curricula has shown strong empirical potential to improve learning from data by avoiding local optima of training objectives. For reinforcement learning (RL), curricula are especially interesting, as the…

Machine Learning · Computer Science 2021-09-03 Pascal Klink , Hany Abdulsamad , Boris Belousov , Carlo D'Eramo , Jan Peters , Joni Pajarinen

We study online reinforcement learning (RL) in non-stationary environments, where a time-varying exogenous context process affects the environment dynamics. Online RL is challenging in such environments due to "catastrophic forgetting"…

Machine Learning · Computer Science 2025-04-01 Pouya Hamadanian , Arash Nasr-Esfahany , Malte Schwarzkopf , Siddartha Sen , Mohammad Alizadeh