English
Related papers

Related papers: AutoForge: Automated Environment Synthesis for Age…

200 papers

Reinforcement learning (RL) is a framework to optimize a control policy using rewards that are revealed by the system as a response to a control action. In its standard form, RL involves a single agent that uses its policy to accomplish a…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

We introduce Agent2 RL-Bench, a compact diagnostic benchmark for evaluating agentic RL post-training, which tests whether LLM agents can autonomously design, implement, debug, and execute post-training pipelines that improve foundation…

Artificial Intelligence · Computer Science 2026-05-14 Wanyi Chen , Xiao Yang , Xu Yang , Tianming Sha , Qizheng Li , Zhuo Wang , Bowen Xian , Fang Kong , Weiqing Liu , Jiang Bian

Reinforcement Learning (RL) is essential for evolving Large Language Models (LLMs) into autonomous agents capable of long-horizon planning, yet a practical recipe for scaling RL in complex, multi-turn environments remains elusive. This…

Machine Learning · Computer Science 2026-03-24 Xixi Wu , Qianguo Sun , Ruiyang Zhang , Chao Song , Junlong Wu , Yiyan Qi , Hong Cheng

Reinforcement learning (RL) is central to post-training, particularly for agentic models that require specialized reasoning behaviors. In this setting, model merging offers a practical mechanism for integrating multiple RL-trained agents…

Machine Learning · Computer Science 2026-01-21 Xiangchi Yuan , Dachuan Shi , Chunhui Zhang , Zheyuan Liu , Shenglong Yao , Soroush Vosoughi , Wenke Lee

Existing agents for solving tasks such as ML engineering rely on prompting powerful language models. As a result, these agents do not improve with more experience. In this paper, we show that agents backed by weaker models that improve via…

Machine Learning · Computer Science 2025-09-04 Sherry Yang , Joy He-Yueya , Percy Liang

In recent years, Reinforcement Learning (RL), has become a popular field of study as well as a tool for enterprises working on cutting-edge artificial intelligence research. To this end, many researchers have built RL frameworks such as…

Although Reinforcement Learning (RL) has shown to be capable of producing impressive results, its use is limited by the impact of its hyperparameters on performance. This often makes it difficult to achieve good results in practice.…

Machine Learning · Computer Science 2024-05-16 Aditya Mohan , Carolin Benjamins , Konrad Wienecke , Alexander Dockhorn , Marius Lindauer

Reinforcement learning (RL) has been demonstrated suitable to develop agents that play complex games with human-level performance. However, it is not understood how to effectively use RL to perform cybersecurity tasks. To develop such…

Cryptography and Security · Computer Science 2021-03-16 Andres Molina-Markham , Cory Miniter , Becky Powell , Ahmad Ridley

We study what actually works and what doesn't for training large language models as agents via multi-turn reinforcement learning. Despite rapid progress, existing frameworks and definitions are fragmented, and there is no systematic…

Machine Learning · Computer Science 2025-12-09 Ruiyi Wang , Prithviraj Ammanabrolu

Safe interaction with the environment is one of the most challenging aspects of Reinforcement Learning (RL) when applied to real-world problems. This is particularly important when unsafe actions have a high or irreversible negative impact…

Machine Learning · Computer Science 2021-10-22 Erik Aumayr , Saman Feghhi , Filippo Vannella , Ezeddin Al Hakim , Grigorios Iakovidis

We introduce Synthetic Environments (SEs) and Reward Networks (RNs), represented by neural networks, as proxy environment models for training Reinforcement Learning (RL) agents. We show that an agent, after being trained exclusively on the…

Machine Learning · Computer Science 2022-02-08 Fabio Ferreira , Thomas Nierhoff , Andreas Saelinger , Frank Hutter

Deep neural networks coupled with fast simulation and improved computation have led to recent successes in the field of reinforcement learning (RL). However, most current RL-based approaches fail to generalize since: (a) the gap between…

Machine Learning · Computer Science 2017-03-09 Lerrel Pinto , James Davidson , Rahul Sukthankar , Abhinav Gupta

Although the power of LLM tool-use agents has ignited a flurry of recent research in this area, the curation of tool-use training data remains an open problem$-$especially for online RL training. Existing approaches to synthetic tool-use…

Machine Learning · Computer Science 2025-09-25 Michael Sullivan , Mareike Hartmann , Alexander Koller

Deep Reinforcement Learning (or just "RL") is gaining popularity for industrial and research applications. However, it still suffers from some key limits slowing down its widespread adoption. Its performance is sensitive to initial…

Machine Learning · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

Reinforcement Learning (RL) has emerged as an efficient method of choice for solving complex sequential decision making problems in automatic control, computer science, economics, and biology. In this paper we present a model-free RL…

Logic in Computer Science · Computer Science 2019-09-13 Mohammadhosein Hasanbeig , Yiannis Kantaros , Alessandro Abate , Daniel Kroening , George J. Pappas , Insup Lee

Recent studies have uncovered the potential of Large Language Models (LLMs) in addressing complex sequential decision-making tasks through the provision of high-level instructions. However, LLM-based agents lack specialization in tackling…

Artificial Intelligence · Computer Science 2024-05-28 Zihao Zhou , Bin Hu , Chenyang Zhao , Pu Zhang , Bin Liu

Goal-directed Reinforcement Learning (RL) traditionally considers an agent interacting with an environment, prescribing a real-valued reward to an agent proportional to the completion of some goal. Goal-directed RL has seen large gains in…

Machine Learning · Computer Science 2020-10-28 Sharath Chandra Raparthy , Bhairav Mehta , Florian Golemo , Liam Paull

Reinforcement Learning (RL) bears the promise of being a game-changer in many applications. However, since most of the literature in the field is currently focused on opaque models, the use of RL in high-stakes scenarios, where…

Machine Learning · Computer Science 2025-01-22 Leonardo Lucio Custode , Giovanni Iacca

Recently, the emergence of agentic RL has showcased that RL could also effectively improve the agentic reasoning ability of LLMs, yet the key design principles and optimal practices remain unclear. In this work, we conduct a comprehensive…

Computation and Language · Computer Science 2025-10-14 Zhaochen Yu , Ling Yang , Jiaru Zou , Shuicheng Yan , Mengdi Wang

Recent progress in AI and Reinforcement learning has shown great success in solving complex problems with high dimensional state spaces. However, most of these successes have been primarily in simulated environments where failure is of…

Artificial Intelligence · Computer Science 2019-03-25 Bharat Prakash , Mohit Khatwani , Nicholas Waytowich , Tinoosh Mohsenin