English
Related papers

Related papers: Agentic Reinforcement Learning for Real-World Code…

200 papers

Language model (LM) agents have gained significant attention for their ability to autonomously complete tasks through interactions with environments, tools, and APIs. LM agents are primarily built with prompt engineering or supervised…

Artificial Intelligence · Computer Science 2025-07-22 Renxi Wang , Rifo Ahmad Genadi , Bilal El Bouardi , Yongxin Wang , Fajri Koto , Zhengzhong Liu , Timothy Baldwin , Haonan Li

Reinforcement learning (RL) for large language models is an energy-intensive endeavor: training can be unstable, and the policy may gradually drift away from its pretrained weights. We present \emph{RLEP}\, -- \,Reinforcement Learning with…

Computation and Language · Computer Science 2025-07-11 Hongzhi Zhang , Jia Fu , Jingyuan Zhang , Kai Fu , Qi Wang , Fuzheng Zhang , Guorui Zhou

This paper introduces a framework that integrates reinforcement learning (RL) with autonomous agents to enable continuous improvement in the automated process of software test cases authoring from business requirement documents within…

Software Engineering · Computer Science 2025-12-09 Mohanakrishnan Hariharan

Reinforcement learning with AI feedback (RLAIF) is a popular paradigm for improving the instruction-following abilities of powerful pre-trained language models. RLAIF first performs supervised fine-tuning (SFT) using demonstrations from a…

Machine Learning · Computer Science 2024-02-20 Archit Sharma , Sedrick Keh , Eric Mitchell , Chelsea Finn , Kushal Arora , Thomas Kollar

Automatic code generation has been a longstanding research topic. With the advancement of general-purpose large language models (LLMs), the ability to code stands out as one important measure to the model's reasoning performance. Usually, a…

Software Engineering · Computer Science 2024-12-18 Jie Chen , Xintian Han , Yu Ma , Xun Zhou , Liang Xiang

Offline reinforcement learning (RL) can be used to improve future performance by leveraging historical data. There exist many different algorithms for offline RL, and it is well recognized that these algorithms, and their hyperparameter…

Machine Learning · Computer Science 2023-01-18 Allen Nie , Yannis Flet-Berliac , Deon R. Jordan , William Steenbergen , Emma Brunskill

Building a search relevance model that achieves both low latency and high performance is a long-standing challenge in the search industry. To satisfy the millisecond-level response requirements of online systems while retaining the…

Machine Learning · Computer Science 2026-02-11 Shijie Zhang , Xiang Guo , Rujun Guo , Shaoyu Liu , Xiaozhao Wang , Guanjun Jiang , Kevin Zhang

Recent advances in large language model (LLM) have empowered autonomous agents to perform multi-turn interactions with tools and environments. However, scaling such agent training is limited by the lack of diverse and reliable environments.…

Artificial Intelligence · Computer Science 2026-05-26 Zhaoyang Wang , Canwen Xu , Boyi Liu , Yite Wang , Siwei Han , Zhewei Yao , Huaxiu Yao , Yuxiong He

In a recent study, Reinforcement Learning (RL) used in combination with many-objective search, has been shown to outperform alternative techniques (random search and many-objective search) for online testing of Deep Neural Network-enabled…

Software Engineering · Computer Science 2024-03-21 Luca Giamattei , Matteo Biagiola , Roberto Pietrantuono , Stefano Russo , Paolo Tonella

Large Language Models (LLMs) have achieved remarkable success through imitation learning on vast text corpora, but this paradigm creates a training-generation gap and limits robust reasoning. Reinforcement learning (RL) offers a more…

Computation and Language · Computer Science 2026-04-13 Zhepeng Cen , Haolin Chen , Shiyu Wang , Zuxin Liu , Zhiwei Liu , Jielin Qiu , Ding Zhao , Silvio Savarese , Caiming Xiong , Huan Wang , Weiran Yao

This paper demonstrates the integration of Reinforcement Learning (RL) into quantum transpiling workflows, significantly enhancing the synthesis and routing of quantum circuits. By employing RL, we achieve near-optimal synthesis of Linear…

Quantum Physics · Physics 2025-02-27 David Kremer , Victor Villar , Hanhee Paik , Ivan Duran , Ismael Faro , Juan Cruz-Benito

Deep research systems, agentic AI that solve complex, multi-step tasks by coordinating reasoning, search across the open web and user files, and tool use, are moving toward hierarchical deployments with a Planner, Coordinator, and…

Artificial Intelligence · Computer Science 2025-11-06 Wenjun Li , Zhi Chen , Jingru Lin , Hannan Cao , Wei Han , Sheng Liang , Zhi Zhang , Kuicai Dong , Dexun Li , Chen Zhang , Yong Liu

Reinforcement learning (RL) is a goal-oriented learning solution that has proven to be successful for Neural Architecture Search (NAS) on the CIFAR and ImageNet datasets. However, a limitation of this approach is its high computational…

Neural and Evolutionary Computing · Computer Science 2019-12-04 J. Gomez Robles , J. Vanschoren

Large Language Model (LLM) agents show great promise for complex, multi-turn tool-use tasks, but their development is often hampered by the extreme scarcity of high-quality training data. Supervised fine-tuning (SFT) on synthetic data leads…

Artificial Intelligence · Computer Science 2026-02-02 Siyuan Lu , Zechuan Wang , Hongxuan Zhang , Qintong Wu , Leilei Gan , Chenyi Zhuang , Jinjie Gu , Tao Lin

Post-training methods, especially Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), play an important role in improving large language models' (LLMs) complex reasoning abilities. However, the dominant two-stage pipeline (SFT…

Machine Learning · Computer Science 2025-12-22 Mingyu Su , Jian Guan , Yuxian Gu , Minlie Huang , Hongning Wang

Agentic reinforcement learning (RL) trains large language models to autonomously call tools during reasoning, with search as the most common application. These models excel at multi-step reasoning tasks, but their safety properties are not…

Computation and Language · Computer Science 2025-10-21 Yushi Yang , Shreyansh Padarha , Andrew Lee , Adam Mahdi

Software engineering agents (SWE) are improving rapidly, with recent gains largely driven by reinforcement learning (RL). However, RL training is constrained by the scarcity of large-scale task collections with reproducible execution…

Software Engineering · Computer Science 2026-03-02 Ibragim Badertdinov , Maksim Nekrashevich , Anton Shevtsov , Alexander Golubev

LLM agents excel in compact environments requiring deep reasoning but remain brittle when operating in broader, more complex contexts that demand robustness across diverse tools and schemas. Building bespoke environments for training is…

Artificial Intelligence · Computer Science 2025-11-04 Yuetai Li , Huseyin A Inan , Xiang Yue , Wei-Ning Chen , Lukas Wutschitz , Janardhan Kulkarni , Radha Poovendran , Robert Sim , Saravan Rajmohan

End-to-end models for autonomous driving hold the promise of learning complex behaviors directly from sensor data, but face critical challenges in safety and handling long-tail events. Reinforcement Learning (RL) offers a promising path to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tianyi Yan , Tao Tang , Xingtai Gui , Yongkang Li , Jiasen Zhesng , Weiyao Huang , Lingdong Kong , Wencheng Han , Xia Zhou , Xueyang Zhang , Yifei Zhan , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu