English
Related papers

Related papers: Controllable and Verifiable Tool-Use Data Synthesi…

200 papers

This paper notes a simple connection between synthetic control and online learning. Specifically, we recognize synthetic control as an instance of Follow-The-Leader (FTL). Standard results in online convex optimization then imply that, even…

Econometrics · Economics 2023-03-16 Jiafeng Chen

Recently, there have been significant research interests in training large language models (LLMs) with reinforcement learning (RL) on real-world tasks, such as multi-turn code generation. While online RL tends to perform better than offline…

Machine Learning · Computer Science 2026-02-04 Ziru Chen , Dongdong Chen , Ruinan Jin , Yingbin Liang , Yujia Xie , Huan Sun

Reinforcement learning (RL) post-training has proven effective at unlocking reasoning, self-reflection, and tool-use capabilities in large language models. As models extend to omni-modal inputs and agentic multi-turn workflows, RL training…

Computation and Language · Computer Science 2026-04-15 Liujie Zhang , Benzhe Ning , Rui Yang , Xiaoyan Yu , Jiaxing Li , Lumeng Wu , Jia Liu , Minghao Li , Weihang Chen , Weiqi Hu , Lei Zhang

With the rapid advancement of large language models (LLMs) technologies, their application in the domain of autonomous driving has become increasingly widespread. However, existing methods suffer from unstructured reasoning, poor…

Artificial Intelligence · Computer Science 2026-01-09 Chang Zhao , Zheming Yang , Yunqing Hu , Qi Guo , Zijian Wang , Pengcheng Li , Wen Ji

Reinforcement learning (RL) is often credited with improving language model reasoning and generalization at the expense of degrading memorized knowledge. We challenge this narrative by observing that RL-enhanced models consistently…

Computation and Language · Computer Science 2025-11-11 Renfei Zhang , Manasa Kaniselvan , Niloofar Mireshghallah

Agentic reinforcement learning (RL) has proven effective for training LLM-based agents with external tool-use capabilities. However, we identify that agentic RL training induces increasing redundant tool calls and blurs the model's…

Computation and Language · Computer Science 2026-05-27 Dingwei Chen , Zefang Zong , Zhipeng Ma , Leo Luo , Yang Li , Chengming Li , Peng Chen , Jie Jiang

Reinforcement learning (RL) algorithms have been successfully applied to control tasks associated with unmanned aerial vehicles and robotics. In recent years, safe RL has been proposed to allow the safe execution of RL algorithms in…

Machine Learning · Computer Science 2025-02-25 Austin Coursey , Marcos Quinones-Grueiro , Gautam Biswas

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

Machine Learning · Computer Science 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas

In this work, we present quantum reinforcement learning (RL) as a solution strategy for process synthesis problems. Building on our prior work, we develop a generalized framework that formally poses process synthesis as a Markov decision…

Quantum Physics · Physics 2026-05-21 Austin Braniff , Fengqi You , Yuhe Tian

Large Language Models (LLMs) have achieved remarkable success on reasoning benchmarks through Reinforcement Learning with Verifiable Rewards (RLVR), excelling at tasks such as math, coding, logic, and puzzles. However, existing benchmarks…

Artificial Intelligence · Computer Science 2026-05-12 Xiaozhe Li , Xinyu Fang , Shengyuan Ding , Yang Li , Linyang Li , Haodong Duan , Qingwen Liu , Kai Chen

Agentic Reinforcement Learning (RL) has empowered Large Language Models (LLMs) to utilize tools like Python interpreters for complex problem-solving. However, for parameter-constrained models (e.g., 4B--7B), the exploration phase is often…

Machine Learning · Computer Science 2026-01-22 Tianshi Xu , Yuteng Chen , Meng Li

Large language models (LLMs) often solve challenging math exercises yet fail to apply the concept right when the problem requires genuine understanding. Popular Reinforcement Learning with Verifiable Rewards (RLVR) pipelines reinforce final…

Artificial Intelligence · Computer Science 2026-05-08 Zijun Gao , Zhikun Xu , Xiao Ye , Ben Zhou

The advent of large pre-trained language models in the domain of Code Synthesis has shown remarkable performance on various benchmarks, treating the problem of Code Generation in a fashion similar to Natural Language Generation, trained…

Machine Learning · Computer Science 2023-10-23 Philip John Gorinski , Matthieu Zimmer , Gerasimos Lampouras , Derrick Goh Xin Deik , Ignacio Iacobacci

Effectively leveraging large, previously collected datasets in reinforcement learning (RL) is a key challenge for large-scale real-world applications. Offline RL algorithms promise to learn effective policies from previously-collected,…

Machine Learning · Computer Science 2020-08-20 Aviral Kumar , Aurick Zhou , George Tucker , Sergey Levine

Force control in hydraulic actuators is notoriously difficult due to strong nonlinearities, uncertainties, and the high risks associated with unsafe exploration during learning. This paper investigates safe reinforcement learning (RL) for…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Lucca Maitan , Lucas Toschi , Cícero Zanette , Elisa G. Vergamini , Leonardo F. Santos , Thiago Boaventura

Agentic reinforcement learning has advanced large language models (LLMs) to reason through long chain-of-thought trajectories while interleaving external tool use. Existing approaches assume a fixed inventory of tools, limiting LLM agents'…

Computation and Language · Computer Science 2025-12-16 Jiaru Zou , Ling Yang , Yunzhe Qi , Sirui Chen , Mengting Ai , Ke Shen , Jingrui He , Mengdi Wang

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…

We propose RLAnything, a reinforcement learning framework that dynamically forges environment, policy, and reward models through closed-loop optimization, amplifying learning signals and strengthening the overall RL system for any LLM or…

Machine Learning · Computer Science 2026-02-04 Yinjie Wang , Tianbao Xie , Ke Shen , Mengdi Wang , Ling Yang

Agentic large language models often rely on skills, reusable natural language procedures that guide planning, action, and tool use. In practice, skills are typically improved through prompt engineering or by aligning the task LLM itself,…

We propose a reinforcement learning (RL) framework for the dynamic selection of the filter parameter in Evolve-Filter (EF) regularization strategies for incompressible turbulent flows. Instead of prescribing the filter radius heuristically,…

Numerical Analysis · Mathematics 2026-03-03 Anna Ivagnes , Maria Strazzullo , Gianluigi Rozza