English
Related papers

Related papers: AT$^2$PO: Agentic Turn-based Policy Optimization v…

200 papers

Offline reinforcement learning methods hold the promise of learning policies from pre-collected datasets without the need to query the environment for new transitions. This setting is particularly well-suited for continuous control robotic…

Machine Learning · Computer Science 2022-03-18 Xi Chen , Ali Ghadirzadeh , Tianhe Yu , Yuan Gao , Jianhao Wang , Wenzhe Li , Bin Liang , Chelsea Finn , Chongjie Zhang

Reinforcement learning with verifiable reward has recently emerged as a central paradigm for post-training large language models (LLMs); however, prevailing mean-based methods, such as Group Relative Policy Optimization (GRPO), suffer from…

Machine Learning · Computer Science 2025-10-02 Tao Ren , Jinyang Jiang , Hui Yang , Wan Tian , Minhao Zou , Guanghao Li , Zishi Zhang , Qinghao Wang , Shentao Qin , Yanjun Zhao , Rui Tao , Hui Shao , Yijie Peng

Large language models (LLMs), optimized through human feedback, have rapidly emerged as a leading paradigm for developing intelligent conversational assistants. However, despite their strong performance across many benchmarks, LLM-based…

Computation and Language · Computer Science 2025-07-29 Maximillian Chen , Ruoxi Sun , Tomas Pfister , Sercan Ö. Arık

Automatic Prompt Optimization (APO) has emerged as a critical technique for enhancing Large Language Model (LLM) performance, yet current state-of-the-art methods typically rely on large, labeled gold-standard development sets to compute…

Tool-integrated (TI) reinforcement learning (RL) enables large language models (LLMs) to perform multi-step reasoning by interacting with external tools such as search engines and retrievers. Group Relative Policy Optimization (GRPO),…

Computation and Language · Computer Science 2026-02-03 Wenlong Deng , Yushu Li , Boying Gong , Yi Ren , Christos Thrampoulidis , Xiaoxiao Li

Reinforcement learning with verifiable rewards has shown notable effectiveness in enhancing large language models (LLMs) reasoning performance, especially in mathematics tasks. However, such improvements often come with reduced outcome…

Artificial Intelligence · Computer Science 2026-02-03 Chenyi Li , Yuan Zhang , Bo Wang , Guoqing Ma , Wei Tang , Haoyang Huang , Nan Duan

Search agents extend Large Language Models (LLMs) beyond static parametric knowledge by enabling access to up-to-date and long-tail information unavailable during pretraining. While reinforcement learning has been widely adopted for…

Machine Learning · Computer Science 2026-04-21 Junzhe Wang , Zhiheng Xi , Yajie Yang , Hao Luo , Shihan Dou , Tao Gui , Qi Zhang

Reinforcement Learning with Verifiable Rewards (RLVR) has demonstrated notable success in enhancing the reasoning performance of large language models (LLMs). However, recent studies reveal that while current RLVR methods improve sampling…

Artificial Intelligence · Computer Science 2026-05-08 Yang Xu , Kun Yao , Yiming Deng , Zheng Fang , Kai Ming Ting , Ming Pang

As autonomous systems move from prototypes to real deployments, the ability of multiple agents to make decentralized, cooperative decisions becomes a core requirement. This paper examines how agentic artificial intelligence, agents that act…

Artificial Intelligence · Computer Science 2025-10-02 Ansh Kamthan

Autonomous vehicles (AVs) need to reason about the multimodal behavior of neighboring agents while planning their own motion. Many existing trajectory planners seek a single trajectory that performs well under \emph{all} plausible futures…

Robotics · Computer Science 2023-02-28 Yuxiao Chen , Peter Karkus , Boris Ivanovic , Xinshuo Weng , Marco Pavone

Aligning large-scale vision-language models (VLMs) for complex reasoning via reinforcement learning is often hampered by the limitations of existing policy optimization algorithms, such as static training schedules and the rigid, uniform…

Artificial Intelligence · Computer Science 2025-10-02 Yunhao Wang , Ziting Li , Shuai Chen , Tao Liu , Chao Song , Junjie Jiang , Jian Zhu , Peng Gao , Bin Qin

Self-evaluation, a model's ability to assess the correctness of its own output, is crucial for Large Multimodal Models (LMMs) to achieve self-improvement in multi-turn conversations, yet largely absent in foundation models. Recent work has…

Machine Learning · Computer Science 2025-08-14 Wenkai Wang , Hongcan Guo , Zheqi Lv , Shengyu Zhang

Reinforcement learning algorithms require a large amount of samples; this often limits their real-world applications on even simple tasks. Such a challenge is more outstanding in multi-agent tasks, as each step of operation is more costly…

Machine Learning · Computer Science 2022-09-05 Yali Du , Chengdong Ma , Yuchen Liu , Runji Lin , Hao Dong , Jun Wang , Yaodong Yang

Tool-integrated reasoning (TIR) augments large language models (LLMs) with the ability to invoke external tools during long-form reasoning, such as search engines and code interpreters, to solve tasks beyond the capabilities of internal…

Artificial Intelligence · Computer Science 2025-06-03 Hongru Wang , Cheng Qian , Wanjun Zhong , Xiusi Chen , Jiahao Qiu , Shijue Huang , Bowen Jin , Mengdi Wang , Kam-Fai Wong , Heng Ji

Large Language Models (LLMs) have been used to make decisions in complex scenarios, where they need models to think deeply, reason logically, and decide wisely. Many existing studies focus solely on multi-round conversations in social tasks…

Artificial Intelligence · Computer Science 2025-09-26 Yiwen Zhang , Ziang Chen , Fanqi Kong , Yizhe Huang , Xue Feng

Large Language Models (LLMs) have become a popular interface for human-AI interaction, supporting information seeking and task assistance through natural, multi-turn dialogue. To respond to users within multi-turn dialogues, the…

Computation and Language · Computer Science 2026-04-16 Fengran Mo , Yifan Gao , Sha Li , Hansi Zeng , Xin Liu , Zhaoxuan Tan , Xian Li , Jianshu Chen , Dakuo Wang , Meng Jiang

The advancement of Text-to-SQL systems is currently hindered by the scarcity of high-quality training data and the limited reasoning capabilities of models in complex scenarios. In this paper, we propose a holistic framework that addresses…

Databases · Computer Science 2025-12-30 Cehua Yang , Dongyu Xiao , Junming Lin , Yuyang Song , Hanxu Yan , Shawn Guo , Wei Zhang , Jian Yang , Mingjie Tang , Bryan Dai

Large language models (LLMs) have demonstrated remarkable potential in solving complex tasks across diverse domains, typically by employing agentic workflows that follow detailed instructions and operational sequences. However, constructing…

We introduce Agent2 RL-Bench, a compact diagnostic benchmark for evaluating agentic RL post-training, which tests whether LLM agents can autonomously design, implement, debug, and execute post-training pipelines that improve foundation…

Artificial Intelligence · Computer Science 2026-05-14 Wanyi Chen , Xiao Yang , Xu Yang , Tianming Sha , Qizheng Li , Zhuo Wang , Bowen Xian , Fang Kong , Weiqing Liu , Jiang Bian

Multi-agent reinforcement learning (MARL) requires coordinated and stable policy updates among interacting agents. Heterogeneous-Agent Trust Region Policy Optimization (HATRPO) enforces per-agent trust region constraints using…

Artificial Intelligence · Computer Science 2025-08-15 Chak Lam Shek , Guangyao Shi , Pratap Tokekar