English
Related papers

Related papers: DSPO: Stable and Efficient Policy Optimization for…

200 papers

Recent advances in Large Language Model (LLM) agents have demonstrated their promising general capabilities. However, their performance in specialized real-world domains often degrades due to challenges in effectively integrating external…

Computation and Language · Computer Science 2025-10-10 Yuzheng Cai , Siqi Cai , Yuchen Shi , Zihan Xu , Lichao Chen , Yulei Qin , Xiaoyu Tan , Gang Li , Zongyi Li , Haojia Lin , Yong Mao , Ke Li , Xing Sun

The effective training of Large Language Models (LLMs) for function calling faces a critical challenge: balancing exploration of complex reasoning paths with stable policy optimization. Standard methods like Supervised Fine-Tuning (SFT)…

Recent Large Reasoning Models (LRMs) have achieved remarkable performance in solving complex problems via supervised fine-tuning (SFT) and reinforcement learning (RL). Although existing RL algorithms significantly enhance model accuracy,…

Artificial Intelligence · Computer Science 2025-10-20 Zezhong Tan , Hang Gao , Xinhong Ma , Feng Zhang , Ziqiang Dong

Leveraging more test-time computation has proven to be an effective way to boost the reasoning capabilities of large language models (LLMs). Among various methods, the verify-and-improve paradigm stands out for enabling dynamic solution…

Machine Learning · Computer Science 2025-06-11 Yurun Yuan , Tengyang Xie

Mathematical reasoning is a crucial capability for Large Language Models (LLMs), yet generating detailed and accurate reasoning traces remains a significant challenge. This paper introduces a novel approach to produce high-quality reasoning…

Computation and Language · Computer Science 2024-10-30 Yihe Deng , Paul Mineiro

Effective social intelligence simulation requires language agents to dynamically adjust reasoning depth, a capability notably absent in current studies. Existing methods either lack explicit reasoning or employ lengthy Chain-of-Thought…

Computation and Language · Computer Science 2026-03-04 Minzheng Wang , Yongbin Li , Haobo Wang , Xinghua Zhang , Nan Xu , Bingli Wu , Fei Huang , Haiyang Yu , Wenji Mao

Mathematical reasoning is a fundamental capability for large language models (LLMs), yet achieving high performance in this domain remains a significant challenge. The auto-regressive generation process often makes LLMs susceptible to…

Artificial Intelligence · Computer Science 2024-12-02 Xiaoxuan Lou , Chaojie Wang , Bo An

Large language models (LLMs) augmented with external tools are increasingly deployed as deep research agents that gather, reason over, and synthesize web information to answer complex queries. Although recent open-source systems achieve…

Artificial Intelligence · Computer Science 2026-02-24 Yi Wan , Jiuqi Wang , Liam Li , Jinsong Liu , Ruihao Zhu , Zheqing Zhu

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

Machine Learning · Computer Science 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

General agents have given rise to phenomenal applications such as OpenClaw and Claude Code. As these agent systems (a.k.a. Harnesses) strive for bolder goals, they demand increasingly stronger agentic capabilities from foundation Large…

Computation and Language · Computer Science 2026-04-21 Daoyu Wang , Qingchuan Li , Mingyue Cheng , Jie Ouyang , Shuo Yu , Qi Liu , Enhong Chen

Recent advances of reasoning models, exemplified by OpenAI's o1 and DeepSeek's R1, highlight the significant potential of Reinforcement Learning (RL) to enhance the reasoning capabilities of Large Language Models (LLMs). However,…

LLM agents have emerged as powerful systems for tackling multi-turn tasks by interleaving internal reasoning and external tool interactions. Agentic Reinforcement Learning has recently drawn significant research attention as a critical…

Artificial Intelligence · Computer Science 2026-01-09 Zefang Zong , Dingwei Chen , Yang Li , Qi Yi , Bo Zhou , Chengming Li , Bo Qian , Peng Chen , Jie Jiang

Reinforcement Learning has emerged as a dominant post-training approach to elicit agentic RAG behaviors such as search and planning from language models. Despite its success with larger models, applying RL to compact models (e.g., 0.5--1B…

Computation and Language · Computer Science 2026-04-28 Rikuto Kotoge , Mai Nishimura , Jiaxin Ma

Reinforcement learning (RL) has emerged as a powerful tool for fine-tuning large language models (LLMs) to improve complex reasoning abilities. However, state-of-the-art policy optimization methods often suffer from high computational…

Machine Learning · Computer Science 2025-05-28 Kianté Brantley , Mingyu Chen , Zhaolin Gao , Jason D. Lee , Wen Sun , Wenhao Zhan , Xuezhou Zhang

Post-training paradigms for Large Language Models (LLMs), primarily Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), face a fundamental dilemma: SFT provides stability (low variance) but suffers from high fitting bias, while RL…

Machine Learning · Computer Science 2026-04-13 Taojie Zhu , Dongyang Xu , Ding Zou , Sen Zhao , Qiaobo Hao , Zhiguo Yang , Yonghong He

Reasoning capabilities in large language models (LLMs) have generally advanced significantly. However, it is still challenging for existing reasoning-based LLMs to perform effective decision-making abilities in multi-agent environments, due…

Computation and Language · Computer Science 2026-04-17 Jiashuo Wang , Jiawen Duan , Jian Wang , Kaitao Song , Chunpu Xu , Johnny K. W. Ho , Fenggang Yu , Wenjie Li , Johan F. Hoorn

Direct preference optimization (DPO) is a form of reinforcement learning from human feedback (RLHF) where the policy is learned directly from preferential feedback. Although many models of human preferences exist, the critical task of…

Machine Learning · Computer Science 2025-03-04 Branislav Kveton , Xintong Li , Julian McAuley , Ryan Rossi , Jingbo Shang , Junda Wu , Tong Yu

Recently, Agentic Reinforcement Learning (Agentic RL) has made significant progress in incentivizing the multi-turn, long-horizon tool-use capabilities of web agents. While mainstream agentic RL algorithms autonomously explore…

Multimodal Large Language Models (MLLMs) are powerful at integrating diverse data, but they often struggle with complex reasoning. While Reinforcement learning (RL) can boost reasoning in LLMs, applying it to MLLMs is tricky. Common issues…

Machine Learning · Computer Science 2025-06-30 Minjie Hong , Zirun Guo , Yan Xia , Zehan Wang , Ziang Zhang , Tao Jin , Zhou Zhao

Large Language Models (LLMs) have shown impressive reasoning capabilities in well-defined problems with clear solutions, such as mathematics and coding. However, they still struggle with complex real-world scenarios like business…

Computation and Language · Computer Science 2025-05-29 Xiaoqian Liu , Ke Wang , Yongbin Li , Yuchuan Wu , Wentao Ma , Aobo Kong , Fei Huang , Jianbin Jiao , Junge Zhang