English
Related papers

Related papers: SimpleTIR: End-to-End Reinforcement Learning for M…

200 papers

In recent years, general-purpose large language models (LLMs) such as GPT, Gemini, Claude, and DeepSeek have advanced at an unprecedented pace. Despite these achievements, their application to finance remains challenging, due to fragmented…

Large reasoning models (LRMs) excel on complex problems but face a critical barrier to efficiency: reinforcement learning (RL) training requires long rollouts for outcome-based rewards, where autoregressive decoding dominates time and…

Machine Learning · Computer Science 2026-02-20 Zeliang Zhang , Xiaodong Liu , Hao Cheng , Hao Sun , Chenliang Xu , Jianfeng Gao

Reinforcement learning (RL) has been widely used in decision-making and control tasks, but the risk is very high for the agent in the training process due to the requirements of interaction with the environment, which seriously limits its…

Machine Learning · Computer Science 2024-09-13 Xuemin Hu , Pan Chen , Yijun Wen , Bo Tang , Long Chen

Large language models (LLMs) excel in complex tasks through advanced prompting techniques like Chain-of-Thought (CoT) and Tree-of-Thought (ToT), but their reliance on manually crafted, task-specific prompts limits adaptability and…

Computation and Language · Computer Science 2025-07-04 Tao Xiong , Xavier Hu , Wenyan Fan , Shengyu Zhang

The emergence of Large Language Models (LLMs) with strong reasoning capabilities marks a significant milestone, unlocking new frontiers in complex problem-solving. However, training these reasoning models, typically using Reinforcement…

Machine Learning · Computer Science 2026-03-23 Qinghao Hu , Shang Yang , Junxian Guo , Xiaozhe Yao , Yujun Lin , Yuxian Gu , Han Cai , Chuang Gan , Ana Klimovic , Song Han

Reasoning-oriented large language models (RLMs) achieve strong gains on tasks such as mathematics and coding by generating explicit intermediate reasoning. However, their impact on machine translation (MT) remains underexplored. We…

Computation and Language · Computer Science 2026-02-17 Sara Rajaee , Sebastian Vincent , Alexandre Berard , Marzieh Fadaee , Kelly Marchisio , Tom Kocmi

Search-augmented large language models (LLMs) trained with reinforcement learning (RL) have achieved strong results on open-domain question answering (QA), but training still remains a significant challenge. The optimization is often…

Computation and Language · Computer Science 2026-03-25 Yutao Xie , Nathaniel Thomas , Nicklas Hansen , Yang Fu , Li Erran Li , Xiaolong Wang

The ability to generate diverse solutions to a given problem is a hallmark of human creativity. This divergent reasoning is also crucial for machines, enhancing their robustness and enabling them to assist humans in many applications such…

Artificial Intelligence · Computer Science 2025-05-28 Fangxu Yu , Lai Jiang , Haoqiang Kang , Shibo Hao , Lianhui Qin

Recent advances in reinforcement learning (RL) have substantially improved the training of large-scale language models, leading to significant gains in generation quality and reasoning ability. However, most existing research focuses on…

Machine Learning · Computer Science 2026-01-13 Di Zhang , Xun Wu , Shaohan Huang , Lingjie Jiang , Yaru Hao , Li Dong , Zewen Chi , Zhifang Sui , Furu Wei

Accurate multi-turn intent classification is essential for advancing conversational AI systems. However, challenges such as the scarcity of comprehensive datasets and the complexity of contextual dependencies across dialogue turns hinder…

Computation and Language · Computer Science 2024-11-20 Junhua Liu , Yong Keat Tan , Bin Fu , Kwan Hui Lim

Large language models (LLMs) excel at complex tasks thanks to advances in their reasoning abilities. However, existing methods overlook the trade-off between reasoning effectiveness and efficiency, often encouraging unnecessarily long…

Machine Learning · Computer Science 2025-10-16 Jingyao Wang , Wenwen Qiang , Zeen Song , Changwen Zheng , Hui Xiong

Reinforcement Learning with Verifiable Rewards (RLVR) has become an effective post-training method for improving the reasoning abilities of Large Language Models (LLMs). However, existing methods mainly apply uniform optimization…

Computation and Language · Computer Science 2026-05-18 Jiakang Wang , Runze Liu , Fuzheng Zhang , Xiu Li , Guorui Zhou , Ling Pan

Large Reasoning Models (LRMs) have achieved remarkable success on reasoning-intensive tasks such as mathematics and programming. However, their enhanced reasoning capabilities do not necessarily translate to improved safety performance-and…

Computation and Language · Computer Science 2026-04-21 Zhexin Zhang , Xian Qi Loye , Victor Shea-Jay Huang , Junxiao Yang , Qi Zhu , Shiyao Cui , Fei Mi , Lifeng Shang , Yingkang Wang , Hongning Wang , Minlie Huang

Reinforcement learning (RL) plays a central role in improving the reasoning and alignment of large language models, yet its efficiency critically depends on how training data are selected. Existing online selection strategies predominantly…

Machine Learning · Computer Science 2026-03-03 Xinyu Zhou , Boyu Zhu , Haotian Zhang , Huiming Wang , Zhijiang Guo

Large Language Models (LLMs) have demonstrated remarkable capabilities in knowledge acquisition, reasoning, and tool use, making them promising candidates for autonomous agent applications. However, training LLM agents for complex…

Machine Learning · Computer Science 2025-12-09 Hanjiang Hu , Changliu Liu , Na Li , Yebin Wang

Large language models (LLMs) provide excellent text-generation capabilities, but standard prompting and generation methods generally do not lead to intentional or goal-directed agents and might necessitate considerable prompt tuning. This…

Computation and Language · Computer Science 2023-12-01 Marwa Abdulhai , Isadora White , Charlie Snell , Charles Sun , Joey Hong , Yuexiang Zhai , Kelvin Xu , Sergey Levine

Large Language Models (LLMs) have recently achieved remarkable progress by leveraging Reinforcement Learning and extended Chain-of-Thought (CoT) techniques. However, the challenge of performing efficient language reasoning--especially…

Computation and Language · Computer Science 2025-06-17 Zhong-Zhi Li , Xiao Liang , Zihao Tang , Lei Ji , Peijie Wang , Haotian Xu , Xing W , Haizhen Huang , Weiwei Deng , Yeyun Gong , Zhijiang Guo , Xiao Liu , Fei Yin , Cheng-Lin Liu

Although large language models (LLMs) achieve effective safety alignment at the time of release, they still face various safety challenges. A key issue is that fine-tuning often compromises the safety alignment of LLMs. To address this…

Computation and Language · Computer Science 2025-05-27 Di Wu , Xin Lu , Yanyan Zhao , Bing Qin

Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) have made significant advancements in reasoning capabilities. However, they still face challenges such as high computational demands and privacy concerns. This paper…

Recent advances of Reinforcement Learning (RL) have highlighted its potential in complex reasoning tasks, yet effective training often relies on external supervision, which limits the broader applicability. In this work, we propose a novel…

Artificial Intelligence · Computer Science 2025-06-11 Kongcheng Zhang , Qi Yao , Shunyu Liu , Yingjie Wang , Baisheng Lai , Jieping Ye , Mingli Song , Dacheng Tao
‹ Prev 1 8 9 10 Next ›