中文
相关论文

相关论文: Native Parallel Reasoner: Reasoning in Parallelism…

200 篇论文

Large reasoning models (LRMs) excel on complex problems but face a critical barrier to efficiency: reinforcement learning (RL) training requires long rollouts for outcome-based rewards, where autoregressive decoding dominates time and…

机器学习 · 计算机科学 2026-02-20 Zeliang Zhang , Xiaodong Liu , Hao Cheng , Hao Sun , Chenliang Xu , Jianfeng Gao

While Multimodal Large Language Models (MLLMs) have achieved impressive progress in vision-language understanding, they still struggle with complex multi-step reasoning, often producing logically inconsistent or partially correct solutions.…

人工智能 · 计算机科学 2025-06-06 Lingxiao Du , Fanqing Meng , Zongkai Liu , Zhixiang Zhou , Ping Luo , Qiaosheng Zhang , Wenqi Shao

Large language models (LLMs) are designed to perform a wide range of tasks. To improve their ability to solve complex problems requiring multi-step reasoning, recent research leverages process reward modeling to provide fine-grained…

计算与语言 · 计算机科学 2025-09-29 Weixuan Wang , Minghao Wu , Barry Haddow , Alexandra Birch

The prevailing approach to distilling reasoning from Large Language Models (LLMs)-behavioral cloning from textual rationales-is fundamentally limited. It teaches Small Language Models (SLMs) to mimic surface-level patterns rather than the…

人工智能 · 计算机科学 2025-10-02 Xiangyu Wen , Junhua Huang , Zeju Li , Min Li , Jianyuan Zhong , Zhijian Xu , Mingxuan Yuan , Yongxiang Huang , Qiang Xu

Reinforcement learning with verifiable rewards (RLVR) has become a highly effective method for improving the reasoning abilities of Large Language Models (LLMs). Recent research shows that Negative Sample Reinforcement (NSR) -- which…

机器学习 · 计算机科学 2026-05-11 Yash Ingle , Jaival Chauhan , Ankit Yadav , Sudhakar Mishra

Reinforcement Learning with Verifiable Rewards (RLVR) has recently demonstrated notable success in enhancing the reasoning performance of large language models (LLMs), particularly on mathematics and programming tasks. Similar to how…

人工智能 · 计算机科学 2025-11-25 Yang Yue , Zhiqi Chen , Rui Lu , Andrew Zhao , Zhaokai Wang , Yang Yue , Shiji Song , Gao Huang

Recent AI advancements, such as OpenAI's new models, are transforming LLMs into LRMs (Large Reasoning Models) that perform reasoning during inference, taking extra time and compute for higher-quality outputs. We aim to uncover the…

Reinforcement learning with verifiable rewards (RLVR) is a promising approach for training language models (LMs) on reasoning tasks that elicit emergent long chains of thought (CoTs). Unlike supervised learning, it updates the model using…

计算与语言 · 计算机科学 2025-10-28 Xinyu Zhu , Mengzhou Xia , Zhepei Wei , Wei-Lin Chen , Danqi Chen , Yu Meng

Recent Large Reasoning Models have achieved significant improvements in complex task-solving capabilities by allocating more computation at the inference stage with a "thinking longer" paradigm. Even as the foundational reasoning…

人工智能 · 计算机科学 2025-09-29 Ziqi Wang , Boye Niu , Zhongli Li , Linghui Meng , Jing Liu , Zhi Zheng , Tong Xu , Hua Wu , Haifeng Wang , Enhong Chen

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

机器学习 · 计算机科学 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

Although Long Reasoning Models (LRMs) have achieved superior performance on various reasoning scenarios, they often suffer from increased computational costs and inference latency caused by overthinking. To address these limitations, we…

人工智能 · 计算机科学 2025-10-15 Yujian Zhang , Keyu Chen , Zhifeng Shen , Ruizhi Qiao , Xing Sun

Learning from negative samples holds great promise for improving Large Language Model (LLM) reasoning capability, yet existing methods treat all incorrect responses as equally informative, overlooking the crucial role of sample quality. To…

机器学习 · 计算机科学 2026-02-05 Zixiang Di , Jinyi Han , Shuo Zhang , Ying Liao , Zhi Li , Xiaofeng Ji , Yongqi Wang , Zheming Yang , Ming Gao , Bingdong Li , Jie Wang

LLMs have fundamentally transformed dense retrieval, upgrading backbones from discriminative encoders to generative architectures. However, a critical disconnect remains: while LLMs possess strong reasoning capabilities, current retrievers…

计算与语言 · 计算机科学 2026-03-03 Jiajie Jin , Yanzhao Zhang , Mingxin Li , Dingkun Long , Pengjun Xie , Yutao Zhu , Zhicheng Dou

Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge. However, existing work has three key limitations: (1) most efforts focus on…

We present PCL-Reasoner-V1.5, a 32-billion-parameter large language model (LLM) for mathematical reasoning. The model is built upon Qwen2.5-32B and refined via supervised fine-tuning (SFT) followed by reinforcement learning (RL). A central…

机器学习 · 计算机科学 2026-01-22 Yao Lu , Dengdong Fan , Jianzheng Nie , Fan Xu , Jie Chen , Bin Zhou , Yonghong Tian

Self-evolving Large Language Models (LLMs) offer a scalable path toward super-intelligence by autonomously generating, refining, and learning from their own experiences. However, existing methods for training such models still rely heavily…

机器学习 · 计算机科学 2026-02-16 Chengsong Huang , Wenhao Yu , Xiaoyang Wang , Hongming Zhang , Zongxia Li , Ruosen Li , Jiaxin Huang , Haitao Mi , Dong Yu

Personalization in Question Answering (QA) requires answers that are both accurate and aligned with users' background, preferences, and historical context. Existing state-of-the-art methods primarily rely on retrieval-augmented generation…

计算与语言 · 计算机科学 2026-02-24 Maryam Amirizaniani , Alireza Salemi , Hamed Zamani

Parallel thinking has emerged as a promising paradigm for reasoning, yet it imposes significant computational burdens. Existing efficiency methods primarily rely on local, per-trajectory signals and lack principled mechanisms to exploit…

计算与语言 · 计算机科学 2026-02-12 Tong Zheng , Chengsong Huang , Runpeng Dai , Yun He , Rui Liu , Xin Ni , Huiwen Bao , Kaishen Wang , Hongtu Zhu , Jiaxin Huang , Furong Huang , Heng Huang

Preference finetuning methods like Direct Preference Optimization (DPO) with AI-generated feedback have shown promise in aligning Large Vision-Language Models (LVLMs) with human preferences. However, existing techniques overlook the…

人工智能 · 计算机科学 2025-10-03 Rohan Wadhawan , Fabrice Y Harel-Canada , Zi-Yi Dou , Suhaila Shakiah , Robinson Piramuthu , Nanyun Peng

In continual learning, a system learns from non-stationary data streams or batches without catastrophic forgetting. While this problem has been heavily studied in supervised image classification and reinforcement learning, continual…

人工智能 · 计算机科学 2021-04-20 Tyler L. Hayes , Christopher Kanan