中文
相关论文

相关论文: Reverse-Engineered Reasoning for Open-Ended Genera…

200 篇论文

While Large Language Models (LLMs) demonstrate exceptional performance in surface-level text generation, their nature in handling complex multi-step reasoning tasks often remains one of ``statistical fitting'' rather than systematic logical…

机器学习 · 计算机科学 2026-01-27 Lianlei Shan , Han Chen , Yixuan Wang , Zhenjie Liu , Wei Li

Sequential recommender systems have become increasingly important in real-world applications that model user behavior sequences to predict their preferences. However, existing sequential recommendation methods predominantly rely on…

信息检索 · 计算机科学 2025-06-05 Enze Liu , Bowen Zheng , Xiaolei Wang , Wayne Xin Zhao , Jinpeng Wang , Sheng Chen , Ji-Rong Wen

Large language models (LLMs) perform strongly on many language tasks but still struggle with complex multi-step reasoning across disciplines. Existing reasoning datasets often lack disciplinary breadth, reasoning depth, and diversity, as…

计算与语言 · 计算机科学 2026-02-03 Weize Liu , Yongchi Zhao , Yijia Luo , Mingyu Xu , Jiaheng Liu , Yanan Li , Xiguo Hu , Zhiqi Bai , Yuchi Xu , Wenbo Su , Bo Zheng

The recent DeepSeek-R1 release has demonstrated the immense potential of reinforcement learning (RL) in enhancing the general reasoning capabilities of large language models (LLMs). While DeepSeek-R1 and other follow-up work primarily focus…

Recent reasoning-first models (e.g., OpenAI o1, DeepSeek R1) have spurred a resurgence of interest in RLVR. Nevertheless, advances are dominated by mathematics (e.g., AIME), with competitive-programming code generation underexplored and…

机器学习 · 计算机科学 2025-11-11 Speed Zhu , Jianwei Cai , Guang Chen , Lulu Wu , Saiyong Yang , Wiggin Zhou

Learning identity-discriminative representations with multi-scene generality has become a critical objective in person re-identification (ReID). However, mainstream perception-driven paradigms tend to identify fitting from massive annotated…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Quan Zhang , Jingze Wu , Jialong Wang , Xiaohua Xie , Jianhuang Lai , Hongbo Chen

Numerical reasoning over hybrid data containing tables and long texts has recently received research attention from the AI community. To generate an executable reasoning program consisting of math and table operations to answer a question,…

计算与语言 · 计算机科学 2022-11-24 Xiao Li , Yin Zhu , Sichen Liu , Jiangzhou Ju , Yuzhong Qu , Gong Cheng

In reinforcement learning (RL), experience replay-based sampling techniques play a crucial role in promoting convergence by eliminating spurious correlations. However, widely used methods such as uniform experience replay (UER) and…

机器学习 · 计算机科学 2023-02-07 Ramnath Kumar , Dheeraj Nagaraj

DEEPTHINK methods improve reasoning by generating, refining, and aggregating populations of candidate solutions, which enables strong performance on complex mathematical and scientific tasks. However, existing frameworks often lack reliable…

人工智能 · 计算机科学 2026-03-04 Rituraj Sharma , Weiyuan Chen , Noah Provenzano , Tu Vu

Retrieval-augmented generation has achieved strong performance on knowledge-intensive tasks where query-document relevance can be identified through direct lexical or semantic matches. However, many real-world queries involve abstract…

Mathematical reasoning benchmarks are vital for evaluating large language models (LLMs), but many are static and repeatedly exposed through public evaluation and training pipelines, making it difficult to separate genuine reasoning from…

计算与语言 · 计算机科学 2026-05-28 Raoyuan Zhao , Yihong Liu , Yupei Du , Hinrich Schütze , Michael A. Hedderich

Large Language Models (LLMs) have recently achieved remarkable progress by leveraging Reinforcement Learning and extended Chain-of-Thought (CoT) techniques. However, the challenge of performing efficient language reasoning--especially…

Deep reinforcement learning (RL) provides powerful methods for training optimal sequential decision-making agents. As collecting real-world interactions can entail additional costs and safety risks, the common paradigm of sim2real conducts…

人工智能 · 计算机科学 2023-12-11 Minqi Jiang

We introduce Native Parallel Reasoner (NPR), a teacher-free framework that enables Large Language Models (LLMs) to self-evolve genuine parallel reasoning capabilities. NPR transforms the model from sequential emulation to native parallel…

计算与语言 · 计算机科学 2026-05-15 Tong Wu , Yang Liu , Jun Bai , Zixia Jia , Shuyi Zhang , Ziyong Lin , Yanting Wang , Song-Chun Zhu , Zilong Zheng

Tool-integrated visual reasoning (TiVR) has demonstrated great potential in enhancing multimodal problem-solving. However, existing TiVR paradigms mainly focus on integrating various visual tools through reinforcement learning, while…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Yuji Wang , Wenlong Liu , Jingxuan Niu , Haoji Zhang , Yansong Tang

Backtracking, an emergent behavior elicited by reasoning fine-tuning, has been shown to be a key mechanism in reasoning models' enhanced capabilities. Prior work has succeeded in manipulating this behavior via steering vectors, but the…

机器学习 · 计算机科学 2025-07-18 Jake Ward , Chuqiao Lin , Constantin Venhoff , Neel Nanda

Recent advancements in large reasoning models (LRMs) have significantly enhanced language models' capabilities in complex problem-solving by emulating human-like deliberative thinking. However, these models often exhibit overthinking (i.e.,…

人工智能 · 计算机科学 2025-06-19 Weixiang Zhao , Jiahe Guo , Yang Deng , Xingyu Sui , Yulin Hu , Yanyan Zhao , Wanxiang Che , Bing Qin , Tat-Seng Chua , Ting Liu

Reinforcement learning (RL) has played an important role in improving the reasoning ability of large language models (LLMs). Some studies apply RL directly to \textit{smaller} base models (known as zero-RL) and also achieve notable…

人工智能 · 计算机科学 2025-05-28 Xiao Hu , Xingyu Lu , Liyuan Mao , YiFan Zhang , Tianke Zhang , Bin Wen , Fan Yang , Tingting Gao , Guorui Zhou

Listwise reranking utilizing Large Language Models (LLMs) has achieved state-of-the-art retrieval effectiveness. Recently, reasoning-enhanced models have further pushed these boundaries by employing Chain-of-Thought (CoT) to perform deep…

信息检索 · 计算机科学 2026-05-15 Danyang Liu , Kan Li

Being able to generate informative and coherent dialogue responses is crucial when designing human-like open-domain dialogue systems. Encoder-decoder-based dialogue models tend to produce generic and dull responses during the decoding step…

计算与语言 · 计算机科学 2021-05-04 Ziming Li , Julia Kiseleva , Maarten de Rijke