中文
相关论文

相关论文: Finding RELIEF: Shaping Reasoning Behavior without…

200 篇论文

The prevalence of fake news on social media demands automated fact-checking systems to provide accurate verdicts with faithful explanations. However, existing large language model (LLM)-based approaches ignore deceptive misinformation…

计算与语言 · 计算机科学 2026-04-21 Chuyi Kong , Gao Wei , Jing Ma , Hongzhan Lin , Yuxi Sun

Designing effective reward functions is crucial to training reinforcement learning (RL) algorithms. However, this design is non-trivial, even for domain experts, due to the subjective nature of certain tasks that are hard to quantify…

神经与进化计算 · 计算机科学 2025-05-26 Rishi Hazra , Alkis Sygkounas , Andreas Persson , Amy Loutfi , Pedro Zuidberg Dos Martires

Recent advances in test-time scaling have led to the emergence of thinking LLMs that exhibit self-reflective behaviors and multi-step reasoning. While RL drives this self-improvement paradigm, a recent study (Gandhi et al., 2025) shows that…

人工智能 · 计算机科学 2025-08-22 Aswin RRV , Jacob Dineen , Divij Handa , Md Nayem Uddin , Mihir Parmar , Chitta Baral , Ben Zhou

Structured reasoning can improve the inference performance of large language models (LLMs), but it also introduces computational cost and control constraints. When additional reasoning structure helps, and when it instead reduces efficiency…

机器学习 · 计算机科学 2026-04-14 Junyu Guo , Shangding Gu , Ming Jin , Costas Spanos , Javad Lavaei

As large language models (LLMs) increasingly engage in complex social interactions, ensuring that their behaviors align with human ethical principles and intentions, known as value alignment, has become a critical scientific challenge.…

计算工程、金融与科学 · 计算机科学 2026-05-29 Yu Lei , Hao Liu , Chengxing Xie , Songjia Liu , Zhiyu Yin , Canyu Chen , Guohao Li , Philip Torr , Zhen Wu

Despite the growing reasoning capabilities of recent large language models (LLMs), their internal mechanisms during the reasoning process remain underexplored. Prior approaches often rely on human-defined concepts (e.g., overthinking,…

计算与语言 · 计算机科学 2026-01-01 Zhenyu Zhang , Shujian Zhang , John Lambert , Wenxuan Zhou , Zhangyang Wang , Mingqing Chen , Andrew Hard , Rajiv Mathews , Lun Wang

Recent Large Reasoning Language Models (LRLMs) employ long chain-of-thought reasoning with complex reflection behaviors, typically signaled by specific trigger words (e.g., "Wait" and "Alternatively") to enhance performance. However, these…

计算与语言 · 计算机科学 2025-11-18 Jiameng Huang , Baijiong Lin , Guhao Feng , Jierun Chen , Di He , Lu Hou

Many challenging reasoning tasks require not just rapid, intuitive responses, but a more deliberate, multi-step approach. Recent progress in large language models (LLMs) highlights an important shift from the "System 1" way of quick…

计算与语言 · 计算机科学 2025-06-03 Guizhen Chen , Weiwen Xu , Hao Zhang , Hou Pong Chan , Chaoqun Liu , Lidong Bing , Deli Zhao , Anh Tuan Luu , Yu Rong

Large Reasoning Models (LRMs) achieve strong performance on complex tasks through extended chains of thought but suffer from high inference latency due to autoregressive reasoning. Recent work explores using Small Reasoning Models (SRMs) to…

人工智能 · 计算机科学 2026-04-17 Yi Zhao , Yajuan Peng , Cam-Tu Nguyen , Zuchao Li , Xiaoliang Wang , Xiaoming Fu , Hai Zhao

Large Reasoning Models (LRMs) demonstrate exceptional capability in tackling complex mathematical, logical, and coding tasks by leveraging extended Chain-of-Thought (CoT) reasoning. Test-time scaling methods, such as prolonging CoT with…

机器学习 · 计算机科学 2025-06-03 Weizhe Lin , Xing Li , Zhiyuan Yang , Xiaojin Fu , Hui-Ling Zhen , Yaoyuan Wang , Xianzhi Yu , Wulong Liu , Xiaosong Li , Mingxuan Yuan

Theory of Mind (ToM) reasoning with Large Language Models (LLMs) requires inferring how people's implicit, evolving beliefs shape what they seek and how they act under uncertainty -- especially in high-stakes settings such as disaster…

人工智能 · 计算机科学 2026-03-23 Ruxiao Chen , Xilei Zhao , Thomas J. Cova , Frank A. Drews , Susu Xu

Reasoning-augmented vision language models (VLMs) generate explicit chains of thought that promise greater capability and transparency but also introduce new failure modes: models may reach correct answers via visually unfaithful…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Rheeya Uppaal , Phu Mon Htut , Min Bai , Nikolaos Pappas , Zheng Qi , Sandesh Swamy

Large Language Models (LLMs) display strikingly different generalization behaviors: supervised fine-tuning (SFT) often narrows capability, whereas reinforcement-learning (RL) tuning tends to preserve it. The reasons behind this divergence…

机器学习 · 计算机科学 2026-01-01 Haoyue Bai , Yiyou Sun , Wenjie Hu , Shi Qiu , Maggie Ziyu Huan , Peiyang Song , Robert Nowak , Dawn Song

We present an ethical decision-making framework that refines a pre-trained reinforcement learning (RL) model using a task-agnostic ethical layer. Following initial training, the RL model undergoes ethical fine-tuning, where human feedback…

计算机与社会 · 计算机科学 2026-05-05 Rohit K. Dubey , Damian Dailisan , Sachit Mahajan

Reinforcement learning from verifiable rewards (RLVR) is a promising paradigm for improving large language model (LLM) agents on long-horizon interactive tasks. However, in partially observable environments, incomplete observations cause…

计算与语言 · 计算机科学 2026-05-20 Wenjie Tang , Minne Li , Sijie Huang , Liquan Xiao , Yuan Zhou

Should we trust Large Language Models (LLMs) with high accuracy? LLMs achieve high accuracy on reasoning benchmarks, but correctness alone does not reveal the quality of the reasoning used to produce it. This highlights a fundamental…

计算与语言 · 计算机科学 2026-04-15 Manas Pathak , Xingyao Chen , Shuozhe Li , Amy Zhang , Liu Leqi

Recent advances in large reasoning models (LRMs) demonstrate that sophisticated behaviors such as multi-step reasoning and self-reflection can emerge via reinforcement learning with verifiable rewards~(\textit{RLVR}). However, existing…

机器学习 · 计算机科学 2025-06-24 Jianhao Yan , Yafu Li , Zican Hu , Zhi Wang , Ganqu Cui , Xiaoye Qu , Yu Cheng , Yue Zhang

Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models improve LLM performance in multi-hop QA tasks, which require…

计算与语言 · 计算机科学 2026-01-21 Guo Chen , Junjie Huang , Huaijin Xie , Fei Sun , Tao Jia

Large Language Models (LLMs) trained via Reinforcement Learning (RL) have exhibited strong reasoning capabilities and emergent reflective behaviors, such as rethinking and error correction, as a form of in-context exploration. However, the…

机器学习 · 计算机科学 2025-12-09 Shenao Zhang , Yaqing Wang , Yinxiao Liu , Tianqi Liu , Peter Grabowski , Eugene Ie , Zhaoran Wang , Yunxuan Li

Large Reasoning Models (LRMs) exhibit backtracking and self-verification mechanisms that enable them to revise intermediate steps and reach correct solutions, yielding strong performance on complex logical benchmarks. We hypothesize that…

机器学习 · 计算机科学 2026-05-25 Hoang Phan , Quang H. Nguyen , Hung T. Q. Le , Xiusi Chen , Heng Ji , Khoa D. Doan