English
Related papers

Related papers: ReCrit: Transition-Aware Reinforcement Learning fo…

200 papers

Reinforcement Learning (RL)-based post-training has significantly advanced the complex reasoning capabilities of language models, fostering sophisticated self-reflection processes. However, this ``slow thinking'' paradigm presents a…

Machine Learning · Computer Science 2025-06-24 Xu Wan , Wei Wang , Wenyue Xu , Wotao Yin , Jie Song , Mingyang Sun

Large Reasoning Models (LRMs) have shown remarkable reasoning capabilities, yet they often suffer from overthinking, expending redundant computational steps on simple problems, or underthinking, failing to explore sufficient reasoning paths…

Artificial Intelligence · Computer Science 2026-04-03 Yulin Li , Tengyao Tu , Li Ding , Junjie Wang , Huiling Zhen , Yixin Chen , Yong Li , Zhuotao Tian

Translating natural language mathematical statements into formal, executable code is a fundamental challenge in automated theorem proving. While prior work has focused on generation and compilation success, little attention has been paid to…

Large Multimodal Models (LMMs) excel at comprehending human instructions and demonstrate remarkable results across a broad spectrum of tasks. Reinforcement Learning from Human Feedback (RLHF) and AI Feedback (RLAIF) further refine LLMs by…

Artificial Intelligence · Computer Science 2024-10-07 Ju-Seung Byun , Jiyun Chun , Jihyung Kil , Andrew Perrault

Access to the right evidence does not guarantee that large language models (LLMs) will reason with it correctly. This gap between retrieval and reasoning is especially concerning in clinical settings, where outputs must align with…

Artificial Intelligence · Computer Science 2025-11-21 Deepthi Potluri , Aby Mammen Mathew , Jeffrey B DeWitt , Alexander L. Rasgon , Yide Hao , Junyuan Hong , Ying Ding

Reasoning-oriented language models typically expose explicit reasoning as a long, front-loaded chain of "thinking" tokens before the main output, either always enabled or externally toggled at inference time. Although this can help on…

Machine Learning · Computer Science 2026-05-05 Susmit Das

Reward models are widely used as proxies for human preferences when aligning or evaluating LLMs. However, reward models are black boxes, and it is often unclear what, exactly, they are actually rewarding. In this paper we develop…

Computation and Language · Computer Science 2025-05-21 David Reber , Sean Richardson , Todd Nief , Cristina Garbacea , Victor Veitch

Binary security has increasingly relied on deep learning to reason about malware behavior and program semantics. However, the performance often degrades as threat landscapes evolve and code representations shift. While continual learning…

Machine Learning · Computer Science 2026-04-24 Yiling He , Junchi Lei , Hongyu She , Shuo Shao , Xinran Zheng , Yiping Liu , Zhan Qin , Lorenzo Cavallaro

Large language models (LLMs) aligned for safety often suffer from over-refusal, the tendency to reject seemingly toxic or benign prompts by misclassifying them as toxic. This behavior undermines models' helpfulness and restricts usability…

Computation and Language · Computer Science 2026-03-05 Yuxiao Lu , Lin Xu , Yang Sun , Wenjun Li , Jie Shi

Test-time adaptation offers a promising avenue for improving reasoning performance in large language models without additional supervision, but existing approaches often apply a uniform optimization objective across all inputs, leading to…

Computation and Language · Computer Science 2026-03-06 Mohammad Mahdi Moradi , Sudhir Mudur

The rise of personal assistants has made conversational question answering (ConvQA) a very popular mechanism for user-system interaction. State-of-the-art methods for ConvQA over knowledge graphs (KGs) can only learn from crisp…

Information Retrieval · Computer Science 2021-08-23 Magdalena Kaiser , Rishiraj Saha Roy , Gerhard Weikum

Large language models (LLMs) achieve high performance on mathematical reasoning, but these results can be inflated by training data leakage or superficial pattern matching rather than genuine reasoning. To this end, an adversarial…

Computation and Language · Computer Science 2026-02-03 Xinyuan Li , Murong Xu , Wenbiao Tao , Hanlun Zhu , Yike Zhao , Jipeng Zhang , Yunshi Lan

Retrieval is increasingly moving from one-shot matching toward interactive reasoning, where language agents iteratively inspect evidence, reformulate queries, and search again. Training such agents raises a credit-assignment challenge:…

Computation and Language · Computer Science 2026-05-27 Mingchen Li , Hansi Zeng , Zhuo Qian , Jiatan Huang , Hamed Zamani , Hong Yu

Large reasoning models (LRMs) achieve impressive reasoning capabilities by generating lengthy chain-of-thoughts, but this "overthinking" incurs high latency and cost without commensurate accuracy gains. In this work, we introduce AALC, a…

Computation and Language · Computer Science 2025-08-11 Ruosen Li , Ziming Luo , Quan Zhang , Ruochen Li , Ben Zhou , Ali Payani , Xinya Du

Large language models excel at complex tasks by breaking down problems into structured reasoning steps. However, reasoning traces often extend beyond reaching a correct answer, causing wasted computation, reduced readability, and…

Computation and Language · Computer Science 2025-05-26 Razvan-Gabriel Dumitru , Darius Peteleaza , Vikas Yadav , Liangming Pan

Large language models (LLMs) achieve high accuracy on many reasoning benchmarks but remain brittle under structural perturbations of rule-based systems. We introduce a diagnostic framework with four stress tests -- redundant vs. essential…

Artificial Intelligence · Computer Science 2026-05-26 Qiming Bao , Xiaoxuan Fu , Michael Witbrock

Recent developments in large language models (LLMs) have been impressive. However, these models sometimes show inconsistencies and problematic behavior, such as hallucinating facts, generating flawed code, or creating offensive and toxic…

Computation and Language · Computer Science 2024-02-22 Zhibin Gou , Zhihong Shao , Yeyun Gong , Yelong Shen , Yujiu Yang , Nan Duan , Weizhu Chen

The most dangerous error in clinical trial interpretation is equating p > 0.05 with no effect. This review provides a practical, algorithm-based framework for classifying randomized controlled trial (RCT) results into six distinct…

Methodology · Statistics 2026-04-13 Ibrahim Halil Tanboga

A vast amount of scholarly work is published daily, yet much of it remains inaccessible to the general public due to dense jargon and complex language. To address this challenge in science communication, we introduce a reinforcement…

Computation and Language · Computer Science 2025-04-17 Haining Wang , Jason Clark , Hannah McKelvey , Leila Sterman , Zheng Gao , Zuoyu Tian , Sandra Kübler , Xiaozhong Liu

Large Reasoning Models possess remarkable capabilities for self-correction in general domain; however, they frequently struggle to recover from unsafe reasoning trajectories under adversarial attacks. Existing alignment methods attempt to…

Artificial Intelligence · Computer Science 2026-05-12 Dongcheng Zhang , Yi Zhang , Yuxin Chen , An Zhang , Xiang Wang , Chaochao Lu