English
Related papers

Related papers: Aware First, Think Less: Dynamic Boundary Self-Awa…

200 papers

Reinforcement learning (RL) has emerged as a promising strategy for improving the reasoning capabilities of language models (LMs) in domains such as mathematics and coding. However, most modern RL algorithms were designed to target robotics…

Artificial Intelligence · Computer Science 2025-05-26 Lianghuan Huang , Shuo Li , Sagnik Anupam , Insup Lee , Osbert Bastani

Large language models (LLMs) increasingly rely on long-context processing, but expanding context windows introduces substantial computational and financial costs. Existing context reduction approaches, including retrieval and memory…

Computation and Language · Computer Science 2026-05-25 Binqi Shen , Lier Jin , Hanyu Cai , Lan Hu , Yuting Xin

Long-context question-answering (LCQA) systems have greatly benefited from the powerful reasoning capabilities of large language models (LLMs), which can be categorized into slow and quick reasoning modes. However, both modes have their…

Computation and Language · Computer Science 2025-04-01 Zhengyi Zhao , Shubo Zhang , Zezhong Wang , Bin Liang , Binyang Li , Kam-Fai Wong

Current Large Language Model (LLM) agents demonstrate strong reasoning and tool use capabilities, but often lack self-awareness, failing to balance these approaches effectively. This imbalance leads to Tool Overuse, where models…

Artificial Intelligence · Computer Science 2025-05-27 Cheng Qian , Emre Can Acikgoz , Hongru Wang , Xiusi Chen , Avirup Sil , Dilek Hakkani-Tür , Gokhan Tur , Heng Ji

Large Language Models (LLMs) have exhibited impressive capabilities across diverse application domains. Recent work has explored Multi-LLM Agent Debate (MAD) as a way to enhance performance by enabling multiple LLMs to discuss and refine…

Computation and Language · Computer Science 2026-05-27 Xuhang Chen , Zhifan Song , Deyi Ji , Shuo Gao , Lanyun Zhu

Autonomous driving has made significant strides through data-driven techniques, achieving robust performance in standardized tasks. However, existing methods frequently overlook user-specific preferences, offering limited scope for…

Robotics · Computer Science 2025-05-13 Chengkai Xu , Jiaqi Liu , Yicheng Guo , Yuhang Zhang , Peng Hang , Jian Sun

Large Reasoning Models (LRMs) often suffer from computational inefficiency due to overthinking, where a fixed reasoning budget fails to match the varying complexity of tasks. To address this issue, we propose Adaptive Overclocking, a method…

Machine Learning · Computer Science 2025-09-23 Shuhao Jiang , Songbo Wang , Yang Qiao , Chun Xu , Chaoyang Zheng , Shengyi Zhou , Huanjun Wang , Fangming Li , Cong Zhang , Jiyu Wang

Large reasoning models (LRMs) achieve strong performance through extended reasoning traces, but they often exhibit overthinking behavior for low-complexity queries. Existing efforts to mitigate this issue are fundamentally limited by…

Machine Learning · Computer Science 2026-02-27 Zihang Xu , Haozhi Xie , Ziqi Miao , Wuxuan Gong , Chen Qian , Lijun Li

Recent advancements in large language models (LLMs) have catalyzed the rise of reasoning-intensive inference paradigms, where models perform explicit step-by-step reasoning before generating final answers. While such approaches improve…

Artificial Intelligence · Computer Science 2026-04-28 Zichuan Fu , Xian Wu , Guojing Li , Yejing Wang , Yijun Chen , Zihao Zhao , Yixuan Luo , Hanyu Yan , Yefeng Zheng , Xiangyu Zhao

Large reasoning models (LRMs) achieve impressive reasoning capabilities by generating lengthy chain-of-thoughts, but this "overthinking" incurs high latency and cost without commensurate accuracy gains. In this work, we introduce AALC, a…

Computation and Language · Computer Science 2025-08-11 Ruosen Li , Ziming Luo , Quan Zhang , Ruochen Li , Ben Zhou , Ali Payani , Xinya Du

Chain-of-Thought (CoT) reasoning has emerged as a promising approach for enhancing the performance of large language models (LLMs) on complex reasoning tasks. Recently, a series of studies attempt to explain the mechanisms underlying CoT,…

Computation and Language · Computer Science 2024-10-29 Qiguang Chen , Libo Qin , Jiaqi Wang , Jinxuan Zhou , Wanxiang Che

Large Reasoning Models (LRMs) have demonstrated impressive capabilities but suffer from cognitive inefficiencies like "overthinking" simple problems and "underthinking" complex ones. While existing methods that use supervised fine-tuning…

Artificial Intelligence · Computer Science 2026-03-24 Tian Liang , Wenxiang Jiao , Zhiwei He , Jiahao Xu , Haitao Mi , Dong Yu

Large language models (LLMs) have emerged as effective action policies for sequential decision-making (SDM) tasks due to their extensive prior knowledge. However, this broad yet general knowledge is often insufficient for specific…

Machine Learning · Computer Science 2025-10-01 Xue Yan , Zijing Ou , Mengyue Yang , Yan Song , Haifeng Zhang , Yingzhen Li , Jun Wang

Large language models (LLMs) achieve strong reasoning performance by allocating substantial computation at inference time, often generating long and verbose reasoning traces. While recent work on efficient reasoning reduces this overhead…

Computation and Language · Computer Science 2026-04-28 Han Wang , Xiaodong Yu , Jialian Wu , Jiang Liu , Ximeng Sun , Mohit Bansal , Zicheng Liu

Large Language Models (LLMs) suffer from a critical limitation: their knowledge is static and quickly becomes outdated. Retraining these massive models is computationally prohibitive, while existing knowledge editing techniques can be slow…

Computation and Language · Computer Science 2025-12-30 Kabir Khan , Priya Sharma , Arjun Mehta , Neha Gupta , Ravi Narayanan

Large language models (LLMs) have demonstrated emergent capabilities across diverse reasoning tasks via popular Chains-of-Thought (COT) prompting. However, such a simple and fast COT approach often encounters limitations in dealing with…

Computation and Language · Computer Science 2024-07-02 Jiabao Pan , Yan Zhang , Chen Zhang , Zuozhu Liu , Hongwei Wang , Haizhou Li

Self-Consistency mitigates hallucinations in Large Language Models (LLMs) by sampling multiple reasoning paths,but it lacks a systematic approach to determine the optimal number of samples or select the most faithful rationale. To address…

Computation and Language · Computer Science 2025-02-05 Guangya Wan , Yuqi Wu , Jie Chen , Sheng Li

The applications of large language models (LLMs) have been widely spread across all domains. However, the basic abilities such as the controllability of LLMs are still limited. To address this, we propose "Self-controller", a novel agentic…

Computation and Language · Computer Science 2024-10-02 Xiao Peng , Xufan Geng

Large language models (LLMs) demonstrate exceptional performance on general-purpose tasks. however, transferring them to complex engineering domains such as space situational awareness (SSA) remains challenging owing to insufficient…

Artificial Intelligence · Computer Science 2026-03-11 Ding Linghu , Cheng Wang , Da Fan , Wei Shi , Kaifeng Yin , Xiaoliang Xue , Fan Yang , Haiyi Ren , Cong Zhang

Large Reasoning Models (LRMs) demonstrate remarkable problem-solving capabilities through extended Chain-of-Thought (CoT) reasoning but often produce excessively verbose and redundant reasoning traces. This inefficiency incurs high…

Computation and Language · Computer Science 2025-09-11 Jiaxuan Gao , Shu Yan , Qixin Tan , Lu Yang , Shusheng Xu , Wei Fu , Zhiyu Mei , Kaifeng Lyu , Yi Wu