English
Related papers

Related papers: The Cognitive Penalty: Ablating System 1 and Syste…

200 papers

As Large Language Models (LLMs) evolve into persistent scientific collaborators, context window saturation has emerged as a critical bottleneck. Scientific workflows involving iterative data analysis and hypothesis refinement rapidly…

Artificial Intelligence · Computer Science 2026-05-19 Nikola Milosevic

End-to-end speech large language models ((LLMs)) extend the capabilities of text-based models to directly process and generate audio tokens. However, this often leads to a decline in reasoning and generation performance compared to text…

Sound · Computer Science 2025-05-21 Yuanbo Fang , Haoze Sun , Jun Liu , Tao Zhang , Zenan Zhou , Weipeng Chen , Xiaofen Xing , Xiangmin Xu

Recent advances in Large Audio-Language Models (LALMs) have made real-time, streaming spoken interaction increasingly practical. In this setting, reasoning quality and responsiveness are tightly coupled: delaying reasoning until the speech…

Computation and Language · Computer Science 2026-05-27 Zhiyuan Song , Weici Zhao , Yang Xiao , Suhao Yu , Cheng Zhu , Jiatao Gu

Large language models (LLMs) have demonstrated significant advancements in reasoning capabilities, performing well on various challenging benchmarks. Techniques like Chain-of-Thought prompting have been introduced to further improve…

Computation and Language · Computer Science 2025-06-13 Zehui Ling , Deshu Chen , Hongwei Zhang , Yifeng Jiao , Xin Guo , Yuan Cheng

As large language models (LLMs) are becoming more capable and widespread, the study of their failure cases is becoming increasingly important. Recent advances in standardizing, measuring, and scaling test-time compute suggest new…

Machine Learning · Computer Science 2025-06-26 Mahdi Sabbaghi , Paul Kassianik , George Pappas , Yaron Singer , Amin Karbasi , Hamed Hassani

This paper presents a novel framework for enhancing reasoning capabilities in large language models (LLMs) by leveraging iterative reasoning and feedback-driven methodologies. Building on the limitations identified in the SimpleBench…

Computation and Language · Computer Science 2024-12-18 Soham Sane , Angus McLean

Large Language Models (LLMs) have been applied to automate cyber security activities and processes including cyber investigation and digital forensics. However, the use of such models for cyber investigation and digital forensics should…

Cryptography and Security · Computer Science 2024-04-02 Jonathan Pan , Swee Liang Wong , Xin Wei Chia , Yidi Yuan

Emerging computation-intensive applications impose stringent latency requirements on resource-constrained mobile devices. Mobile Edge Computing (MEC) addresses this challenge through task offloading. However, designing effective policies…

Machine Learning · Computer Science 2026-04-09 Ning Yang , Chuangxin Cheng , Haijun Zhang

The rapid proliferation of Large Language Models (LLMs) has revolutionized Natural Language Processing (NLP) but has simultaneously created a "resource divide." State-of-the-art legal intelligence systems typically rely on massive parameter…

Computation and Language · Computer Science 2026-02-19 Subrit Dikshit

Emerging 6G visions, reflected in ongoing standardization efforts within 3GPP, IETF, ETSI, ITU-T, and the O-RAN Alliance, increasingly characterize networks as AI-native systems in which high-level semantic reasoning layers operate above…

Networking and Internet Architecture · Computer Science 2026-03-03 Mohamed Amine Ferrag , Abderrahmane Lakas , Merouane Debbah

Large Language Models (LLMs) exhibit impressive reasoning abilities, yet their reliance on structured step-by-step processing reveals a critical limitation. In contrast, human cognition fluidly adapts between intuitive, heuristic (System 1)…

Computation and Language · Computer Science 2025-10-16 Alireza S. Ziabari , Nona Ghazizadeh , Zhivar Sourati , Farzan Karimi-Malekabadi , Payam Piray , Morteza Dehghani

Reasoning and strategic behavior in social interactions is a hallmark of intelligence. This form of reasoning is significantly more sophisticated than isolated planning or reasoning tasks in static settings (e.g., math problem solving). In…

Artificial Intelligence · Computer Science 2025-10-17 Jianzhu Yao , Kevin Wang , Ryan Hsieh , Haisu Zhou , Tianqing Zou , Zerui Cheng , Zhangyang Wang , Pramod Viswanath

Large Language Models (LLMs) exhibit impressive capabilities across various applications but encounter substantial challenges such as high inference latency, considerable training costs, and the generation of hallucinations. Collaborative…

Computation and Language · Computer Science 2024-10-24 Kaiyan Zhang , Jianyu Wang , Ning Ding , Biqing Qi , Ermo Hua , Xingtai Lv , Bowen Zhou

Structured reasoning can improve the inference performance of large language models (LLMs), but it also introduces computational cost and control constraints. When additional reasoning structure helps, and when it instead reduces efficiency…

Machine Learning · Computer Science 2026-04-14 Junyu Guo , Shangding Gu , Ming Jin , Costas Spanos , Javad Lavaei

Reinforcement learning exhibits potential in enhancing the reasoning abilities of large language models, yet it is hard to scale for the low sample efficiency during the rollout phase. Existing methods attempt to improve efficiency by…

Machine Learning · Computer Science 2026-02-02 Deyang Kong , Qi Guo , Xiangyu Xi , Wei Wang , Jingang Wang , Xunliang Cai , Shikun Zhang , Wei Ye

Large language models (LLMs) empowered by chain-of-thought reasoning have achieved impressive accuracy on complex tasks but suffer from excessive inference costs and latency when applied uniformly to all problems. We propose SABER…

Computation and Language · Computer Science 2025-08-15 Kai Zhao , Yanjun Zhao , Jiaming Song , Shien He , Lusheng Zhang , Qiang Zhang , Tianjiao Li

This paper explores the system 1 thinking capability of Large Reasoning Models (LRMs), the intuitive ability to respond efficiently with minimal token usage. While existing LRMs rely on long-chain reasoning and excel at complex tasks, their…

Computation and Language · Computer Science 2026-05-04 Wenyuan Zhang , Shuaiyi Nie , Xinghua Zhang , Zefeng Zhang , Tingwen Liu

Small language models (SLMs) are more efficient, cost-effective, and customizable than large language models (LLMs), though they often underperform in specific areas like reasoning. Past methods for enhancing SLMs' reasoning, such as…

Computation and Language · Computer Science 2024-12-12 Kaiyuan Chen , Jin Wang , Xuejie Zhang

While Large Language Models (LLMs) demonstrate exceptional performance in surface-level text generation, their nature in handling complex multi-step reasoning tasks often remains one of ``statistical fitting'' rather than systematic logical…

Machine Learning · Computer Science 2026-01-27 Lianlei Shan , Han Chen , Yixuan Wang , Zhenjie Liu , Wei Li

The recent explosion of large language models (LLMs), each with its own general or specialized strengths, makes scalable, reliable benchmarking more urgent than ever. Standard practices nowadays face fundamental trade-offs: closed-ended…