English
Related papers

Related papers: Beyond the Attention Stability Boundary: Agentic S…

200 papers

We present (Experience-Modulated Biologically-inspired Emergent Reasoning), a hybrid cognitive architecture that reorganises the relationship between large language models (LLMs) and memory: rather than augmenting an LLM with retrieval…

Artificial Intelligence · Computer Science 2026-04-15 William Savage

Latent reasoning offers a more efficient alternative to explicit reasoning by compressing intermediate reasoning into continuous representations and substantially shortening reasoning chains. However, existing latent reasoning methods…

Machine Learning · Computer Science 2026-05-01 Jingcheng Deng , Zihao Wei , Liang Pang , Junhong Wu , Shicheng Xu , Zenghao Duan , Huawei Shen

Operating LLMs as coordinated multi-agent research systems over multi-hour runs surfaces failure modes that single-shot evaluation cannot: upstream providers throttle without warning, sub-agents drift the task to fit accessible tools,…

Artificial Intelligence · Computer Science 2026-05-26 Sasank Annapureddy

RL training of multi-turn LLM agents is inherently unstable, and reasoning quality directly determines task performance. Entropy is widely used to track reasoning stability. However, entropy only measures diversity within the same input,…

Reinforcement Learning from Verifiable Rewards (RLVR) is bottlenecked by data: existing synthesis pipelines rely on expert-written code or fixed templates, confining growth to instance-level perturbations. We shift the evolvable unit from…

Artificial Intelligence · Computer Science 2026-04-07 Bowen Liu , Zhi Wu , Runquan Xie , Zhanhui Kang , Jia Li

Large language models are increasingly deployed in multi-agent systems to overcome context limitations by distributing information across agents. Yet whether agents can reliably compute with distributed information, rather than merely…

Multiagent Systems · Computer Science 2026-04-15 Yuzhe Zhang , Feiran Liu , Yi Shan , Xinyi Huang , Xin Yang , Yueqi Zhu , Xuxin Cheng , Cao Liu , Ke Zeng , Terry Jingchen Zhang , Wenyuan Jiang

Autonomous agents are increasingly entrusted with complex, long-horizon tasks, ranging from mathematical reasoning to software generation. While agentic workflows facilitate these tasks by decomposing them into multi-step reasoning chains,…

Artificial Intelligence · Computer Science 2026-03-03 Yandong Yan , Junwei Peng , Shijie Li , Chenxi Li , Yifei Shang , Can Deng , Ruiting Dai , Yongqiang Zhao , Jiaqi Zhu , Yu Huang

The evaluation of large language models (LLMs) has predominantly relied on static datasets, which offer limited scalability and fail to capture the evolving reasoning capabilities of recent models. To overcome these limitations, we propose…

Computation and Language · Computer Science 2026-03-02 Seungdong Yoa , Sanghyu Yoon , Suhee Yoon , Dongmin Kim , Ye Seul Sim , Junhyun Lee , Woohyung Lim

Explicit Chain-of-Thought improves the reasoning performance of large language models but often incurs high inference cost due to verbose token-level traces. While recent approaches reduce this overhead via concise prompting or step…

Computation and Language · Computer Science 2026-03-09 Yunlong Chu , Minglai Shao , Yuhang Liu , Bing Hao , Yumeng Lin , Jialu Wang , Ruijie Wang

As Large Language Model (LLM) agents increasingly gain self-evolutionary capabilities to adapt and refine their strategies through real-world interaction, their long-term reliability becomes a critical concern. We identify the Alignment…

Machine Learning · Computer Science 2026-02-13 Siwei Han , Kaiwen Xiong , Jiaqi Liu , Xinyu Ye , Yaofeng Su , Wenbo Duan , Xinyuan Liu , Cihang Xie , Mohit Bansal , Mingyu Ding , Linjun Zhang , Huaxiu Yao

Vision-language models with extended reasoning succeed on complex problems, but many real-world problems require external tools that internal reasoning alone often cannot resolve. Agentic reasoning therefore interleaves two behaviors with a…

Computation and Language · Computer Science 2026-05-28 Minki Kang , Shizhe Diao , Ryo Hachiuma , Sung Ju Hwang , Pavlo Molchanov , Yu-Chiang Frank Wang , Byung-Kwan Lee

The dominant paradigm for Audio-Text Retrieval (ATR) relies on dual-encoder architectures optimized via mini-batch contrastive learning. However, restricting optimization to local in-batch samples creates a fundamental limitation we term…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-25 Siyuan Fu , Xuchen Guo , Mingjun Liu , Hongxiang Li , Boyin Tan , Gongxi Zhu , Xianwei Zhuang , Jinghan Ru , Yuxin Xie , Yuguo Yin

Scaling inference-time computation has substantially improved the reasoning capabilities of language models. However, existing methods have significant limitations: serialized chain-of-thought approaches generate overly long outputs,…

Artificial Intelligence · Computer Science 2025-08-19 Jiayi Pan , Xiuyu Li , Long Lian , Charlie Snell , Yifei Zhou , Adam Yala , Trevor Darrell , Kurt Keutzer , Alane Suhr

Autonomous agents powered by LLMs and Retrieval-Augmented Generation (RAG) are proficient consumers of digital content but remain unidirectional, a limitation we term epistemic asymmetry. This isolation leads to redundant reasoning and…

Artificial Intelligence · Computer Science 2025-12-25 Zan-Kai Chong , Hiroyuki Ohsaki , Bryan Ng

Large Language Models (LLMs) have demonstrated remarkable reasoning abilities, yet existing test-time frameworks often rely on coarse self-verification and self-correction, limiting their effectiveness on complex tasks. In this paper, we…

Computation and Language · Computer Science 2025-11-14 Haizhou Shi , Ye Liu , Bo Pang , Zeyu Leo Liu , Hao Wang , Silvio Savarese , Caiming Xiong , Yingbo Zhou , Semih Yavuz

Large Reasoning Language Models (LRLMs or LRMs) demonstrate remarkable capabilities in complex reasoning tasks, but suffer from significant computational inefficiencies due to overthinking phenomena. Existing efficient reasoning methods…

Artificial Intelligence · Computer Science 2025-10-13 Dongqi Zheng

Large Language Models (LLMs) often produce incorrect answers on multi-hop question answering even when the reasoning trace already contains a correct intermediate conclusion. We attribute this gap to weak self-regulation rather than…

Artificial Intelligence · Computer Science 2026-05-12 Ik-hwan Kim , Hyeongrok Han , Mingi Jung , Sangwon Yu , Jinseok Hong , Sang Hun Kim , Yoonyoung Choi , Sungroh Yoon

In the realm of spoken language understanding (SLU), numerous natural language understanding (NLU) methodologies have been adapted by supplying large language models (LLMs) with transcribed speech instead of conventional written text. In…

Since the advent of ChatGPT, Large Language Models (LLMs) have excelled in various tasks but remain as black-box systems. Understanding the reasoning bottlenecks of LLMs has become a critical challenge, as these limitations are deeply tied…

Computation and Language · Computer Science 2024-12-24 Zifan Zheng , Yezhaohui Wang , Yuxin Huang , Shichao Song , Mingchuan Yang , Bo Tang , Feiyu Xiong , Zhiyu Li

Latent reasoning offers a computation-efficient alternative to Chain-of-Thought but often suffers from performance degradation due to distributional misalignment and ambiguous chain definitions. Ideally, latent reasoning should function as…

Computation and Language · Computer Science 2026-02-02 Jingcheng Deng , Liang Pang , Zihao Wei , Shicheng Xu , Zenghao Duan , Kun Xu , Yang Song , Huawei Shen , Xueqi Cheng