English
Related papers

Related papers: DualSpec: Accelerating Deep Research Agents via Du…

200 papers

Despite their strong performance on reasoning tasks, large reasoning models (LRMs) often suffer from overthinking, producing unnecessarily long outputs and incurring high end-to-end latency, a significant limitation to their real-world…

Artificial Intelligence · Computer Science 2025-10-22 Rubing Yang , Huajun Bai , Song Liu , Guanghua Yu , Runzhi Fan , Yanbin Dang , Jiejing Zhang , Kai Liu , Jianchen Zhu , Peng Chen

We present a novel computational model employing hierarchical active inference to simulate reading and eye movements. The model characterizes linguistic processing as inference over a hierarchical generative model, facilitating predictions…

Neurons and Cognition · Quantitative Biology 2025-08-11 Francesco Donnarumma , Mirco Frosolone , Giovanni Pezzulo

Speculative decoding accelerates large language model inference by using smaller draft models to generate candidate tokens for parallel verification. However, current approaches are limited by sequential stage dependencies that prevent full…

Artificial Intelligence · Computer Science 2025-05-06 Bradley McDanel , Sai Qian Zhang , Yunhai Hu , Zining Liu

Graph Retrieval-Augmented Generation (GraphRAG) enhances factual reasoning in LLMs by structurally modeling knowledge through graph-based representations. However, existing GraphRAG approaches face two core limitations: shallow retrieval…

Computation and Language · Computer Science 2025-10-01 Cehao Yang , Xiaojun Wu , Xueyuan Lin , Chengjin Xu , Xuhui Jiang , Yuanliang Sun , Jia Li , Hui Xiong , Jian Guo

Deep Research Agents generate analyst-grade reports, yet evaluating them remains challenging due to the absence of a single ground truth and the multidimensional nature of research quality. Recent benchmarks propose distinct methodologies,…

Artificial Intelligence · Computer Science 2026-02-24 Elad Ben Avraham , Changhao Li , Ron Dorfman , Roy Ganz , Oren Nuriel , Amir Dudai , Aviad Aberdam , Noah Flynn , Elman Mansimov , Adi Kalyanpur , Ron Litman

The rapid advancement of large language models has fundamentally shifted the bottleneck in AI development from computational power to data availability-with countless valuable datasets remaining hidden across specialized repositories,…

Artificial Intelligence · Computer Science 2025-08-12 Keyu Li , Mohan Jiang , Dayuan Fu , Yunze Wu , Xiangkun Hu , Dequan Wang , Pengfei Liu

Large language models (LLMs) have rapidly evolved from text generators into powerful problem solvers. Yet, many open tasks demand critical thinking, multi-source, and verifiable outputs, which are beyond single-shot prompting or standard…

Large Language Models (LLMs) have achieved significant advances in reasoning tasks. A key approach is tree-based search with verifiers, which expand candidate reasoning paths and use reward models to guide pruning and selection. Although…

Artificial Intelligence · Computer Science 2025-10-01 Yingqian Cui , Zhenwei Dai , Pengfei He , Bing He , Hui Liu , Xianfeng Tang , Jingying Zeng , Suhang Wang , Yue Xing , Jiliang Tang , Benoit Dumoulin

The rapid progress of Large Language Models (LLMs) has given rise to a new category of autonomous AI systems, referred to as Deep Research (DR) agents. These agents are designed to tackle complex, multi-turn informational research tasks by…

Artificial Intelligence · Computer Science 2025-09-04 Yuxuan Huang , Yihang Chen , Haozheng Zhang , Kang Li , Huichi Zhou , Meng Fang , Linyi Yang , Xiaoguang Li , Lifeng Shang , Songcen Xu , Jianye Hao , Kun Shao , Jun Wang

Speculative decoding has emerged as a promising approach to accelerate autoregressive inference in large language models (LLMs). Self-draft methods, which leverage the base LLM itself for speculation, avoid the overhead of auxiliary draft…

Computation and Language · Computer Science 2026-04-15 Zhuofan Wen , Yang Feng

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Artificial Intelligence · Computer Science 2025-11-05 Zhiwei Zhang , Xiaomin Li , Yudi Lin , Hui Liu , Ramraj Chandradevan , Linlin Wu , Minhua Lin , Fali Wang , Xianfeng Tang , Qi He , Suhang Wang

Recent agent frameworks and inference-time algorithms often struggle with complex planning problems due to limitations in verifying generated plans or reasoning and varying complexity of instances within a single task. Many existing methods…

We propose a method to efficiently learn diverse strategies in reinforcement learning for query reformulation in the tasks of document retrieval and question answering. In the proposed framework an agent consists of multiple specialized…

Machine Learning · Computer Science 2018-12-27 Rodrigo Nogueira , Jannis Bulian , Massimiliano Ciaramita

Deep research, in which an agent searches the open web, collects evidence, and derives an answer through extended reasoning, is a prominent use case for frontier language models. Frontier deep research products score high on existing…

Artificial Intelligence · Computer Science 2026-05-21 Sixiong Xie , Zhuofan Shi , Haiyang Shen , Jiuzheng Wang , Siqi Zhong , Mugeng Liu , Chongyang Pan , Peilun Jia , Baoqing Sun , Xiang Jing , Yun Ma

Speculative decoding (SD) has become a popular technique to accelerate Large Language Model (LLM) inference, yet its real-world effectiveness remains unclear as prior evaluations rely on research prototypes and unrealistically small batch…

Computation and Language · Computer Science 2026-03-19 Xiaoxuan Liu , Jiaxiang Yu , Jongseok Park , Ion Stoica , Alvin Cheung

Edge computing breaks with traditional autoscaling due to strict resource constraints, thus, motivating more flexible scaling behaviors using multiple elasticity dimensions. This work introduces an agent-based autoscaling framework that…

Artificial Intelligence · Computer Science 2026-01-13 Boris Sedlak , Alireza Furutanpey , Zihang Wang , Víctor Casamayor Pujol , Schahram Dustdar

We present Dingtalk DeepResearch, a unified multi agent intelligence framework for real world enterprise environments, delivering deep research, heterogeneous table reasoning, and multimodal report generation.

Computation and Language · Computer Science 2025-10-30 Mengyuan Chen , Chengjun Dai , Xinyang Dong , Chengzhe Feng , Kewei Fu , Jianshe Li , Zhihan Peng , Yongqi Tong , Junshao Zhang , Hong Zhu

Large Language Models (LLMs) have shown remarkable reasoning capabilities in mathematical and scientific tasks. To enhance complex reasoning, multi-agent systems have been proposed to harness the collective intelligence of LLM agents.…

Artificial Intelligence · Computer Science 2025-10-22 Zhenyu Bi , Meng Lu , Yang Li , Swastik Roy , Weijie Guan , Morteza Ziyadi , Xuan Wang

We introduce DRBench, a benchmark for evaluating AI agents on complex, open-ended deep research tasks in enterprise settings. Unlike prior benchmarks that focus on simple questions or web-only queries, DRBench evaluates agents on multi-step…

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song