English
Related papers

Related papers: DualSpec: Accelerating Deep Research Agents via Du…

200 papers

Although Reinforcement Learning (RL) agents are effective in well-defined environments, they often struggle to generalize their learned policies to dynamic settings due to their reliance on trial-and-error interactions. Recent work has…

Machine Learning · Computer Science 2025-08-26 Zhihao Dou , Dongfei Cui , Jun Yan , Weida Wang , Benteng Chen , Haoming Wang , Zeke Xie , Shufei Zhang

Large language models are evolving from single-turn responders into tool-using agents capable of sustained reasoning and decision-making for deep research. Prevailing systems adopt a linear pipeline of plan to search to write to a report,…

Computation and Language · Computer Science 2025-11-25 Yu Lei , Shuzheng Si , Wei Wang , Yifei Wu , Gang Chen , Fanchao Qi , Maosong Sun

Recent search-augmented LLMs trained with reinforcement learning (RL) can interleave searching and reasoning for multi-hop reasoning tasks. However, they face two critical failure modes as the accumulating context becomes flooded with both…

Computation and Language · Computer Science 2026-01-14 Kangcheng Luo , Tinglang Wu , Yansong Feng

Retrieval-augmented language models (RaLM) have demonstrated the potential to solve knowledge-intensive natural language processing (NLP) tasks by combining a non-parametric knowledge base with a parametric language model. Instead of…

Machine Learning · Computer Science 2024-01-26 Zhihao Zhang , Alan Zhu , Lijie Yang , Yihua Xu , Lanting Li , Phitchaya Mangpo Phothilimthana , Zhihao Jia

Recent agentic search systems have made substantial progress by emphasising deep, multi-step reasoning. However, this focus often overlooks the challenges of wide-scale information synthesis, where agents must aggregate large volumes of…

Artificial Intelligence · Computer Science 2026-04-06 Ka Yiu Lee , Yuxuan Huang , Zhiyuan He , Huichi Zhou , Weilin Luo , Kun Shao , Meng Fang , Jun Wang

Speculative decoding is commonly used for reducing the inference latency of large language models. Its effectiveness depends highly on the speculation lookahead (SL)-the number of tokens generated by the draft model at each iteration. In…

Computation and Language · Computer Science 2024-11-08 Jonathan Mamou , Oren Pereg , Daniel Korat , Moshe Berchansky , Nadav Timor , Moshe Wasserblat , Roy Schwartz

Deep research systems are widely used for multi-step web research, analysis, and cross-source synthesis, yet their evaluation remains challenging. Existing benchmarks often require annotation-intensive task construction, rely on static…

Computation and Language · Computer Science 2026-01-15 Yibo Wang , Lei Wang , Yue Deng , Keming Wu , Yao Xiao , Huanjin Yao , Liwei Kang , Hai Ye , Yongcheng Jing , Lidong Bing

Despite the integration of search tools, Deep Search Agents often suffer from a misalignment between reasoning-driven queries and the underlying web indexing structures. Existing frameworks treat the search engine as a static utility,…

Machine Learning · Computer Science 2026-03-10 Zixuan Yu , Zhenheng Tang , Tongliang Liu , Chengqi Zhang , Xiaowen Chu , Bo Han

Although deep learning models perform remarkably well across a range of tasks such as language translation and object recognition, it remains unclear what high-level logic, if any, they follow. Understanding this logic may lead to more…

Databases · Computer Science 2019-01-08 Thibault Sellam , Kevin Lin , Ian Yiran Huang , Yiru Chen , Michelle Yang , Carl Vondrick , Eugene Wu

Research has shown the effectiveness of reasoning (e.g., Chain-of-Thought), planning (e.g., SelfAsk), and retrieval augmented generation strategies to improve the performance of Large Language Models (LLMs) on various tasks, such as…

Computation and Language · Computer Science 2025-02-11 Tanmay Parekh , Pradyot Prakash , Alexander Radovic , Akshay Shekher , Denis Savenkov

Despite their impressive capabilities, large language models (LLMs) often face challenges such as temporal misalignment and generating hallucinatory content. Enhancing LLMs with retrieval mechanisms to fetch relevant information from…

Computation and Language · Computer Science 2024-06-21 Yige Shen , Hao Jiang , Hua Qu , Jihong Zhao

Deep Research agents tackle knowledge-intensive tasks through multi-round retrieval and decision-oriented generation. While reinforcement learning (RL) has been shown to improve performance in this paradigm, its contributions remain…

Computation and Language · Computer Science 2026-02-24 Yinuo Xu , Shuo Lu , Jianjie Cheng , Meng Wang , Qianlong Xie , Xingxing Wang , Ran He , Jian Liang

While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and…

Computation and Language · Computer Science 2025-10-14 Jialu Du , Guiyang Hou , Yihui Fu , Chen Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu

Agentic Retrieval-Augmented Generation (RAG) systems enhance Large Language Models (LLMs) by enabling dynamic, multi-step reasoning and information retrieval. However, these systems often exhibit sub-optimal search behaviors like…

Computation and Language · Computer Science 2025-10-10 Peilin Wu , Mian Zhang , Xinlu Zhang , Xinya Du , Zhiyu Zoey Chen

Multi-agent debates have been introduced to improve the accuracy of Large Language Models (LLMs) by having multiple agents discuss solutions to a problem over several rounds of debate. However, models often generate incorrect yet…

Computation and Language · Computer Science 2025-02-25 Luke Yoffe , Alfonso Amayuelas , William Yang Wang

Agentic search such as Deep Research systems-where agents autonomously browse the web, synthesize information, and return comprehensive citation-backed answers-represents a major shift in how users interact with web-scale information. While…

The rapid advancement of large language models (LLMs) has driven the development of agentic systems capable of autonomously performing complex tasks. Despite their impressive capabilities, LLMs remain constrained by their internal knowledge…

Information Retrieval · Computer Science 2025-08-19 Wenlin Zhang , Xiaopeng Li , Yingyi Zhang , Pengyue Jia , Yichao Wang , Huifeng Guo , Yong Liu , Xiangyu Zhao

Agentic reinforcement learning (RL) holds great promise for the development of autonomous agents under complex GUI tasks, but its scalability remains severely hampered by the verification of task completion. Existing task verification is…

Computation and Language · Computer Science 2026-01-07 Shaofei Cai , Yulei Qin , Haojia Lin , Zihan Xu , Gang Li , Yuchen Shi , Zongyi Li , Yong Mao , Siqi Cai , Xiaoyu Tan , Yitao Liang , Ke Li , Xing Sun

Recently, large reasoning models have demonstrated strong mathematical and coding abilities, and deep search leverages their reasoning capabilities in challenging information retrieval tasks. Existing deep search works are generally limited…

Information Retrieval · Computer Science 2025-08-12 Jiejun Tan , Zhicheng Dou , Yan Yu , Jiehan Cheng , Qiang Ju , Jian Xie , Ji-Rong Wen

Speculative decoding is widely adopted to reduce latency in large language model (LLM) inference by leveraging smaller draft models capable of handling diverse user tasks. However, emerging AI applications, such as LLM-based agents, present…

Computation and Language · Computer Science 2025-10-09 Gabriele Oliaro , Zhihao Jia , Daniel Campos , Aurick Qiao
‹ Prev 1 3 4 5 6 7 10 Next ›