English
Related papers

Related papers: RE-TRAC: REcursive TRAjectory Compression for Deep…

200 papers

Recent years, multimodal models have made remarkable strides and pave the way for intelligent browser use agents. However, when solving tasks on real world webpages in multi-turn, long-horizon trajectories, current agents still suffer from…

Artificial Intelligence · Computer Science 2025-09-26 Kaiwen He , Zhiwei Wang , Chenyi Zhuang , Jinjie Gu

Large transformer models powered by diverse data and model scale have dominated natural language modeling and computer vision and pushed the frontier of multiple AI areas. In reinforcement learning (RL), despite many efforts into…

Machine Learning · Computer Science 2023-05-29 Hao Liu , Pieter Abbeel

While large language models (LLMs) have advanced the development of general-purpose agents, achieving robust generalization to unseen tasks remains a significant challenge. Current approaches typically rely on either fine-tuning or…

Artificial Intelligence · Computer Science 2026-03-20 Thomas Palmeira Ferraz , Romain Deffayet , Vassilina Nikoulina , Hervé Déjean , Stéphane Clinchant

Large language model agents are becoming increasingly capable at web-centric tasks such as information retrieval, complex reasoning. These emerging capabilities have given rise to surge research interests in developing LLM agent for…

Computation and Language · Computer Science 2026-04-02 Yu Li , Lehui Li , Lin Chen , Qingmin Liao , Fengli Xu , Yong Li

Long-horizon agentic search requires iteratively exploring the web over long trajectories and synthesizing information across many sources, and is the foundation for enabling powerful applications like deep research systems. In this work,…

Computation and Language · Computer Science 2025-10-23 Howard Yen , Ashwin Paranjape , Mengzhou Xia , Thejas Venkatesh , Jack Hessel , Danqi Chen , Yuhao Zhang

The hallucinations of large language models (LLMs) are increasingly mitigated by allowing LLMs to search for information and to ground their answers in real sources. Unfortunately, LLMs often struggle with posing the right search queries,…

Machine Learning · Computer Science 2024-11-01 Sheryl Hsu , Omar Khattab , Chelsea Finn , Archit Sharma

Sensemaking report writing often requires multiple refinements in the iterative process. While Large Language Models (LLMs) have shown promise in generating initial reports based on human visual workspace representations, they struggle to…

Human-Computer Interaction · Computer Science 2025-10-03 Xuxin Tang , Rehema Abulikemu , Eric Krokos , Kirsten Whitley , Xuan Wang , Chris North

LLM-powered search agents are increasingly being used for multi-step information seeking tasks, yet the IR community lacks empirical understanding of how agentic search sessions unfold and how retrieved evidence is reflected in later…

Information Retrieval · Computer Science 2026-04-30 Jingjie Ning , João Coelho , Yibo Kong , Yunfan Long , Bruno Martins , João Magalhães , Jamie Callan , Chenyan Xiong

This technical report details a novel approach to combining reasoning and retrieval augmented generation (RAG) within a single, lean language model architecture. While existing RAG systems typically rely on large-scale models and external…

Large Language Models (LLMs) have achieved impressive progress in natural language processing, but their limited ability to retain long-term context constrains performance on document-level or multi-turn tasks. Retrieval-Augmented…

Computation and Language · Computer Science 2025-05-20 Zhangyu Wang , Siyuan Gao , Rong Zhou , Hao Wang , Li Ning

Answering complex natural language questions often necessitates multi-step reasoning and integrating external information. Several systems have combined knowledge retrieval with a large language model (LLM) to answer such questions. These…

In the past year, large language models (LLMs) have had remarkable success in domains outside the traditional natural language processing, and their capacity is further expanded into the so-called LLM agents when connected with external…

Computation and Language · Computer Science 2025-02-17 Weizhe Chen , Sven Koenig , Bistra Dilkina

Long-horizon tasks requiring multi-step reasoning and dynamic re-planning remain challenging for large language models (LLMs). Sequential prompting methods are prone to context drift, loss of goal information, and recurrent failure cycles,…

Artificial Intelligence · Computer Science 2025-10-30 Zhenyu Zhang , Tianyi Chen , Weiran Xu , Alex Pentland , Jiaxin Pei

Deep Research (DR) agents extend Large Language Models (LLMs) beyond parametric knowledge by autonomously retrieving and synthesizing evidence from large web corpora into long-form reports, enabling a long-horizon agentic paradigm. However,…

Artificial Intelligence · Computer Science 2026-02-04 Haohao Luo , Zexi Li , Yuexiang Xie , Wenhao Zhang , Yaliang Li , Ying Shen

Agents have demonstrated their potential in scientific reasoning tasks through large language models. However, they often face challenges such as insufficient accuracy and degeneration of thought when handling complex reasoning tasks, which…

Computation and Language · Computer Science 2025-01-06 Chengbo He , Bochao Zou , Xin Li , Jiansheng Chen , Junliang Xing , Huimin Ma

While Retrieval-Augmented Generation (RAG) has proven effective for generating accurate, context-based responses based on existing knowledge bases, it presents several challenges including retrieval quality dependencies, integration…

Information Retrieval · Computer Science 2026-03-02 Shreyas Subramanian , Adewale Akinfaderin , Yanyan Zhang , Ishan Singh , Mani Khanuja , Sandeep Singh , Maira Ladeira Tanke

Retrieval-Augmented Generation (RAG) systems have emerged as a promising solution to enhance large language models (LLMs) by integrating external knowledge retrieval with generative capabilities. While significant advancements have been…

Human-Computer Interaction · Computer Science 2025-08-11 Sizhe Cheng , Jiaping Li , Huanchen Wang , Yuxin Ma

Multi-trajectory inference for tool-use LLM agents - generating multiple reasoning attempts and selecting among them - benefits from transferring knowledge across attempts so that later ones avoid the pitfalls of earlier ones. Existing…

Artificial Intelligence · Computer Science 2026-05-28 Xinzhe Li , Yaguang Tao

Large Language Models (LLMs) have shown remarkable performance on general Question Answering (QA), yet they often struggle in domain-specific scenarios where accurate and up-to-date information is required. Retrieval-Augmented Generation…

Computation and Language · Computer Science 2026-02-13 Haoyue Bai , Haoyu Wang , Shengyu Chen , Zhengzhang Chen , Lu-An Tang , Wei Cheng , Haifeng Chen , Yanjie Fu

Web agents powered by Large Language Models (LLMs) show promise for next-generation AI, but their limited reasoning in uncertain, dynamic web environments hinders robust deployment. In this paper, we identify key reasoning skills essential…

Computation and Language · Computer Science 2025-09-19 Minda Hu , Tianqing Fang , Jianshu Zhang , Junyu Ma , Zhisong Zhang , Jingyan Zhou , Hongming Zhang , Haitao Mi , Dong Yu , Irwin King