English
Related papers

Related papers: M$^3$Searcher: Modular Multimodal Information Seek…

200 papers

Engineering rulebooks and technical standards contain multimodal information like dense text, tables, and illustrations that are challenging for retrieval augmented generation (RAG) systems. Building upon the DesignQA framework [1], which…

Information Retrieval · Computer Science 2026-05-28 Kiarash Naghavi Khanghah , Hoang Anh Nguyen , Anna C. Doris , Amir Mohammad Vahedi , Daniele Grandi , Faez Ahmed , Hongyi Xu

Omnimodal understanding entails a massive, highly redundant search space of cross-modal interactions, demanding focused and deliberative reasoning. Current reasoning paradigms rely on either sequential step-by-step generation or parallel…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zhicheng Zhang , Wentao Gu , Weicheng Wang , Yongjie Zhu , Wenyu Qin , Meng Wang , Pengfei Wan , Jufeng Yang

Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models improve LLM performance in multi-hop QA tasks, which require…

Computation and Language · Computer Science 2026-01-21 Guo Chen , Junjie Huang , Huaijin Xie , Fei Sun , Tao Jia

Agentic search has recently emerged as a powerful paradigm, where an agent interleaves multi-step reasoning with on-demand retrieval to solve complex questions. Despite its success, how to design a retriever for agentic search remains…

Information Retrieval · Computer Science 2026-01-22 Wenhan Liu , Xinyu Ma , Yutao Zhu , Yuchen Li , Daiting Shi , Dawei Yin , Zhicheng Dou

Vision-centric retrieval for VQA requires retrieving images to supply missing visual cues and integrating them into the reasoning process. However, selecting the right images and integrating them effectively into the model's reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Zhuohong Chen , Zhengxian Wu , Zirui Liao , Shenao Jiang , Hangrui Xu , Yang Chen , Chaokui Su , Xiaoyu Liu , Haoqian Wang

In search scenarios, user experience can be hindered by erroneous queries due to typos, voice errors, or knowledge gaps. Therefore, query correction is crucial for search engines. Current correction models, usually small models trained on…

Computation and Language · Computer Science 2024-12-18 Kepu Zhang , Zhongxiang Sun , Xiao Zhang , Xiaoxue Zang , Kai Zheng , Yang Song , Jun Xu

Despite recent progress in multimodal agentic systems, existing approaches often treat image manipulation and web search as disjoint capabilities, rely heavily on costly reinforcement learning, and lack planning grounded in real…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yifan Zhang , Liang Hu , Haofeng Sun , Peiyu Wang , Yichen Wei , Shukang Yin , Jiangbo Pei , Wei Shen , Peng Xia , Yi Peng , Tianyidan Xie , Eric Li , Yang Liu , Xuchen Song , Yahui Zhou

Large Language Models (LLMs) have shown remarkable capabilities in reasoning, exemplified by the success of OpenAI-o1 and DeepSeek-R1. However, integrating reasoning with external search processes remains challenging, especially for complex…

Contemporary large language model (LLM)-based multi-agent systems exhibit systematic advantages in deep research tasks, which emphasize iterative, vertically structured information seeking. However, when confronted with wide search tasks…

Multiagent Systems · Computer Science 2026-02-03 Mingju Chen , Guibin Zhang , Heng Chang , Yuchen Guo , Shiji Zhou

Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical…

Computation and Language · Computer Science 2025-10-09 Shuang Sun , Huatong Song , Yuhao Wang , Ruiyang Ren , Jinhao Jiang , Junjie Zhang , Fei Bai , Jia Deng , Wayne Xin Zhao , Zheng Liu , Lei Fang , Zhongyuan Wang , Ji-Rong Wen

Recent advancements in retrieval-augmented generation (RAG) have demonstrated impressive performance in the question-answering (QA) task. However, most previous works predominantly focus on text-based answers. While some studies address…

Information Retrieval · Computer Science 2025-02-10 Zhengyuan Zhu , Daniel Lee , Hong Zhang , Sai Sree Harsha , Loic Feujio , Akash Maharaj , Yunyao Li

While Retrieval-Augmented Generation (RAG) augments Large Language Models (LLMs) with external knowledge, conventional single-agent RAG remains fundamentally limited in resolving complex queries demanding coordinated reasoning across…

Computation and Language · Computer Science 2025-04-18 Pei Liu , Xin Liu , Ruoyu Yao , Junming Liu , Siyuan Meng , Ding Wang , Jun Ma

Tool learning with foundation models aims to endow AI systems with the ability to invoke external resources -- such as APIs, computational utilities, and specialized models -- to solve complex tasks beyond the reach of standalone language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Gabriele Mattioli , Evelyn Turri , Sara Sarto , Lorenzo Baraldi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Document Question Answering (DocQA) focuses on answering questions grounded in given documents, yet existing DocQA agents lack effective tool utilization and largely rely on closed-source models. In this work, we introduce DocDancer, an…

Computation and Language · Computer Science 2026-01-09 Qintong Zhang , Xinjie Lv , Jialong Wu , Baixuan Li , Zhengwei Tao , Guochen Yan , Huanyao Zhang , Bin Wang , Jiahao Xu , Haitao Mi , Wentao Zhang

Search agents have achieved significant advancements in enabling intelligent information retrieval and decision-making within interactive environments. Although reinforcement learning has been employed to train agentic models capable of…

Computation and Language · Computer Science 2025-10-22 Guanzhong He , Zhen Yang , Jinxin Liu , Bin Xu , Lei Hou , Juanzi Li

Most of the prior work on multi-agent reinforcement learning (MARL) achieves optimal collaboration by directly controlling the agents to maximize a common reward. In this paper, we aim to address this from a different angle. In particular,…

Artificial Intelligence · Computer Science 2019-03-08 Tianmin Shu , Yuandong Tian

DeepSearch paradigms have become a core enabler for deep reasoning models, allowing them to invoke external search tools to access up-to-date, domain-specific knowledge beyond parametric boundaries, thereby enhancing the depth and factual…

Artificial Intelligence · Computer Science 2025-12-11 Hengzhi Lan , Yue Yu , Li Qian , Li Peng , Jie Wu , Wei Liu , Jian Luan , Ting Bai

We present MiroThinker-1.7, a new research agent designed for complex long-horizon reasoning tasks. Building on this foundation, we further introduce MiroThinker-H1, which extends the agent with heavy-duty reasoning capabilities for more…

Query expansion is widely used in Information Retrieval (IR) to improve search outcomes by supplementing initial queries with richer information. While recent Large Language Model (LLM) based methods generate pseudo-relevant content and…

Information Retrieval · Computer Science 2025-08-15 Wonduk Seo , Hyunjin An , Seunghyun Lee

Recent agentic search frameworks enable deep research via iterative planning and retrieval, reducing hallucinations and enhancing factual grounding. However, they remain text-centric, overlooking the multimodal evidence that characterizes…

Computation and Language · Computer Science 2026-04-21 Fangda Ye , Zhifei Xie , Yuxin Hu , Yihang Yin , Shurui Huang , Shikai Dong , Jianzhu Bao , Shuicheng Yan