English
Related papers

Related papers: DeepImageSearch: Benchmarking Multimodal Agents fo…

200 papers

Modern retrieval systems, whether lexical or semantic, expose a corpus through a fixed similarity interface that compresses access into a single top-k retrieval step before reasoning. This abstraction is efficient, but for agentic search,…

Existing benchmarks for multimodal memory reasoning largely evaluate systems within pre-assembled contexts, but under-evaluate whether agents can use evidence distributed across independently originated sources. We argue that…

Computation and Language · Computer Science 2026-05-18 Huacan Chai , Yukai Wang , Yingxuan Yang , Dan Peng , Yuanyi Song , Zhihui Fu , Weiwen Liu , Jianghao Lin , Jun Wang , Weinan Zhang

Multi-step agentic retrieval systems based on large language models (LLMs) have demonstrated remarkable performance in complex information search tasks. However, these systems still face significant challenges in practical applications,…

Machine Learning · Computer Science 2025-10-16 Chuzhan Hao , Wenfeng Feng , Yuewei Zhang , Hao Wang

Multimodal large language models (MLLMs) have achieved remarkable success across a broad range of vision tasks. However, constrained by the capacity of their internal world knowledge, prior work has proposed augmenting MLLMs by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Wenxuan Huang , Yu Zeng , Qiuchen Wang , Zhen Fang , Shaosheng Cao , Zheng Chu , Qingyu Yin , Shuang Chen , Zhenfei Yin , Lin Chen , Zehui Chen , Xu Tang , Yao Hu , Shaohui Lin , Philip Torr , Feng Zhao , Wanli Ouyang

Video generation models have achieved remarkable progress, particularly excelling in realistic scenarios; however, their performance degrades notably in imaginative scenarios. These prompts often involve rarely co-occurring concepts with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Meiqi Wu , Jiashu Zhu , Xiaokun Feng , Chubin Chen , Chen Zhu , Bingze Song , Fangyuan Mao , Jiahong Wu , Xiangxiang Chu , Kaiqi Huang

Top-down images play an important role in safety-critical settings such as autonomous navigation and aerial surveillance, where they provide holistic spatial information that front-view images cannot capture. Despite this, Vision Language…

Machine Learning · Computer Science 2025-10-02 Kaiyuan Hou , Minghui Zhao , Lilin Xu , Yuang Fan , Xiaofan Jiang

Multimodal deep search requires an agent to solve open-world problems by chaining search, tool use, and visual reasoning over evolving textual and visual context. Two bottlenecks limit current systems. First, existing tool-use harnesses…

Computation and Language · Computer Science 2026-05-12 Shijue Huang , Hangyu Guo , Chenxin Li , Junting Lu , Xinyu Geng , Zhaochen Su , Zhenyu Li , Shuang Chen , Hongru Wang , Yi R. Fung

Image fusion plays a key role in a variety of multi-sensor-based vision systems, especially for enhancing visual quality and/or extracting aggregated features for perception. However, most existing methods just consider image fusion as an…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Risheng Liu , Zhu Liu , Jinyuan Liu , Xin Fan , Zhongxuan Luo

The rapid advancement of large language models (LLMs) has driven the development of agentic systems capable of autonomously performing complex tasks. Despite their impressive capabilities, LLMs remain constrained by their internal knowledge…

Information Retrieval · Computer Science 2025-08-19 Wenlin Zhang , Xiaopeng Li , Yingyi Zhang , Pengyue Jia , Yichao Wang , Huifeng Guo , Yong Liu , Xiangyu Zhao

Built on the power of LLMs, numerous multimodal large language models (MLLMs) have recently achieved remarkable performance on various vision-language tasks. However, most existing MLLMs and benchmarks primarily focus on single-image input…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Haowei Liu , Xi Zhang , Haiyang Xu , Yaya Shi , Chaoya Jiang , Ming Yan , Ji Zhang , Fei Huang , Chunfeng Yuan , Bing Li , Weiming Hu

Autonomous agents capable of planning, reasoning, and executing actions on the web offer a promising avenue for automating computer tasks. However, the majority of existing benchmarks primarily focus on text-based agents, neglecting many…

We present a new benchmark for evaluating Deep Search--a realistic and complex form of retrieval-augmented generation (RAG) that requires source-aware, multi-hop reasoning over diverse, sparsed, but related sources. These include documents,…

Computation and Language · Computer Science 2025-07-01 Prafulla Kumar Choubey , Xiangyu Peng , Shilpa Bhagavath , Kung-Hsiang Huang , Caiming Xiong , Chien-Sheng Wu

AI agents are changing the requirements for document parsing. What matters is semantic correctness: parsed output must preserve the structure and meaning needed for autonomous decisions, including correct table structure, precise chart…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Boyang Zhang , Sebastián G. Acosta , Preston Carlson , Sacha Bron , Pierre-Loïc Doulcet , Daniel B. Ospina , Simon Suo

Recent agentic search systems have made substantial progress by emphasising deep, multi-step reasoning. However, this focus often overlooks the challenges of wide-scale information synthesis, where agents must aggregate large volumes of…

Artificial Intelligence · Computer Science 2026-04-06 Ka Yiu Lee , Yuxuan Huang , Zhiyuan He , Huichi Zhou , Weilin Luo , Kun Shao , Meng Fang , Jun Wang

The ability to distinguish whether an image is generated by artificial intelligence (AI) is a crucial ingredient in human intelligence, usually accompanied by a complex and dialectical forensic and reasoning process. However, current fake…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yixuan Li , Xuelin Liu , Xiaoyang Wang , Bu Sung Lee , Shiqi Wang , Anderson Rocha , Weisi Lin

Video agentic models have advanced challenging video-language tasks. However, most agentic approaches still heavily rely on greedy parsing over densely sampled video frames, resulting in high computational cost. We present VideoSeek, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jingyang Lin , Jialian Wu , Jiang Liu , Ximeng Sun , Ze Wang , Xiaodong Yu , Jiebo Luo , Zicheng Liu , Emad Barsoum

Most organizational data in this world are stored as documents, and visual retrieval plays a crucial role in unlocking the collective intelligence from all these documents. However, existing benchmarks focus on English-only document…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jian Chen , Ming Li , Jihyung Kil , Chenguang Wang , Tong Yu , Ryan Rossi , Tianyi Zhou , Changyou Chen , Ruiyi Zhang

Modern video understanding systems excel at tasks such as scene classification, object detection, and short video retrieval. However, as video analysis becomes increasingly central to real-world applications, there is a growing need for…

Artificial Intelligence · Computer Science 2025-05-21 Sahil Shah , Harsh Goel , Sai Shankar Narasimhan , Minkyu Choi , S P Sharan , Oguzhan Akcin , Sandeep Chinchali

Innovation in nanophotonics currently relies on human experts who synergize specialized knowledge in photonics and coding with simulation and optimization algorithms, entailing design cycles that are time-consuming, computationally…

Applied Physics · Physics 2025-03-27 Robert Lupoiu , Yixuan Shao , Tianxiang Dai , Chenkai Mao , Kofi Edee , Jonathan A. Fan

The advent of Deep Research agents has substantially reduced the time required for conducting extensive research tasks. However, these tasks inherently demand rigorous standards of factual accuracy and comprehensiveness, necessitating…

Computation and Language · Computer Science 2025-08-25 Minghao Li , Ying Zeng , Zhihao Cheng , Cong Ma , Kai Jia