English
Related papers

Related papers: DeepImageSearch: Benchmarking Multimodal Agents fo…

200 papers

Making image retrieval methods practical for real-world search applications requires significant progress in dataset scales, entity comprehension, and multimodal information fusion. In this work, we introduce \textbf{E}ntity-\textbf{D}riven…

Computation and Language · Computer Science 2023-10-24 Siqi Liu , Weixi Feng , Tsu-jui Fu , Wenhu Chen , William Yang Wang

Early artificial intelligence paradigms exhibited separated cognitive functions: Neural Networks focused on "perception-representation," Reinforcement Learning on "decision-making-behavior," and Symbolic AI on "knowledge-reasoning." With…

Artificial Intelligence · Computer Science 2026-01-07 Zhi Liu , Guangzhi Wang

One of the primary challenges faced by deep learning is the degree to which current methods exploit superficial statistics and dataset bias, rather than learning to generalise over the specific representations they have experienced. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Damien Teney , Peng Wang , Jiewei Cao , Lingqiao Liu , Chunhua Shen , Anton van den Hengel

Large language models are transitioning from generalpurpose knowledge engines to realworld problem solvers, yet optimizing them for deep search tasks remains challenging. The central bottleneck lies in the extreme sparsity of highquality…

Artificial Intelligence · Computer Science 2026-02-17 Zheng Chu , Xiao Wang , Jack Hong , Huiming Fan , Yuqi Huang , Yue Yang , Guohai Xu , Chenxiao Zhao , Cheng Xiang , Shengchao Hu , Dongdong Kuang , Ming Liu , Bing Qin , Xing Yu

Situated dialogue requires speakers to maintain a reliable representation of shared context rather than reasoning only over isolated utterances. Current conversational agents often struggle with this requirement, especially when the common…

Computation and Language · Computer Science 2026-04-24 Biswesh Mohapatra , Giovanni Duca , Laurent Romary , Justine Cassell

Long-form video understanding presents significant challenges due to extensive temporal-spatial complexity and the difficulty of question answering under such extended contexts. While Large Language Models (LLMs) have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xiaoyi Zhang , Zhaoyang Jia , Zongyu Guo , Jiahao Li , Bin Li , Houqiang Li , Yan Lu

As agentic AI systems increasingly operate autonomously, establishing trust through verifiable evaluation becomes critical. Yet existing benchmarks lack the transparency and auditability needed to assess whether agents behave reliably. We…

Computation and Language · Computer Science 2025-12-02 Hyunjun Kim , Sooyoung Ryu

Knowledge-based visual question answering (KB-VQA) requires vision-language models to understand images and use external knowledge, especially for rare entities and long-tail facts. Most existing retrieval-augmented generation (RAG) methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Zhuohong Chen , Zhenxian Wu , Yunyao Yu , Hangrui Xu , Zirui Liao , Zhifang Liu , Xiangwen Deng , Pen Jiao , Haoqian Wang

Multimodal Large Language Models (MLLMs) in real-world applications require access to external knowledge sources and must remain responsive to the dynamic and ever-changing real-world information in order to address information-seeking and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Kartik Narayan , Yang Xu , Tian Cao , Kavya Nerella , Vishal M. Patel , Navid Shiee , Peter Grasch , Chao Jia , Yinfei Yang , Zhe Gan

Evaluating diffusion-based image-editing models is a crucial task in the field of Generative AI. Specifically, it is imperative to assess their capacity to execute diverse editing tasks while preserving the image content and realism. While…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Stefan Stefanache , Lluís Pastor Pérez , Julen Costa Watanabe , Ernesto Sanchez Tejedor , Thomas Hofmann , Enis Simsar

Recent benchmarks for Large Language Model (LLM) agents mainly evaluate reasoning, planning, and execution. However, memory is also essential for agents, as it enables them to store, update, and retrieve information over time. This ability…

Computation and Language · Computer Science 2026-05-19 Yuyao Wang , Zhongjian Zhang , Mo Chi , Kaichi Yu , Yuhan Li , Miao Peng , Bing Tong , Chen Zhang , Yan Zhou , Jia Li

With the prolification of multimodal interaction in various domains, recently there has been much interest in text based image retrieval in the computer vision community. However most of the state of the art techniques model this problem in…

Artificial Intelligence · Computer Science 2019-11-05 Sahana Ramnath , Amrita Saha , Soumen Chakrabarti , Mitesh M. Khapra

The content based image retrieval aims to find the similar images from a large scale dataset against a query image. Generally, the similarity between the representative features of the query image and dataset images is used to rank the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Shiv Ram Dubey

We aim to develop a multimodal research agent capable of explicit reasoning and planning, multi-tool invocation, and cross-modal information synthesis, enabling it to conduct deep research tasks. However, we observe three main challenges in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Huanjin Yao , Qixiang Yin , Min Yang , Ziwang Zhao , Yibo Wang , Haotian Luo , Jingyi Zhang , Jiaxing Huang

Large Language Models (LLMs)-based agents have made impressive progress in reasoning and tool use, enabling them to solve complex tasks. However, their ability to proactively collaborate with users, especially when goals are vague,…

While recent advances in reasoning models have demonstrated cognitive behaviors through reinforcement learning, existing approaches struggle to invoke deep reasoning capabilities in multi-turn agents with long-horizon interactions. We…

Computation and Language · Computer Science 2025-10-10 Qiaoyu Tang , Hao Xiang , Le Yu , Bowen Yu , Yaojie Lu , Xianpei Han , Le Sun , WenJuan Zhang , Pengbo Wang , Shixuan Liu , Zhenru Zhang , Jianhong Tu , Hongyu Lin , Junyang Lin

Agentic multimodal models have garnered significant attention for their ability to leverage external tools to tackle complex tasks. However, it is observed that such agents often meet premature interaction collapse, caused by two primary…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Shengqin Wang , Wentao Yan , Huichi Zhou , Yihang Chen , Kun Shao , Zhizhong Zhang , Yuan Xie

To tackle long-context reasoning tasks without the quadratic complexity of standard attention mechanisms, approaches based on agent memory have emerged, which typically maintain a dynamically updated memory when linearly processing document…

Computation and Language · Computer Science 2026-05-12 Baibei Ji , Xiaoyang Weng , Juntao Li , Zecheng Tang , Yihang Lou , Min Zhang

Multimodal Large Language Models are primarily trained and evaluated on aligned image-text pairs, which leaves their ability to detect and resolve real-world inconsistencies largely unexplored. In open-domain applications visual and textual…

Visual perception connects high-level semantic understanding to pixel-level perception, but most existing settings assume that the decisive evidence for identifying a target is already in the image or frozen model knowledge. We study a more…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Bokang Yang , Xinyi Sun , Kaituo Feng , Xingping Dong , Dongming Wu , Xiangyu Yue