English
Related papers

Related papers: BrowseComp-$V^3$: A Visual, Vertical, and Verifiab…

200 papers

AI agents with advanced reasoning and tool use capabilities have demonstrated impressive performance in web browsing for deep search. While existing benchmarks such as BrowseComp evaluate these browsing abilities, they primarily focus on…

The rapid advancement of Multimodal Large Language Models (MLLMs) has enabled browsing agents to acquire and reason over multimodal information in the real world. But existing benchmarks suffer from two limitations: insufficient evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zhengbo Zhang , Jinbo Su , Zhaowen Zhou , Changtao Miao , Yuhan Hong , Qimeng Wu , Yumeng Liu , Feier Wu , Yihe Tian , Yuhao Liang , Zitong Shan , Wanke Xia , Yi-Fan Zhang , Bo Zhang , Zhe Li , Shiming Xiang , Ying Yan

We present M$^3$-VQA, a novel knowledge-based Visual Question Answering (VQA) benchmark, to enhance the evaluation of multimodal large language models (MLLMs) in fine-grained multimodal entity understanding and complex multi-hop reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jiatong Ma , Longteng Guo , Yuchen Liu , Zijia Zhao , Dongze Hao , Xuanxu Lin , Jing Liu

Multimodal Large Language Models (MLLMs) have advanced VQA and now support Vision-DeepResearch systems that use search engines for complex visual-textual fact-finding. However, evaluating these visual and textual search abilities is still…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yu Zeng , Wenxuan Huang , Zhen Fang , Shuang Chen , Yufan Shen , Yishuo Cai , Xiaoman Wang , Zhenfei Yin , Lin Chen , Zehui Chen , Shiting Huang , Yiming Zhao , Xu Tang , Yao Hu , Philip Torr , Wanli Ouyang , Shaosheng Cao

The ability for AI agents to "think with images" requires a sophisticated blend of reasoning and perception. However, current open multimodal agents still largely fall short on the reasoning aspect crucial for real-world tasks like…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Kaican Li , Lewei Yao , Jiannan Wu , Tiezheng Yu , Jierun Chen , Haoli Bai , Lu Hou , Lanqing Hong , Wei Zhang , Nevin L. Zhang

Web agents such as Deep Research have demonstrated superhuman cognitive abilities, capable of solving highly challenging information-seeking problems. However, most research remains primarily text-centric, overlooking visual information in…

Information Retrieval · Computer Science 2025-09-03 Xinyu Geng , Peng Xia , Zhen Zhang , Xinyu Wang , Qiuchen Wang , Ruixue Ding , Chenxi Wang , Jialong Wu , Yida Zhao , Kuan Li , Yong Jiang , Pengjun Xie , Fei Huang , Jingren Zhou

Deep-Research agents, which integrate large language models (LLMs) with search tools, have shown success in improving the effectiveness of handling complex queries that require iterative search planning and reasoning over search results.…

Large language models (LLMs) are increasingly envisioned as decision-support tools in clinical practice, yet safe clinical reasoning demands integrating heterogeneous knowledge bases -- trials, primary studies, regulatory documents, and…

Computation and Language · Computer Science 2025-05-22 Shan Chen , Pedro Moreira , Yuxin Xiao , Sam Schmidgall , Jeremy Warner , Hugo Aerts , Thomas Hartvigsen , Jack Gallifant , Danielle S. Bitterman

Multimodal Large Language models (MLLMs) have shown promise in web-related tasks, but evaluating their performance in the web domain remains a challenge due to the lack of comprehensive benchmarks. Existing benchmarks are either designed…

Computation and Language · Computer Science 2024-04-10 Junpeng Liu , Yifan Song , Bill Yuchen Lin , Wai Lam , Graham Neubig , Yuanzhi Li , Xiang Yue

Existing multimodal browsing benchmarks often fail to require genuine multimodal reasoning, as many tasks can be solved with text-only heuristics without vision-in-the-loop verification. We introduce MMSearch-Plus, a 311-task benchmark that…

Artificial Intelligence · Computer Science 2026-03-20 Xijia Tao , Yihua Teng , Xinxing Su , Xinyu Fu , Jihao Wu , Chaofan Tao , Ziru Liu , Haoli Bai , Rui Liu , Lingpeng Kong

Existing benchmarks for multimodal agentic search evaluate multimodal search and visual browsing, but visual evidence is either confined to the input or treated as an answer endpoint rather than part of an interleaved search trajectory. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Bohan Hou , Jiuning Gu , Jiayan Guo , Ronghao Dang , Sicong Leng , Xin Li , Xuemeng Song , Jianfei Yang

Large vision-language models (LVLMs) have demonstrated remarkable achievements, yet the generation of non-factual responses remains prevalent in fact-seeking question answering (QA). Current multimodal fact-seeking benchmarks primarily…

Computation and Language · Computer Science 2025-03-11 Yanling Wang , Yihan Zhao , Xiaodong Chen , Shasha Guo , Lixin Liu , Haoyang Li , Yong Xiao , Jing Zhang , Qi Li , Ke Xu

We present M^3-Bench, the first benchmark for evaluating multimodal tool use under the Model Context Protocol. The benchmark targets realistic, multi-hop and multi-threaded workflows that require visual grounding and textual reasoning,…

Artificial Intelligence · Computer Science 2026-02-05 Yang Zhou , Mingyu Zhao , Zhenting Wang , Difei Gu , Bangwei Guo , Ruosong Ye , Ligong Han , Can Jin , Dimitris N. Metaxas

Visual reasoning is a core component of human intelligence and a critical capability for advanced multimodal models. Yet current reasoning evaluations of multimodal large language models (MLLMs) often rely on text descriptions and allow…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Weiye Xu , Jiahao Wang , Weiyun Wang , Zhe Chen , Wengang Zhou , Aijun Yang , Lewei Lu , Houqiang Li , Xiaohua Wang , Xizhou Zhu , Wenhai Wang , Jifeng Dai , Jinguo Zhu

Multimodal Large Language Models (MLLMs) have shown remarkable proficiency on general-purpose vision-language benchmarks, reaching or even exceeding human-level performance. However, these evaluations typically rely on standard…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Wenjin Hou , Wei Liu , Han Hu , Xiaoxiao Sun , Serena Yeung-Levy , Hehe Fan

Most organizational data in this world are stored as documents, and visual retrieval plays a crucial role in unlocking the collective intelligence from all these documents. However, existing benchmarks focus on English-only document…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jian Chen , Ming Li , Jihyung Kil , Chenguang Wang , Tong Yu , Ryan Rossi , Tianyi Zhou , Changyou Chen , Ruiyi Zhang

Large language models (LLMs) have become increasingly pivotal across various domains, especially in handling complex data types. This includes structured data processing, as exemplified by ChartQA and ChatGPT-Ada, and multimodal…

The rise of powerful multimodal LLMs has enhanced the viability of building web agents which can, with increasing levels of autonomy, assist users to retrieve information and complete tasks on various human-computer interfaces. It is hence…

Information Retrieval · Computer Science 2024-09-26 Maria Wang , Srinivas Sunkara , Gilles Baechler , Jason Lin , Yun Zhu , Fedir Zubach , Lei Shu , Jindong Chen

As large language models (LLMs) evolve into tool-using agents, the ability to browse the web in real-time has become a critical yardstick for measuring their reasoning and retrieval competence. Existing benchmarks such as BrowseComp…

Recent advances in DeepResearch-style agents have demonstrated strong capabilities in autonomous information acquisition and synthesize from real-world web environments. However, existing approaches remain fundamentally limited to text…

Artificial Intelligence · Computer Science 2026-01-15 Xiaohan Yu , Chao Feng , Lang Mei , Chong Chen
‹ Prev 1 2 3 10 Next ›