English
Related papers

Related papers: WebWatcher: Breaking New Frontier of Vision-Langua…

200 papers

Recent advancements in Multi-modal Large Language Models (MLLMs) have significantly improved their performance in tasks combining vision and language. However, challenges persist in detailed multi-modal understanding, comprehension of…

Computation and Language · Computer Science 2024-05-29 Somnath Kumar , Yash Gadhia , Tanuja Ganu , Akshay Nambi

Multimodal deep search requires an agent to solve open-world problems by chaining search, tool use, and visual reasoning over evolving textual and visual context. Two bottlenecks limit current systems. First, existing tool-use harnesses…

Computation and Language · Computer Science 2026-05-12 Shijue Huang , Hangyu Guo , Chenxin Li , Junting Lu , Xinyu Geng , Zhaochen Su , Zhenyu Li , Shuang Chen , Hongru Wang , Yi R. Fung

The integration of Large Language Models (LLMs) into healthcare is constrained by knowledge limitations, hallucinations, and a disconnect from Evidence-Based Medicine (EBM). While Retrieval-Augmented Generation (RAG) offers a solution,…

Computation and Language · Computer Science 2026-02-03 Qiaoyu Zheng , Yuze Sun , Chaoyi Wu , Weike Zhao , Pengcheng Qiu , Yongguo Yu , Kun Sun , Jian Zhang , Yanfeng Wang , Ya Zhang , Weidi Xie

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by grounding responses with retrieved information. As an emerging paradigm, Agentic RAG further enhances this process by introducing autonomous LLM agents into the…

Information Retrieval · Computer Science 2025-05-26 Yunjia Xi , Jianghao Lin , Menghui Zhu , Yongzhao Xiao , Zhuoying Ou , Jiaqi Liu , Tong Wan , Bo Chen , Weiwen Liu , Yasheng Wang , Ruiming Tang , Weinan Zhang , Yong Yu

Vision-Language Models (VLMs) have demonstrated remarkable progress in multimodal understanding, yet their capabilities for scientific reasoning remain inadequately assessed. Current multimodal benchmarks predominantly evaluate generic…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Ai Jian , Weijie Qiu , Xiaokun Wang , Peiyu Wang , Yunzhuo Hao , Jiangbo Pei , Yichen Wei , Yi Peng , Xuchen Song

Deep research agents integrate fragmented evidence through multi-step tool use. BrowseComp offers a text-only testbed for such agents, but existing multimodal benchmarks rarely require both weak visual cues composition and BrowseComp-style…

Computation and Language · Computer Science 2026-04-07 Xinyu Geng , Yanjing Xiao , Yuyang Zhang , Hanwen Wang , Xinyan Liu , Rui Min , Tianqing Fang , Yi R. Fung

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

The rapid evolution of Retrieval-Augmented Generation (RAG) toward multimodal, high-stakes enterprise applications has outpaced the development of domain specific evaluation benchmarks. Existing datasets often rely on general-domain corpora…

Artificial Intelligence · Computer Science 2026-01-23 Chandan Kumar Sahu , Premith Kumar Chilukuri , Matthew Hetrich

Agentic web search increasingly faces two distinct demands: deep reasoning over a single target, and structured aggregation across many entities and heterogeneous sources. Current systems struggle on both fronts. Breadth-oriented tasks…

Artificial Intelligence · Computer Science 2026-05-01 Yuxuan Huang , Yihang Chen , Zhiyuan He , Yuxiang Chen , Ka Yiu Lee , Huichi Zhou , Weilin Luo , Meng Fang , Jun Wang

CAPTCHAs have been a critical bottleneck for deploying web agents in real-world applications, often blocking them from completing end-to-end automation tasks. While modern multimodal LLM agents have demonstrated impressive performance in…

Artificial Intelligence · Computer Science 2025-06-02 Yaxin Luo , Zhaoyi Li , Jiacheng Liu , Jiacheng Cui , Xiaohan Zhao , Zhiqiang Shen

Building robust vision systems for high-stakes domains such as remote sensing requires stronger visual reasoning than what single-pass inference typically provides; yet, retraining large models is often computationally expensive and data…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Chung-En Johnny Yu , Brian Jalaian , Nathaniel D. Bastian

Research agents have recently achieved significant progress in information seeking and synthesis across heterogeneous textual and visual sources. In this paper, we introduce MuSEAgent, a multimodal reasoning agent that enhances…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Shijian Wang , Jiarui Jin , Runhao Fu , Zexuan Yan , Xingjian Wang , Mengkang Hu , Eric Wang , Xiaoxi Li , Kangning Zhang , Li Yao , Wenxiang Jiao , Xuelian Cheng , Yuan Lu , Zongyuan Ge

Multimodal Large Language Models (MLLMs) have recently been applied to universal multimodal retrieval, where Chain-of-Thought (CoT) reasoning improves candidate reranking. However, existing approaches remain largely language-driven, relying…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Dongyang Chen , Chaoyang Wang , Dezhao Su , Xi Xiao , Zeyu Zhang , Jing Xiong , Qing Li , Yuzhang Shang , Shichao Kan

The integration of deep learning-based glaucoma detection with large language models (LLMs) presents an automated strategy to mitigate ophthalmologist shortages and improve clinical reporting efficiency. However, applying general LLMs to…

Multiagent Systems · Computer Science 2025-12-18 Philip R. Liu , Sparsh Bansal , Jimmy Dinh , Aditya Pawar , Ramani Satishkumar , Shail Desai , Neeraj Gupta , Xin Wang , Shu Hu

Leveraging Multi-modal Large Language Models (MLLMs) to accelerate frontier scientific research is promising, yet how to rigorously evaluate such systems remains unclear. Existing benchmarks mainly focus on single-document understanding,…

Artificial Intelligence · Computer Science 2026-04-14 Lei Xiong , Huaying Yuan , Zheng Liu , Zhao Cao , Zhicheng Dou

Recent progress in deep research systems has been impressive, but evaluation still lags behind real user needs. Existing benchmarks predominantly assess final reports using fixed rubrics, failing to evaluate the underlying research process.…

In this article, we investigate vision-language models (VLM) as reasoners. The ability to form abstractions underlies mathematical reasoning, problem-solving, and other Math AI tasks. Several formalisms have been given to these underlying…

Artificial Intelligence · Computer Science 2024-07-08 Denisa Roberts , Lucas Roberts

Deep research requires reasoning over web evidence to answer open-ended questions, and it is a core capability for AI agents. Yet many deep research agents still rely on implicit, unstructured search behavior that causes redundant…

Artificial Intelligence · Computer Science 2026-04-29 Boer Zhang , Mingyan Wu , Dongzhuoran Zhou , Yuqicheng Zhu , Wendong Fan , Puzhen Zhang , Zifeng Ding , Guohao Li , Yuan He

One of the primary challenges faced by deep learning is the degree to which current methods exploit superficial statistics and dataset bias, rather than learning to generalise over the specific representations they have experienced. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Damien Teney , Peng Wang , Jiewei Cao , Lingqiao Liu , Chunhua Shen , Anton van den Hengel

Breakthroughs in transformer-based models have revolutionized not only the NLP field, but also vision and multimodal systems. However, although visualization and interpretability tools have become available for NLP models, internal…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Estelle Aflalo , Meng Du , Shao-Yen Tseng , Yongfei Liu , Chenfei Wu , Nan Duan , Vasudev Lal