English
Related papers

Related papers: WebWatcher: Breaking New Frontier of Vision-Langua…

200 papers

Knowledge-based visual question answering (KB-VQA) requires vision-language models to understand images and use external knowledge, especially for rare entities and long-tail facts. Most existing retrieval-augmented generation (RAG) methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Zhuohong Chen , Zhenxian Wu , Yunyao Yu , Hangrui Xu , Zirui Liao , Zhifang Liu , Xiangwen Deng , Pen Jiao , Haoqian Wang

Multimodal Large Language Models (MLLMs) have advanced VQA and now support Vision-DeepResearch systems that use search engines for complex visual-textual fact-finding. However, evaluating these visual and textual search abilities is still…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yu Zeng , Wenxuan Huang , Zhen Fang , Shuang Chen , Yufan Shen , Yishuo Cai , Xiaoman Wang , Zhenfei Yin , Lin Chen , Zehui Chen , Shiting Huang , Yiming Zhao , Xu Tang , Yao Hu , Philip Torr , Wanli Ouyang , Shaosheng Cao

Lately, researchers in artificial intelligence have been really interested in how language and vision come together, giving rise to the development of multimodal models that aim to seamlessly integrate textual and visual information.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Rajat Chawla , Arkajit Datta , Tushar Verma , Adarsh Jha , Anmol Gautam , Ayush Vatsal , Sukrit Chaterjee , Mukunda NS , Ishaan Bhola

Agentic multimodal models have garnered significant attention for their ability to leverage external tools to tackle complex tasks. However, it is observed that such agents often meet premature interaction collapse, caused by two primary…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Shengqin Wang , Wentao Yan , Huichi Zhou , Yihang Chen , Kun Shao , Zhizhong Zhang , Yuan Xie

Multimodal Entity Linking (MEL) aims to associate textual and visual mentions with entities in a multimodal knowledge graph. Despite its importance, current methods face challenges such as incomplete contextual information, coarse…

Computation and Language · Computer Science 2025-08-25 Fang Wang , Tianwei Yan , Zonghao Yang , Minghao Hu , Jun Zhang , Zhunchen Luo , Xiaoying Bai

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in vision-language tasks yet remain limited in long video understanding due to the limited context window. Consequently, prevailing approaches tend to rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yang Ding , Yizhen Zhang , Xin Lai , Ruihang Chu , Yujiu Yang

Radiology visual question answering (RVQA) provides precise answers to questions about chest X-ray images, alleviating radiologists' workload. While recent methods based on multimodal large language models (MLLMs) and retrieval-augmented…

Artificial Intelligence · Computer Science 2025-08-06 Ziruo Yi , Jinyu Liu , Ting Xiao , Mark V. Albert

The increasing availability of multimodal data across text, tables, and images presents new challenges for developing models capable of complex cross-modal reasoning. Existing methods for Multimodal Multi-hop Question Answering (MMQA) often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Qi Zhi Lim , Chin Poo Lee , Kian Ming Lim , Kalaiarasi Sonai Muthu Anbananthen

Data science and engineering workflows often span multiple stages, from warehousing to orchestration, using tools like BigQuery, dbt, and Airbyte. As vision language models (VLMs) advance in multimodal understanding and code generation,…

With the advancement of vision-language models, web automation has made significant progress. However, deploying autonomous agents in real-world settings remains challenging, primarily due to site heterogeneity, where generalist models lack…

Human-Computer Interaction · Computer Science 2026-04-24 Jihong Wang , Jiamu Zhou , Weiming Zhang , Teng Wang , Weiwen Liu , Zhuosheng Zhang , Xingyu Lou , Weinan Zhang , Huarong Deng , Jun Wang

The rapid advancement of large language models (LLMs) has driven the development of agentic systems capable of autonomously performing complex tasks. Despite their impressive capabilities, LLMs remain constrained by their internal knowledge…

Information Retrieval · Computer Science 2025-08-19 Wenlin Zhang , Xiaopeng Li , Yingyi Zhang , Pengyue Jia , Yichao Wang , Huifeng Guo , Yong Liu , Xiangyu Zhao

Large language models are transitioning from generalpurpose knowledge engines to realworld problem solvers, yet optimizing them for deep search tasks remains challenging. The central bottleneck lies in the extreme sparsity of highquality…

Artificial Intelligence · Computer Science 2026-02-17 Zheng Chu , Xiao Wang , Jack Hong , Huiming Fan , Yuqi Huang , Yue Yang , Guohai Xu , Chenxiao Zhao , Cheng Xiang , Shengchao Hu , Dongdong Kuang , Ming Liu , Bing Qin , Xing Yu

We present DeepSeek-VL, an open-source Vision-Language (VL) Model designed for real-world vision and language understanding applications. Our approach is structured around three key dimensions: We strive to ensure our data is diverse,…

Artificial Intelligence · Computer Science 2024-03-12 Haoyu Lu , Wen Liu , Bo Zhang , Bingxuan Wang , Kai Dong , Bo Liu , Jingxiang Sun , Tongzheng Ren , Zhuoshu Li , Hao Yang , Yaofeng Sun , Chengqi Deng , Hanwei Xu , Zhenda Xie , Chong Ruan

Deep search capabilities have become an indispensable competency for frontier Large Language Model (LLM) agents, yet the development of high-performance search agents remains dominated by industrial giants due to a lack of transparent,…

Artificial Intelligence · Computer Science 2026-03-17 Yuwen Du , Rui Ye , Shuo Tang , Xinyu Zhu , Yijun Lu , Yuzhu Cai , Siheng Chen

Scientific research demands sophisticated reasoning over multimodal data, a challenge especially prevalent in biology. Despite recent advances in multimodal large language models (MLLMs) for AI-assisted research, existing multimodal…

Existing benchmarks for multimodal agentic search evaluate multimodal search and visual browsing, but visual evidence is either confined to the input or treated as an answer endpoint rather than part of an interleaved search trajectory. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Bohan Hou , Jiuning Gu , Jiayan Guo , Ronghao Dang , Sicong Leng , Xin Li , Xuemeng Song , Jianfei Yang

From professional research to everyday planning, many tasks are bottlenecked by wide-scale information seeking, which is more repetitive than cognitively complex. With the rapid development of Large Language Models (LLMs), automated search…

Computation and Language · Computer Science 2025-08-29 Ryan Wong , Jiawei Wang , Junjie Zhao , Li Chen , Yan Gao , Long Zhang , Xuan Zhou , Zuo Wang , Kai Xiang , Ge Zhang , Wenhao Huang , Yang Wang , Ke Wang

The rise of powerful multimodal LLMs has enhanced the viability of building web agents which can, with increasing levels of autonomy, assist users to retrieve information and complete tasks on various human-computer interfaces. It is hence…

Information Retrieval · Computer Science 2024-09-26 Maria Wang , Srinivas Sunkara , Gilles Baechler , Jason Lin , Yun Zhu , Fedir Zubach , Lei Shu , Jindong Chen

Addressing intricate real-world problems necessitates in-depth information seeking and multi-step reasoning. Recent progress in agentic systems, exemplified by Deep Research, underscores the potential for autonomous multi-step research. In…

Computation and Language · Computer Science 2025-08-12 Jialong Wu , Baixuan Li , Runnan Fang , Wenbiao Yin , Liwen Zhang , Zhengwei Tao , Dingchu Zhang , Zekun Xi , Gang Fu , Yong Jiang , Pengjun Xie , Fei Huang , Jingren Zhou

This paper presents our submission to the ACMMM25 - Grand Challenge on Multimedia Verification. We developed a multi-agent verification system that combines Multimodal Large Language Models (MLLMs) with specialized verification tools to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Huy Hoan Le , Van Sy Thinh Nguyen , Thi Le Chi Dang , Vo Thanh Khang Nguyen , Truong Thanh Hung Nguyen , Hung Cao
‹ Prev 1 3 4 5 6 7 10 Next ›