English
Related papers

Related papers: DeepEyesV2: Toward Agentic Multimodal Model

200 papers

Deep reasoning is fundamental for solving complex tasks, especially in vision-centric scenarios that demand sequential, multimodal understanding. However, existing benchmarks typically evaluate agents with fully synthetic, single-turn…

Large Vision-Language Models excel at multimodal understanding but struggle to deeply integrate visual information into their predominantly text-based reasoning processes, a key challenge in mirroring human cognition. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ziwei Zheng , Michael Yang , Jack Hong , Chenxiao Zhao , Guohai Xu , Le Yang , Chao Shen , Xing Yu

Video reasoning constitutes a comprehensive assessment of a model's capabilities, as it demands robust perceptual and interpretive skills, thereby serving as a means to explore the boundaries of model performance. While recent research has…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Yudi Shi , Shangzhe Di , Qirui Chen , Qinian Wang , Jiayin Cai , Xiaolong Jiang , Yao Hu , Weidi Xie

Reinforcement learning for agentic multimodal models often suffers from interaction collapse, where models learn to reduce tool usage and multi-turn reasoning, limiting the benefits of agentic behavior. We introduce PyVision-RL, a…

Artificial Intelligence · Computer Science 2026-02-25 Shitian Zhao , Shaoheng Lin , Ming Li , Haoquan Zhang , Wenshuo Peng , Kaipeng Zhang , Chen Wei

Reward models are critical for aligning vision-language systems with human preferences, yet current approaches suffer from hallucination, weak visual grounding, and an inability to use tools for verification, limiting their reliability on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Shengyuan Ding , Xinyu Fang , Ziyu Liu , Yuhang Zang , Yuhang Cao , Xiangyu Zhao , Haodong Duan , Xiaoyi Dong , Jianze Liang , Bin Wang , Conghui He , Dahua Lin , Jiaqi Wang

While Vision-Language Models (VLMs) can solve complex tasks through agentic reasoning, their capabilities remain largely constrained to text-oriented chain-of-thought or isolated tool invocation. They fail to exhibit the human-like…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yong Xien Chng , Tao Hu , Wenwen Tong , Xueheng Li , Jiandong Chen , Haojia Yu , Jiefan Lu , Hewei Guo , Hanming Deng , Chengjun Xie , Gao Huang , Dahua Lin , Lewei Lu

Inspired by the remarkable reasoning capabilities of Deepseek-R1 in complex textual tasks, many works attempt to incentivize similar capabilities in Multimodal Large Language Models (MLLMs) by directly applying reinforcement learning (RL).…

Machine Learning · Computer Science 2026-01-29 Shuang Chen , Yue Guo , Zhaochen Su , Yafu Li , Yulun Wu , Jiacheng Chen , Jiayu Chen , Weijie Wang , Xiaoye Qu , Yu Cheng

Existing multimodal retrieval systems excel at semantic matching but implicitly assume that query-image relevance can be measured in isolation. This paradigm overlooks the rich dependencies inherent in realistic visual streams, where…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Chenlong Deng , Mengjie Deng , Junjie Wu , Dun Zeng , Teng Wang , Qingsong Xie , Jiadeng Huang , Shengjie Ma , Changwang Zhang , Zhaoxiang Wang , Jun Wang , Yutao Zhu , Zhicheng Dou

A key trend in Large Reasoning Models (e.g., OpenAI's o3) is the native agentic ability to use external tools such as web browsers for searching and writing/executing code for image manipulation to think with images. In the open-source…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Ziyu Liu , Yuhang Zang , Yushan Zou , Zijian Liang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

Despite recent progress in multimodal agentic systems, existing approaches often treat image manipulation and web search as disjoint capabilities, rely heavily on costly reinforcement learning, and lack planning grounded in real…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yifan Zhang , Liang Hu , Haofeng Sun , Peiyu Wang , Yichen Wei , Shukang Yin , Jiangbo Pei , Wei Shen , Peng Xia , Yi Peng , Tianyidan Xie , Eric Li , Yang Liu , Xuchen Song , Yahui Zhou

Agentic reinforcement learning has advanced large language models (LLMs) to reason through long chain-of-thought trajectories while interleaving external tool use. Existing approaches assume a fixed inventory of tools, limiting LLM agents'…

Computation and Language · Computer Science 2025-12-16 Jiaru Zou , Ling Yang , Yunzhe Qi , Sirui Chen , Mengting Ai , Ke Shen , Jingrui He , Mengdi Wang

Recent advances in text-only large language models (LLMs), such as DeepSeek-R1, demonstrate remarkable reasoning ability. However, these models remain fragile or entirely incapable when extended to multi-modal tasks. Existing approaches…

Multiagent Systems · Computer Science 2025-10-30 Weijia Zhang , Zijia Liu , Haoru Li , Haoqi Chen , Jiaxuan You

With the rapid advancement of commercial multi-modal models, image editing has garnered significant attention due to its widespread applicability in daily life. Despite impressive progress, existing image editing systems, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yiran Zhao , Yaoqi Ye , Xiang Liu , Michael Qizhe Shieh , Trung Bui

Existing multimodal search agents process target entities sequentially, issuing one tool call per entity and accumulating redundant interaction rounds whenever a query decomposes into independent sub-retrievals. We argue that effective…

Machine Learning · Computer Science 2026-05-12 Guankai Li , Jiabin Chen , Yi Xu , Xichen Zhang , Yuan Lu

Multimodal retrieval is becoming a crucial component of modern AI applications, yet its evaluation lags behind the demands of more realistic and challenging scenarios. Existing benchmarks primarily probe surface-level semantic…

Information Retrieval · Computer Science 2025-10-01 Junjie Zhou , Ze Liu , Lei Xiong , Jin-Ge Yao , Yueze Wang , Shitao Xiao , Fenfen Lin , Miguel Hu Chen , Zhicheng Dou , Siqi Bao , Defu Lian , Yongping Xiong , Zheng Liu

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao

Recent agentic search frameworks enable deep research via iterative planning and retrieval, reducing hallucinations and enhancing factual grounding. However, they remain text-centric, overlooking the multimodal evidence that characterizes…

Computation and Language · Computer Science 2026-04-21 Fangda Ye , Zhifei Xie , Yuxin Hu , Yihang Yin , Shurui Huang , Shikai Dong , Jianzhu Bao , Shuicheng Yan

Large Language Models (LLMs) have demonstrated remarkable capabilities in challenging, knowledge-intensive reasoning tasks. However, extending LLMs to perceive and reason over a new modality (e.g., vision), often requires costly development…

Computation and Language · Computer Science 2025-11-25 James Y. Huang , Sheng Zhang , Qianchu Liu , Guanghui Qin , Tinghui Zhu , Tristan Naumann , Muhao Chen , Hoifung Poon

Large models are increasingly becoming autonomous agents that interact with real-world environments and use external tools to augment their static capabilities. However, most recent progress has focused on text-only large language models,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ruiyang Zhang , Qianguo Sun , Chao Song , Yiyan Qi , Zhedong Zheng

Current research on agentic visual reasoning enables deep multimodal understanding but primarily focuses on image manipulation tools, leaving a gap toward more general-purpose agentic models. In this work, we revisit the geolocalization…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Yikun Wang , Zuyan Liu , Ziyi Wang , Han Hu , Pengfei Liu , Yongming Rao
‹ Prev 1 2 3 10 Next ›