English
Related papers

Related papers: Weaver: End-to-End Agentic System Training for Vid…

200 papers

Building robust vision systems for high-stakes domains such as remote sensing requires stronger visual reasoning than what single-pass inference typically provides; yet, retraining large models is often computationally expensive and data…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Chung-En Johnny Yu , Brian Jalaian , Nathaniel D. Bastian

Vision-language agents have achieved remarkable progress in a variety of multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaqi Liu , Kaiwen Xiong , Peng Xia , Yiyang Zhou , Haonian Ji , Lu Feng , Siwei Han , Mingyu Ding , Huaxiu Yao

Vision-and-Language Navigation (VLN) requires an agent to ground language instructions to its own movement within a visual environment. While state-of-the-art methods leverage the reasoning capabilities of Vision-Language Models (VLMs) for…

Multimodal reasoning requires iterative coordination between language and vision, yet it remains unclear what constitutes a meaningful interleaved chain of thought. We posit that text and image thoughts should function as complementary…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jiawei Gu , Yunzhuo Hao , Huichen Will Wang , Linjie Li , Michael Qizhe Shieh , Yejin Choi , Ranjay Krishna , Yu Cheng

Self-reflection mechanisms that rely on purely text-based rethinking processes perform well in most multimodal tasks. However, when directly applied to long-form video understanding scenarios, they exhibit clear limitations. The fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Jiaze Li , Hao Yin , Wenhui Tan , Jingyang Chen , Boshen Xu , Yuxun Qu , Yijing Chen , Jianzhong Ju , Zhenbo Luo , Jian Luan

Video Question Answering (VideoQA) is a challenging task that requires understanding complex visual and temporal relationships within videos to answer questions accurately. In this work, we introduce \textbf{ReasVQA} (Reasoning-enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Jianxin Liang , Xiaojun Meng , Huishuai Zhang , Yueqian Wang , Jiansheng Wei , Dongyan Zhao

Recent advances in text-only large language models (LLMs), such as DeepSeek-R1, demonstrate remarkable reasoning ability. However, these models remain fragile or entirely incapable when extended to multi-modal tasks. Existing approaches…

Multiagent Systems · Computer Science 2025-10-30 Weijia Zhang , Zijia Liu , Haoru Li , Haoqi Chen , Jiaxuan You

Cross-Video Reasoning (CVR) has emerged as a critical frontier in multimodal intelligence, requiring models to retrieve, align, and aggregate evidence distributed across multiple videos. Current Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yilun Qiu , Jiahe Wang , Cilin Yan , Jiayin Cai , Xiaolong Jiang , Yao Hu , Chun Yuan

Sports video understanding requires perceiving high-speed dynamics, complex rules, and long temporal contexts. Yet, current Multimodal Large Language Models (MLLMs) remain narrowly focused on single sports, specific tasks, or training-free…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Junbo Zou , Haotian Xia , Zhen Ye , Shengjie Zhang , Christopher Lai , Vicente Ordonez , Weining Shen , Hanjie Chen

Long video understanding is challenging due to rich and complicated multimodal clues in long temporal range.Current methods adopt reasoning to improve the model's ability to analyze complex video clues in long videos via text-form…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Houlun Chen , Xin Wang , Guangyao Li , Yuwei Zhou , Yihan Chen , Jia Jia , Wenwu Zhu

Visual reasoning (VR), which is crucial in many fields for enabling human-like visual understanding, remains highly challenging. Recently, compositional visual reasoning approaches, which leverage the reasoning abilities of large language…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Fucai Ke , Vijay Kumar B G , Xingjian Leng , Zhixi Cai , Zaid Khan , Weiqing Wang , Pari Delir Haghighi , Hamid Rezatofighi , Manmohan Chandraker

Vision-language-action (VLA) reasoning tasks require agents to interpret multimodal instructions, perform long-horizon planning, and act adaptively in dynamic environments. Existing approaches typically train VLA models in an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Chi-Pin Huang , Yueh-Hua Wu , Min-Hung Chen , Yu-Chiang Frank Wang , Fu-En Yang

Long video understanding presents significant challenges for vision-language models due to extremely long context windows. Existing solutions relying on naive chunking strategies with retrieval-augmented generation, typically suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Xinlei Yin , Xiulian Peng , Xiao Li , Zhiwei Xiong , Yan Lu

This paper aims at improving how machines can answer questions directly from text, with the focus of having models that can answer correctly multiple types of questions and from various types of texts, documents or even from large…

Computation and Language · Computer Science 2018-04-30 Martin Raison , Pierre-Emmanuel Mazaré , Rajarshi Das , Antoine Bordes

Multimodal large language models are increasingly expected to perform thinking with images, yet existing visual latent reasoning methods still rely on explicit textual chain-of-thought interleaved with visual latent tokens. This interleaved…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Houcheng Jiang , Jiajun Fu , Junfeng Fang , Chen Gao , Xiang Wang , Xiangnan He , Yong Li

Self-evolving agents improve by accumulating and reusing experience from past interactions. Existing work has largely focused on how experience is constructed, represented, and updated, while paying less attention to how experience should…

Computation and Language · Computer Science 2026-05-11 Weixiang Zhao , Yingshuo Wang , Yichen Zhang , Yanyan Zhao , Yu Zhang , Yang Wu , Dandan Tu , Bing Qin , Ting Liu

Effectively retrieving, reasoning, and understanding multimodal information remains a critical challenge for agentic systems. Traditional Retrieval-augmented Generation (RAG) methods rely on linear interaction histories, which struggle to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Qiuchen Wang , Shihang Wang , Yu Zeng , Qiang Zhang , Fanrui Zhang , Zhuoning Guo , Bosi Zhang , Wenxuan Huang , Lin Chen , Zehui Chen , Pengjun Xie , Ruixue Ding

We aim to investigate whether end-to-end learning of visual reasoning can be achieved with general-purpose neural networks, with the help of visual pretraining. A positive result would refute the common belief that explicit visual…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Chen Sun , Calvin Luo , Xingyi Zhou , Anurag Arnab , Cordelia Schmid

Generative models have substantially expanded video generation capabilities, yet practical thought-to-video creation remains a multi-stage, multi-modal, and decision-intensive process. However, existing tools either hide intermediate…

Multimedia · Computer Science 2026-02-10 Zhuoyun Zheng , Yu Dong , Gaorong Liang , Guan Li , Guihua Shan , Shiyu Cheng , Dong Tian , Jianlong Zhou , Jie Liang

Agentic vision-language models are increasingly trained to "think with images" by calling image operations. However, we show that high final-answer accuracy often hides unfaithful visual reasoning: models may invoke tools on irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xinhai Hou , Shaoyuan Xu , Manan Biyani , Moyan Li , Jia Liu , Todd C. Hollon , Bryan Wang