English
Related papers

Related papers: VQAThinker: Exploring Generalizable and Explainabl…

200 papers

Recently, User-Generated Content (UGC) videos have gained popularity in our daily lives. However, UGC videos often suffer from poor exposure due to the limitations of photographic equipment and techniques. Therefore, Video Exposure…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Xunchu Zhou , Xiaohong Liu , Yunlong Dong , Tengchuan Kou , Yixuan Gao , Zicheng Zhang , Chunyi Li , Haoning Wu , Guangtao Zhai

We introduce VisTA, a new reinforcement learning framework that empowers visual agents to dynamically explore, select, and combine tools from a diverse library based on empirical performance. Existing methods for tool-augmented reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zeyi Huang , Yuyang Ji , Anirudh Sundara Rajan , Zefan Cai , Wen Xiao , Haohan Wang , Junjie Hu , Yong Jae Lee

Visual quality assessment (VQA) is increasingly shifting from scalar score prediction toward interpretable quality understanding -- a paradigm that demands \textit{fine-grained spatiotemporal perception} and \textit{auxiliary contextual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Linhan Cao , Wei Sun , Weixia Zhang , Xiangyang Zhu , Kaiwei Zhang , Jun Jia , Dandan Zhu , Guangtao Zhai , Xiongkuo Min

The data scaling law has been shown to significantly enhance the performance of large multi-modal models (LMMs) across various downstream tasks. However, in the domain of perceptual video quality assessment (VQA), the potential of scaling…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Ziheng Jia , Zicheng Zhang , Zeyu Zhang , Yingji Liang , Xiaorong Zhu , Chunyi Li , Jinliang Han , Haoning Wu , Bin Wang , Haoran Zhang , Guanyu Zhu , Qiyong Zhao , Xiaohong Liu , Guangtao Zhai , Xiongkuo Min

Video Quality Assessment (VQA) aims to simulate the process of perceiving video quality by the human visual system (HVS). The judgments made by HVS are always influenced by human subjective feelings. However, most of the current VQA…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Yachun Mi , Yu Li , Yan Shu , Chen Hui , Puchao Zhou , Shaohui Liu

The rapid proliferation of AI-generated video necessitates robust detection tools that offer both high accuracy and human-interpretable explanations. While existing MLLM-based detectors rely on supervised fine-tuning (SFT) or direct…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Kyoungjun Park , Yifan Yang , Juheon Yi , Shicheng Zheng , Yifei Shen , Dongqi Han , Caihua Shan , Muhammad Muaz , Lili Qiu

Visual Question Answering (VQA) deep-learning systems tend to capture superficial statistical correlations in the training data because of strong language priors and fail to generalize to test data with a significantly different…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Jialin Wu , Raymond J. Mooney

Recent advancements in reinforcement learning with verifiable rewards have pushed the boundaries of the visual reasoning capabilities in large vision-language models (LVLMs). However, training LVLMs with reinforcement fine-tuning (RFT) is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zilin Xiao , Jaywon Koo , Siru Ouyang , Jefferson Hernandez , Yu Meng , Vicente Ordonez

Group Relative Policy Optimization (GRPO) has emerged as the de facto Reinforcement Learning (RL) objective driving recent advancements in Multimodal Large Language Models. However, extending this success to open-source multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Wenbo Hu , Xin Chen , Yan Gao-Tian , Yihe Deng , Nanyun Peng , Kai-Wei Chang

Reinforcement learning (RL) has shown strong potential for enhancing reasoning in multimodal large language models, yet existing video reasoning methods often rely on coarse sequence-level rewards or single-factor token selection,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Ziyue Wang , Sheng Jin , Zhongrong Zuo , Jiawei Wu , Han Qiu , Qi She , Hao Zhang , Xudong Jiang

Omnidirectional images (ODIs), with their 360{\deg} field of view, provide unparalleled spatial awareness for immersive applications like augmented reality and embodied AI. However, the capability of existing multi-modal large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Xinshen Zhang , Zhen Ye , Xu Zheng

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

Recent advancements in large language models, multimodal large language models, and large audio language models (LALMs) have significantly improved their reasoning capabilities through reinforcement learning with rule-based rewards.…

Sound · Computer Science 2025-11-05 Shu Wu , Chenxing Li , Wenfu Wang , Hao Zhang , Hualei Wang , Meng Yu , Dong Yu

We introduce CausalVQA, a benchmark dataset for video question answering (VQA) composed of question-answer pairs that probe models' understanding of causality in the physical world. Existing VQA benchmarks either tend to focus on surface…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Aaron Foss , Chloe Evans , Sasha Mitts , Koustuv Sinha , Ammar Rizvi , Justine T. Kao

This paper proposes the first video-grounded entailment tree reasoning method for commonsense video question answering (VQA). Despite the remarkable progress of large visual-language models (VLMs), there are growing concerns that they learn…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Huabin Liu , Filip Ilievski , Cees G. M. Snoek

Recently, reinforcement learning (RL)-based tuning has shifted the trajectory of Multimodal Large Language Models (MLLMs), particularly following the introduction of Group Relative Policy Optimization (GRPO). However, directly applying it…

Computation and Language · Computer Science 2025-05-21 Wenhui Zhu , Xuanzhao Dong , Xin Li , Peijie Qiu , Xiwen Chen , Abolfazl Razi , Aris Sotiras , Yi Su , Yalin Wang

Visual Question Answering (VQA) is a challenging task that requires systems to provide accurate answers to questions based on image content. Current VQA models struggle with complex questions due to limitations in capturing and integrating…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Peiyuan Chen , Zecheng Zhang , Yiping Dong , Li Zhou , Han Wang

Video Question Answering (VideoQA) has made significant strides by leveraging multimodal learning to align visual and textual modalities. However, current benchmarks overwhelmingly focus on questions answerable through explicit visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Sirnam Swetha , Rohit Gupta , Parth Parag Kulkarni , David G Shatwell , Jeffrey A Chan Santiago , Nyle Siddiqui , Joseph Fioresi , Mubarak Shah

Understanding text-rich videos requires reading small, transient textual cues that often demand repeated inspection. Yet most video QA models rely on single-pass perception over fixed frames, leading to hallucinations and failures on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yolo Y. Tang , Daiki Shimada , Hang Hua , Chao Huang , Jing Bi , Rogerio Feris , Chenliang Xu

The proliferation of videos collected during in-the-wild natural settings has pushed the development of effective Video Quality Assessment (VQA) methodologies. Contemporary supervised opinion-driven VQA strategies predominantly hinge on…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Haoning Wu , Liang Liao , Annan Wang , Chaofeng Chen , Jingwen Hou , Wenxiu Sun , Qiong Yan , Weisi Lin
‹ Prev 1 3 4 5 6 7 10 Next ›