中文
相关论文

相关论文: VQAThinker: Exploring Generalizable and Explainabl…

200 篇论文

Recently, User-Generated Content (UGC) videos have gained popularity in our daily lives. However, UGC videos often suffer from poor exposure due to the limitations of photographic equipment and techniques. Therefore, Video Exposure…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Xunchu Zhou , Xiaohong Liu , Yunlong Dong , Tengchuan Kou , Yixuan Gao , Zicheng Zhang , Chunyi Li , Haoning Wu , Guangtao Zhai

We introduce VisTA, a new reinforcement learning framework that empowers visual agents to dynamically explore, select, and combine tools from a diverse library based on empirical performance. Existing methods for tool-augmented reasoning…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Zeyi Huang , Yuyang Ji , Anirudh Sundara Rajan , Zefan Cai , Wen Xiao , Haohan Wang , Junjie Hu , Yong Jae Lee

Visual quality assessment (VQA) is increasingly shifting from scalar score prediction toward interpretable quality understanding -- a paradigm that demands \textit{fine-grained spatiotemporal perception} and \textit{auxiliary contextual…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Linhan Cao , Wei Sun , Weixia Zhang , Xiangyang Zhu , Kaiwei Zhang , Jun Jia , Dandan Zhu , Guangtao Zhai , Xiongkuo Min

The data scaling law has been shown to significantly enhance the performance of large multi-modal models (LMMs) across various downstream tasks. However, in the domain of perceptual video quality assessment (VQA), the potential of scaling…

Video Quality Assessment (VQA) aims to simulate the process of perceiving video quality by the human visual system (HVS). The judgments made by HVS are always influenced by human subjective feelings. However, most of the current VQA…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Yachun Mi , Yu Li , Yan Shu , Chen Hui , Puchao Zhou , Shaohui Liu

The rapid proliferation of AI-generated video necessitates robust detection tools that offer both high accuracy and human-interpretable explanations. While existing MLLM-based detectors rely on supervised fine-tuning (SFT) or direct…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Kyoungjun Park , Yifan Yang , Juheon Yi , Shicheng Zheng , Yifei Shen , Dongqi Han , Caihua Shan , Muhammad Muaz , Lili Qiu

Visual Question Answering (VQA) deep-learning systems tend to capture superficial statistical correlations in the training data because of strong language priors and fail to generalize to test data with a significantly different…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Jialin Wu , Raymond J. Mooney

Recent advancements in reinforcement learning with verifiable rewards have pushed the boundaries of the visual reasoning capabilities in large vision-language models (LVLMs). However, training LVLMs with reinforcement fine-tuning (RFT) is…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Zilin Xiao , Jaywon Koo , Siru Ouyang , Jefferson Hernandez , Yu Meng , Vicente Ordonez

Group Relative Policy Optimization (GRPO) has emerged as the de facto Reinforcement Learning (RL) objective driving recent advancements in Multimodal Large Language Models. However, extending this success to open-source multimodal…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Wenbo Hu , Xin Chen , Yan Gao-Tian , Yihe Deng , Nanyun Peng , Kai-Wei Chang

Reinforcement learning (RL) has shown strong potential for enhancing reasoning in multimodal large language models, yet existing video reasoning methods often rely on coarse sequence-level rewards or single-factor token selection,…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Ziyue Wang , Sheng Jin , Zhongrong Zuo , Jiawei Wu , Han Qiu , Qi She , Hao Zhang , Xudong Jiang

Omnidirectional images (ODIs), with their 360{\deg} field of view, provide unparalleled spatial awareness for immersive applications like augmented reality and embodied AI. However, the capability of existing multi-modal large language…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Xinshen Zhang , Zhen Ye , Xu Zheng

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

Recent advancements in large language models, multimodal large language models, and large audio language models (LALMs) have significantly improved their reasoning capabilities through reinforcement learning with rule-based rewards.…

声音 · 计算机科学 2025-11-05 Shu Wu , Chenxing Li , Wenfu Wang , Hao Zhang , Hualei Wang , Meng Yu , Dong Yu

We introduce CausalVQA, a benchmark dataset for video question answering (VQA) composed of question-answer pairs that probe models' understanding of causality in the physical world. Existing VQA benchmarks either tend to focus on surface…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Aaron Foss , Chloe Evans , Sasha Mitts , Koustuv Sinha , Ammar Rizvi , Justine T. Kao

This paper proposes the first video-grounded entailment tree reasoning method for commonsense video question answering (VQA). Despite the remarkable progress of large visual-language models (VLMs), there are growing concerns that they learn…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Huabin Liu , Filip Ilievski , Cees G. M. Snoek

Recently, reinforcement learning (RL)-based tuning has shifted the trajectory of Multimodal Large Language Models (MLLMs), particularly following the introduction of Group Relative Policy Optimization (GRPO). However, directly applying it…

计算与语言 · 计算机科学 2025-05-21 Wenhui Zhu , Xuanzhao Dong , Xin Li , Peijie Qiu , Xiwen Chen , Abolfazl Razi , Aris Sotiras , Yi Su , Yalin Wang

Visual Question Answering (VQA) is a challenging task that requires systems to provide accurate answers to questions based on image content. Current VQA models struggle with complex questions due to limitations in capturing and integrating…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Peiyuan Chen , Zecheng Zhang , Yiping Dong , Li Zhou , Han Wang

Video Question Answering (VideoQA) has made significant strides by leveraging multimodal learning to align visual and textual modalities. However, current benchmarks overwhelmingly focus on questions answerable through explicit visual…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Sirnam Swetha , Rohit Gupta , Parth Parag Kulkarni , David G Shatwell , Jeffrey A Chan Santiago , Nyle Siddiqui , Joseph Fioresi , Mubarak Shah

Understanding text-rich videos requires reading small, transient textual cues that often demand repeated inspection. Yet most video QA models rely on single-pass perception over fixed frames, leading to hallucinations and failures on…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Yolo Y. Tang , Daiki Shimada , Hang Hua , Chao Huang , Jing Bi , Rogerio Feris , Chenliang Xu

The proliferation of videos collected during in-the-wild natural settings has pushed the development of effective Video Quality Assessment (VQA) methodologies. Contemporary supervised opinion-driven VQA strategies predominantly hinge on…

计算机视觉与模式识别 · 计算机科学 2023-05-01 Haoning Wu , Liang Liao , Annan Wang , Chaofeng Chen , Jingwen Hou , Wenxiu Sun , Qiong Yan , Weisi Lin