English
Related papers

Related papers: Cross-modal Causal Relation Alignment for Video Qu…

200 papers

Video Question Answering (VideoQA) is the task of answering questions about a video. At its core is understanding the alignments between visual scenes in video and linguistic semantics in question to yield the answer. In leading VideoQA…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yicong Li , Xiang Wang , Junbin Xiao , Wei Ji , Tat-Seng Chua

Existing methods for video question answering (VideoQA) often suffer from spurious correlations between different modalities, leading to a failure in identifying the dominant visual evidence and the intended question. Moreover, these…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Yushen Wei , Yang Liu , Hong Yan , Guanbin Li , Liang Lin

Reasoning about causal and temporal event relations in videos is a new destination of Video Question Answering (VideoQA).The major stumbling block to achieve this purpose is the semantic gap between language and video since they are at…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Shaoning Xiao , Long Chen , Kaifeng Gao , Zhao Wang , Yi Yang , Zhimeng Zhang , Jun Xiao

Long-term Video Question Answering (VideoQA) is a challenging vision-and-language bridging task focusing on semantic understanding of untrimmed long-term videos and diverse free-form questions, simultaneously emphasizing comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Ting Yu , Kunhao Fu , Jian Zhang , Qingming Huang , Jun Yu

Video Question Answering (VideoQA) aims to answer natural language questions based on the information observed in videos. Despite the recent success of Large Multimodal Models (LMMs) in image-language understanding and reasoning, they deal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Haibo Wang , Chenghang Lai , Yixuan Sun , Weifeng Ge

Existing visual question reasoning methods usually fail to explicitly discover the inherent causal mechanism and ignore jointly modeling cross-modal event temporality and causality. In this paper, we propose a visual question reasoning…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Yang Liu , Ying Tan , Jingzhou Luo , Weixing Chen

Video Question Answering (VideoQA) has made significant strides by leveraging multimodal learning to align visual and textual modalities. However, current benchmarks overwhelmingly focus on questions answerable through explicit visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Sirnam Swetha , Rohit Gupta , Parth Parag Kulkarni , David G Shatwell , Jeffrey A Chan Santiago , Nyle Siddiqui , Joseph Fioresi , Mubarak Shah

Video Question Answering (VideoQA) is a very attractive and challenging research direction aiming to understand complex semantics of heterogeneous data from two domains, i.e., the spatio-temporal video content and the word sequence in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Chengxiang Yin , Zhengping Che , Kun Wu , Zhiyuan Xu , Qinru Qiu , Jian Tang

The task of language-guided video temporal grounding is to localize the particular video clip corresponding to a query sentence in an untrimmed video. Though progress has been made continuously in this field, some issues still need to be…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Binjie Zhang , Yu Li , Chun Yuan , Dejing Xu , Pin Jiang , Ying Shan

Video Question Answering (VideoQA) requires identifying sparse critical moments in long videos and reasoning about their causal relationships to answer semantically complex questions. While recent advances in multimodal learning have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Xinxin Dong , Baoyun Peng , Haokai Ma , Yufei Wang , Zixuan Dong , Fei Hu , Xiaodong Wang

Existing visual question answering methods often suffer from cross-modal spurious correlations and oversimplified event-level reasoning processes that fail to capture event temporality, causality, and dynamics spanning over the video. In…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Yang Liu , Guanbin Li , Liang Lin

Video Temporal Grounding (VTG) faces a cross-modal semantic gap that often leads to background features being incorrectly aligned with the query, while directly matching the query to moments results in insufficient discriminability and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Ran Ran , Jiwei Wei , Shuchang Zhou , Yitong Qin , Shiyuan He , Zeyu Ma , Yuyang Zhou , Yang Yang

We introduce CausalVQA, a benchmark dataset for video question answering (VQA) composed of question-answer pairs that probe models' understanding of causality in the physical world. Existing VQA benchmarks either tend to focus on surface…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Aaron Foss , Chloe Evans , Sasha Mitts , Koustuv Sinha , Ammar Rizvi , Justine T. Kao

We study visually grounded VideoQA in response to the emerging trends of utilizing pretraining techniques for video-language understanding. Specifically, by forcing vision-language models (VLMs) to answer questions and simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Junbin Xiao , Angela Yao , Yicong Li , Tat Seng Chua

Video Question Answering (VideoQA) is the task of answering the natural language questions about a video. Producing an answer requires understanding the interplay across visual scenes in video and linguistic semantics in question. However,…

Computation and Language · Computer Science 2022-07-27 Yicong Li , Xiang Wang , Junbin Xiao , Tat-Seng Chua

Grounding temporal video segments described in natural language queries effectively and efficiently is a crucial capability needed in vision-and-language fields. In this paper, we deal with the fast video temporal grounding (FVTG) task,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Ziyue Wu , Junyu Gao , Shucheng Huang , Changsheng Xu

Multi-modal reasoning in visual question answering (VQA) has witnessed rapid progress recently. However, most reasoning models heavily rely on shortcuts learned from training data, which prevents their usage in challenging real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Qi Zheng , Chaoyue Wang , Daqing Liu , Dadong Wang , Dacheng Tao

In this technical report, we introduce a framework to address Grounded Video Question Answering (GVQA) task for the ICCV 2025 Perception Test Challenge. The GVQA task demands robust multimodal models capable of complex reasoning over video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Jinhwan Seo , Yoonki Cho , Junhyug Noh , Sung-eui Yoon

Video question answering (VideoQA) is challenging as it requires modeling capacity to distill dynamic visual artifacts and distant relations and to associate them with linguistic concepts. We introduce a general-purpose reusable neural unit…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Thao Minh Le , Vuong Le , Svetha Venkatesh , Truyen Tran

We propose GHR-VQA, Graph-guided Hierarchical Relational Reasoning for Video Question Answering (Video QA), a novel human-centric framework that incorporates scene graphs to capture intricate human-object interactions within video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Dionysia Danai Brilli , Dimitrios Mallis , Vassilis Pitsikalis , Petros Maragos
‹ Prev 1 2 3 10 Next ›