English
Related papers

Related papers: MoReVQA: Exploring Modular Reasoning Models for Vi…

200 papers

Video Question Answering (VideoQA) is the task of answering the natural language questions about a video. Producing an answer requires understanding the interplay across visual scenes in video and linguistic semantics in question. However,…

Computation and Language · Computer Science 2022-07-27 Yicong Li , Xiang Wang , Junbin Xiao , Tat-Seng Chua

In this paper, the LCV2 modular method is proposed for the Grounded Visual Question Answering task in the vision-language multimodal domain. This approach relies on a frozen large language model (LLM) as intermediate mediator between the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yuhan Chen , Lumei Su , Lihua Chen , Zhiwei Lin

In this technical report, we introduce a framework to address Grounded Video Question Answering (GVQA) task for the ICCV 2025 Perception Test Challenge. The GVQA task demands robust multimodal models capable of complex reasoning over video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Jinhwan Seo , Yoonki Cho , Junhyug Noh , Sung-eui Yoon

Video understanding has achieved great success in representation learning, such as video caption, video object grounding, and video descriptive question-answer. However, current methods still struggle on video reasoning, including evidence…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Jiangtong Li , Li Niu , Liqing Zhang

This paper proposes a method to gain extra supervision via multi-task learning for multi-modal video question answering. Multi-modal video question answering is an important task that aims at the joint understanding of vision and language.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Junyeong Kim , Minuk Ma , Kyungsu Kim , Sungjin Kim , Chang D. Yoo

This paper considers the problem of Multi-Hop Video Question Answering (MH-VidQA) in long-form egocentric videos. This task not only requires to answer visual questions, but also to localize multiple relevant time intervals within the video…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Qirui Chen , Shangzhe Di , Weidi Xie

Video Question Answering (VideoQA) requires identifying sparse critical moments in long videos and reasoning about their causal relationships to answer semantically complex questions. While recent advances in multimodal learning have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Xinxin Dong , Baoyun Peng , Haokai Ma , Yufei Wang , Zixuan Dong , Fei Hu , Xiaodong Wang

Generalization in Visual Question Answering (VQA) requires models to answer questions about images with contexts beyond the training distribution. Existing attempts primarily refine unimodal aspects, overlooking enhancements in multimodal…

Artificial Intelligence · Computer Science 2023-10-10 Trang Nguyen , Naoaki Okazaki

Despite the recent progress made in Video Question-Answering (VideoQA), these methods typically function as black-boxes, making it difficult to understand their reasoning processes and perform consistent compositional reasoning. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zhaohe Liao , Jiangtong Li , Li Niu , Liqing Zhang

We introduce NExT-QA, a rigorously designed video question answering (VideoQA) benchmark to advance video understanding from describing to explaining the temporal actions. Based on the dataset, we set up multi-choice and open-ended QA tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Junbin Xiao , Xindi Shang , Angela Yao , Tat-Seng Chua

We present LLoVi, a language-based framework for long-range video question-answering (LVQA). Unlike prior long-range video understanding methods, which are often costly and require specialized long-range video modeling design (e.g., memory…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Ce Zhang , Taixi Lu , Md Mohaiminul Islam , Ziyang Wang , Shoubin Yu , Mohit Bansal , Gedas Bertasius

Video Question Answering (VideoQA), aiming to correctly answer the given question based on understanding multi-modal video content, is challenging due to the rich video content. From the perspective of video understanding, a good VideoQA…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Jingjing Jiang , Ziyi Liu , Nanning Zheng

Understanding real-world videos such as movies requires integrating visual and dialogue cues. Yet existing VideoQA benchmarks struggle to capture this multimodal reasoning and, given the difficulty of evaluating free-form answers, largely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Shaden Shaar , Bradon Thymes , Sirawut Chaixanien , Claire Cardie , Bharath Hariharan

Video question answering is a challenging task, which requires agents to be able to understand rich video contents and perform spatial-temporal reasoning. However, existing graph-based methods fail to perform multi-step reasoning well,…

Multimedia · Computer Science 2021-07-14 Jianyu Wang , Bing-Kun Bao , Changsheng Xu

Audio-Visual Question Answering (AVQA) is a challenging multimodal reasoning task requiring intelligent systems to answer natural language queries based on paired audio-video inputs accurately. However, existing AVQA approaches often suffer…

Multimedia · Computer Science 2025-04-03 Jie Ma , Zhitao Gao , Qi Chai , Jun Liu , Pinghui Wang , Jing Tao , Zhou Su

Video Question Answering (VideoQA) has emerged as a vital tool to evaluate agents' ability to understand human daily behaviors. Despite the recent success of large vision language models in many multi-modal tasks, complex situation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Ziyi Bai , Ruiping Wang , Xilin Chen

Knowledge-Based Visual Question Answering (KB-VQA) methods focus on tasks that demand reasoning with information extending beyond the explicit content depicted in the image. Early methods relied on explicit knowledge bases to provide this…

Computation and Language · Computer Science 2025-05-27 Mohammad Mahdi Moradi , Sudhir Mudur

Recent advances in test-time optimization have led to remarkable reasoning capabilities in Large Language Models (LLMs), enabling them to solve highly complex problems in math and coding. However, the reasoning capabilities of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Ce Zhang , Yan-Bo Lin , Ziyang Wang , Mohit Bansal , Gedas Bertasius

Video question answering (VideoQA) is challenging given its multimodal combination of visual understanding and natural language processing. While most existing approaches ignore the visual appearance-motion information at different temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Min Peng , Chongyang Wang , Yuan Gao , Yu Shi , Xiang-Dong Zhou

To build Video Question Answering (VideoQA) systems capable of assisting humans in daily activities, seeking answers from long-form videos with diverse and complex events is a must. Existing multi-modal VQA models achieve promising…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Difei Gao , Luowei Zhou , Lei Ji , Linchao Zhu , Yi Yang , Mike Zheng Shou