English
Related papers

Related papers: Towards Fine-Grained Video Question Answering

200 papers

Video understanding is a complex challenge that requires effective modeling of spatial-temporal dynamics. With the success of image foundation models (IFMs) in image understanding, recent approaches have explored parameter-efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yuhuan Yang , Chaofan Ma , Zhenjie Mao , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Recent advancements in Large Video-Language Models (LVLMs) have led to promising results in multimodal video understanding. However, it remains unclear whether these models possess the cognitive capabilities required for high-level tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Chenglin Li , Qianglong Chen , Zhi Li , Feng Tao , Yin Zhang

Long video question answering is a challenging task that involves recognizing short-term activities and reasoning about their fine-grained relationships. State-of-the-art video Large Language Models (vLLMs) hold promise as a viable solution…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Reuben Tan , Ximeng Sun , Ping Hu , Jui-hsien Wang , Hanieh Deilamsalehy , Bryan A. Plummer , Bryan Russell , Kate Saenko

Large multimodal models (LMMs) have shown remarkable progress in audio-visual understanding, yet they struggle with real-world scenarios that require complex reasoning across extensive video collections. Existing benchmarks for video…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Sanjoy Chowdhury , Mohamed Elmoghany , Yohan Abeysinghe , Junjie Fei , Sayan Nag , Salman Khan , Mohamed Elhoseiny , Dinesh Manocha

Video question answering is a challenging task, which requires agents to be able to understand rich video contents and perform spatial-temporal reasoning. However, existing graph-based methods fail to perform multi-step reasoning well,…

Multimedia · Computer Science 2021-07-14 Jianyu Wang , Bing-Kun Bao , Changsheng Xu

Visual Question Answering (VQA) is an interdisciplinary field that bridges the gap between computer vision (CV) and natural language processing(NLP), enabling Artificial Intelligence(AI) systems to answer questions about images. Since its…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Anupam Pandey , Deepjyoti Bodo , Arpan Phukan , Asif Ekbal

We address the problem of Visual Question Answering (VQA), which requires joint image and language understanding to answer a question about a given photograph. Recent approaches have applied deep image captioning methods based on…

Computer Vision and Pattern Recognition · Computer Science 2016-03-22 Huijuan Xu , Kate Saenko

We propose a novel framework for open-ended video question answering that enhances reasoning depth and robustness in complex real-world scenarios, as benchmarked on the CVRR-ES dataset. Existing Video-Large Multimodal Models (Video-LMMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Jun Xie , Zhaoran Zhao , Xiongjun Guan , Yingjian Zhu , Hongzhu Yi , Xinming Wang , Feng Chen , Zhepeng Wang

Video question answering (VQA) is a multimodal task that requires the interpretation of a video to answer a given question. Existing VQA methods primarily utilize question and answer (Q&A) pairs to learn the spatio-temporal characteristics…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Ju-Young Oh , Ho-Joong Kim , Seong-Whan Lee

Spatio-temporal localization is vital for precise interactions across diverse domains, from biological research to autonomous navigation and interactive interfaces. Current video-based approaches, while proficient in tracking, lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ghazi Shazan Ahmad , Ahmed Heakl , Hanan Gani , Abdelrahman Shaker , Zhiqiang Shen , Fahad Shahbaz Khan , Salman Khan

With the rapid development of multimedia processing and deep learning technologies, especially in the field of video understanding, video quality assessment (VQA) has achieved significant progress. Although researchers have moved from…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Jiebin Yan , Lei Wu , Yuming Fang , Xuelin Liu , Xue Xia , Weide Liu

With the ever-increasing popularity of pretrained Video-Language Models (VidLMs), there is a pressing need to develop robust evaluation methodologies that delve deeper into their visio-linguistic capabilities. To address this challenge, we…

We present SpatialMem, a memory-centric system for long-horizon, language-grounded retrieval and QA from egocentric video, where metric 3D serves as an interpretable indexing scaffold rather than an explicit mapping objective. Starting from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Xinyi Zheng , Yunze Liu , Chi-Hao Wu , Fan Zhang , Hao Zheng , Wenqi Zhou , Walterio W. Mayol-Cuevas , Junxiao Shen

Recent advancements in video large language models (Video LLMs) have significantly advanced the field of video question answering (VideoQA). While existing methods perform well on short videos, they often struggle with long-range reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Mustafa Chasmai , Gauri Jagatap , Gouthaman KV , Grant Van Horn , Subhransu Maji , Andrea Fanelli

What does it take to design a machine that learns to answer natural questions about a video? A Video QA system must simultaneously understand language, represent visual content over space-time, and iteratively transform these…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Thao Minh Le , Vuong Le , Svetha Venkatesh , Truyen Tran

In this technical report, we introduce a framework to address Grounded Video Question Answering (GVQA) task for the ICCV 2025 Perception Test Challenge. The GVQA task demands robust multimodal models capable of complex reasoning over video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Jinhwan Seo , Yoonki Cho , Junhyug Noh , Sung-eui Yoon

Video Question Answering (VideoQA) aims to answer natural language questions based on the given video, with prior work primarily focusing on identifying the duration of relevant segments, referred to as explicit visual evidence. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Tieyuan Chen , Huabin Liu , Yi Wang , Chaofan Gan , Mingxi Lyu , Ziran Qin , Shijie Li , Liquan Shen , Junhui Hou , Zheng Wang , Weiyao Lin

Video Question Answering (VideoQA) is a challenging task that requires understanding complex visual and temporal relationships within videos to answer questions accurately. In this work, we introduce \textbf{ReasVQA} (Reasoning-enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Jianxin Liang , Xiaojun Meng , Huishuai Zhang , Yueqian Wang , Jiansheng Wei , Dongyan Zhao

Visual Question Answering (VQA) focuses on providing answers to natural language questions by utilizing information from images. Although cutting-edge multimodal large language models (MLLMs) such as GPT-4o achieve strong performance on VQA…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Zhengxuan Zhang , Yin Wu , Yuyu Luo , Nan Tang

Video question answering (VideoQA) is a complex task that requires diverse multi-modal data for training. Manual annotation of question and answers for videos, however, is tedious and prohibits scalability. To tackle this problem, recent…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Antoine Yang , Antoine Miech , Josef Sivic , Ivan Laptev , Cordelia Schmid