中文
相关论文

相关论文: Towards Fine-Grained Video Question Answering

200 篇论文

Video understanding is a complex challenge that requires effective modeling of spatial-temporal dynamics. With the success of image foundation models (IFMs) in image understanding, recent approaches have explored parameter-efficient…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Yuhuan Yang , Chaofan Ma , Zhenjie Mao , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Recent advancements in Large Video-Language Models (LVLMs) have led to promising results in multimodal video understanding. However, it remains unclear whether these models possess the cognitive capabilities required for high-level tasks,…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Chenglin Li , Qianglong Chen , Zhi Li , Feng Tao , Yin Zhang

Long video question answering is a challenging task that involves recognizing short-term activities and reasoning about their fine-grained relationships. State-of-the-art video Large Language Models (vLLMs) hold promise as a viable solution…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Reuben Tan , Ximeng Sun , Ping Hu , Jui-hsien Wang , Hanieh Deilamsalehy , Bryan A. Plummer , Bryan Russell , Kate Saenko

Large multimodal models (LMMs) have shown remarkable progress in audio-visual understanding, yet they struggle with real-world scenarios that require complex reasoning across extensive video collections. Existing benchmarks for video…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Sanjoy Chowdhury , Mohamed Elmoghany , Yohan Abeysinghe , Junjie Fei , Sayan Nag , Salman Khan , Mohamed Elhoseiny , Dinesh Manocha

Video question answering is a challenging task, which requires agents to be able to understand rich video contents and perform spatial-temporal reasoning. However, existing graph-based methods fail to perform multi-step reasoning well,…

多媒体 · 计算机科学 2021-07-14 Jianyu Wang , Bing-Kun Bao , Changsheng Xu

Visual Question Answering (VQA) is an interdisciplinary field that bridges the gap between computer vision (CV) and natural language processing(NLP), enabling Artificial Intelligence(AI) systems to answer questions about images. Since its…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Anupam Pandey , Deepjyoti Bodo , Arpan Phukan , Asif Ekbal

We address the problem of Visual Question Answering (VQA), which requires joint image and language understanding to answer a question about a given photograph. Recent approaches have applied deep image captioning methods based on…

计算机视觉与模式识别 · 计算机科学 2016-03-22 Huijuan Xu , Kate Saenko

We propose a novel framework for open-ended video question answering that enhances reasoning depth and robustness in complex real-world scenarios, as benchmarked on the CVRR-ES dataset. Existing Video-Large Multimodal Models (Video-LMMs)…

计算机视觉与模式识别 · 计算机科学 2025-07-21 Jun Xie , Zhaoran Zhao , Xiongjun Guan , Yingjian Zhu , Hongzhu Yi , Xinming Wang , Feng Chen , Zhepeng Wang

Video question answering (VQA) is a multimodal task that requires the interpretation of a video to answer a given question. Existing VQA methods primarily utilize question and answer (Q&A) pairs to learn the spatio-temporal characteristics…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Ju-Young Oh , Ho-Joong Kim , Seong-Whan Lee

Spatio-temporal localization is vital for precise interactions across diverse domains, from biological research to autonomous navigation and interactive interfaces. Current video-based approaches, while proficient in tracking, lack the…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Ghazi Shazan Ahmad , Ahmed Heakl , Hanan Gani , Abdelrahman Shaker , Zhiqiang Shen , Fahad Shahbaz Khan , Salman Khan

With the rapid development of multimedia processing and deep learning technologies, especially in the field of video understanding, video quality assessment (VQA) has achieved significant progress. Although researchers have moved from…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Jiebin Yan , Lei Wu , Yuming Fang , Xuelin Liu , Xue Xia , Weide Liu

With the ever-increasing popularity of pretrained Video-Language Models (VidLMs), there is a pressing need to develop robust evaluation methodologies that delve deeper into their visio-linguistic capabilities. To address this challenge, we…

We present SpatialMem, a memory-centric system for long-horizon, language-grounded retrieval and QA from egocentric video, where metric 3D serves as an interpretable indexing scaffold rather than an explicit mapping objective. Starting from…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Xinyi Zheng , Yunze Liu , Chi-Hao Wu , Fan Zhang , Hao Zheng , Wenqi Zhou , Walterio W. Mayol-Cuevas , Junxiao Shen

Recent advancements in video large language models (Video LLMs) have significantly advanced the field of video question answering (VideoQA). While existing methods perform well on short videos, they often struggle with long-range reasoning…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Mustafa Chasmai , Gauri Jagatap , Gouthaman KV , Grant Van Horn , Subhransu Maji , Andrea Fanelli

What does it take to design a machine that learns to answer natural questions about a video? A Video QA system must simultaneously understand language, represent visual content over space-time, and iteratively transform these…

计算机视觉与模式识别 · 计算机科学 2020-04-14 Thao Minh Le , Vuong Le , Svetha Venkatesh , Truyen Tran

In this technical report, we introduce a framework to address Grounded Video Question Answering (GVQA) task for the ICCV 2025 Perception Test Challenge. The GVQA task demands robust multimodal models capable of complex reasoning over video…

计算机视觉与模式识别 · 计算机科学 2025-11-05 Jinhwan Seo , Yoonki Cho , Junhyug Noh , Sung-eui Yoon

Video Question Answering (VideoQA) aims to answer natural language questions based on the given video, with prior work primarily focusing on identifying the duration of relevant segments, referred to as explicit visual evidence. However,…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Tieyuan Chen , Huabin Liu , Yi Wang , Chaofan Gan , Mingxi Lyu , Ziran Qin , Shijie Li , Liquan Shen , Junhui Hou , Zheng Wang , Weiyao Lin

Video Question Answering (VideoQA) is a challenging task that requires understanding complex visual and temporal relationships within videos to answer questions accurately. In this work, we introduce \textbf{ReasVQA} (Reasoning-enhanced…

计算机视觉与模式识别 · 计算机科学 2025-01-24 Jianxin Liang , Xiaojun Meng , Huishuai Zhang , Yueqian Wang , Jiansheng Wei , Dongyan Zhao

Visual Question Answering (VQA) focuses on providing answers to natural language questions by utilizing information from images. Although cutting-edge multimodal large language models (MLLMs) such as GPT-4o achieve strong performance on VQA…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Zhengxuan Zhang , Yin Wu , Yuyu Luo , Nan Tang

Video question answering (VideoQA) is a complex task that requires diverse multi-modal data for training. Manual annotation of question and answers for videos, however, is tedious and prohibits scalability. To tackle this problem, recent…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Antoine Yang , Antoine Miech , Josef Sivic , Ivan Laptev , Cordelia Schmid