中文
相关论文

相关论文: MoReVQA: Exploring Modular Reasoning Models for Vi…

200 篇论文

Video Question Answering (VideoQA) is the task of answering the natural language questions about a video. Producing an answer requires understanding the interplay across visual scenes in video and linguistic semantics in question. However,…

计算与语言 · 计算机科学 2022-07-27 Yicong Li , Xiang Wang , Junbin Xiao , Tat-Seng Chua

In this paper, the LCV2 modular method is proposed for the Grounded Visual Question Answering task in the vision-language multimodal domain. This approach relies on a frozen large language model (LLM) as intermediate mediator between the…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Yuhan Chen , Lumei Su , Lihua Chen , Zhiwei Lin

In this technical report, we introduce a framework to address Grounded Video Question Answering (GVQA) task for the ICCV 2025 Perception Test Challenge. The GVQA task demands robust multimodal models capable of complex reasoning over video…

计算机视觉与模式识别 · 计算机科学 2025-11-05 Jinhwan Seo , Yoonki Cho , Junhyug Noh , Sung-eui Yoon

Video understanding has achieved great success in representation learning, such as video caption, video object grounding, and video descriptive question-answer. However, current methods still struggle on video reasoning, including evidence…

计算机视觉与模式识别 · 计算机科学 2022-05-31 Jiangtong Li , Li Niu , Liqing Zhang

This paper proposes a method to gain extra supervision via multi-task learning for multi-modal video question answering. Multi-modal video question answering is an important task that aims at the joint understanding of vision and language.…

计算机视觉与模式识别 · 计算机科学 2019-06-03 Junyeong Kim , Minuk Ma , Kyungsu Kim , Sungjin Kim , Chang D. Yoo

This paper considers the problem of Multi-Hop Video Question Answering (MH-VidQA) in long-form egocentric videos. This task not only requires to answer visual questions, but also to localize multiple relevant time intervals within the video…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Qirui Chen , Shangzhe Di , Weidi Xie

Video Question Answering (VideoQA) requires identifying sparse critical moments in long videos and reasoning about their causal relationships to answer semantically complex questions. While recent advances in multimodal learning have…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Xinxin Dong , Baoyun Peng , Haokai Ma , Yufei Wang , Zixuan Dong , Fei Hu , Xiaodong Wang

Generalization in Visual Question Answering (VQA) requires models to answer questions about images with contexts beyond the training distribution. Existing attempts primarily refine unimodal aspects, overlooking enhancements in multimodal…

人工智能 · 计算机科学 2023-10-10 Trang Nguyen , Naoaki Okazaki

Despite the recent progress made in Video Question-Answering (VideoQA), these methods typically function as black-boxes, making it difficult to understand their reasoning processes and perform consistent compositional reasoning. To address…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Zhaohe Liao , Jiangtong Li , Li Niu , Liqing Zhang

We introduce NExT-QA, a rigorously designed video question answering (VideoQA) benchmark to advance video understanding from describing to explaining the temporal actions. Based on the dataset, we set up multi-choice and open-ended QA tasks…

计算机视觉与模式识别 · 计算机科学 2021-05-25 Junbin Xiao , Xindi Shang , Angela Yao , Tat-Seng Chua

We present LLoVi, a language-based framework for long-range video question-answering (LVQA). Unlike prior long-range video understanding methods, which are often costly and require specialized long-range video modeling design (e.g., memory…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Ce Zhang , Taixi Lu , Md Mohaiminul Islam , Ziyang Wang , Shoubin Yu , Mohit Bansal , Gedas Bertasius

Video Question Answering (VideoQA), aiming to correctly answer the given question based on understanding multi-modal video content, is challenging due to the rich video content. From the perspective of video understanding, a good VideoQA…

计算机视觉与模式识别 · 计算机科学 2021-12-01 Jingjing Jiang , Ziyi Liu , Nanning Zheng

Understanding real-world videos such as movies requires integrating visual and dialogue cues. Yet existing VideoQA benchmarks struggle to capture this multimodal reasoning and, given the difficulty of evaluating free-form answers, largely…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Shaden Shaar , Bradon Thymes , Sirawut Chaixanien , Claire Cardie , Bharath Hariharan

Video question answering is a challenging task, which requires agents to be able to understand rich video contents and perform spatial-temporal reasoning. However, existing graph-based methods fail to perform multi-step reasoning well,…

多媒体 · 计算机科学 2021-07-14 Jianyu Wang , Bing-Kun Bao , Changsheng Xu

Audio-Visual Question Answering (AVQA) is a challenging multimodal reasoning task requiring intelligent systems to answer natural language queries based on paired audio-video inputs accurately. However, existing AVQA approaches often suffer…

多媒体 · 计算机科学 2025-04-03 Jie Ma , Zhitao Gao , Qi Chai , Jun Liu , Pinghui Wang , Jing Tao , Zhou Su

Video Question Answering (VideoQA) has emerged as a vital tool to evaluate agents' ability to understand human daily behaviors. Despite the recent success of large vision language models in many multi-modal tasks, complex situation…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Ziyi Bai , Ruiping Wang , Xilin Chen

Knowledge-Based Visual Question Answering (KB-VQA) methods focus on tasks that demand reasoning with information extending beyond the explicit content depicted in the image. Early methods relied on explicit knowledge bases to provide this…

计算与语言 · 计算机科学 2025-05-27 Mohammad Mahdi Moradi , Sudhir Mudur

Recent advances in test-time optimization have led to remarkable reasoning capabilities in Large Language Models (LLMs), enabling them to solve highly complex problems in math and coding. However, the reasoning capabilities of multimodal…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Ce Zhang , Yan-Bo Lin , Ziyang Wang , Mohit Bansal , Gedas Bertasius

Video question answering (VideoQA) is challenging given its multimodal combination of visual understanding and natural language processing. While most existing approaches ignore the visual appearance-motion information at different temporal…

计算机视觉与模式识别 · 计算机科学 2022-05-10 Min Peng , Chongyang Wang , Yuan Gao , Yu Shi , Xiang-Dong Zhou

To build Video Question Answering (VideoQA) systems capable of assisting humans in daily activities, seeking answers from long-form videos with diverse and complex events is a must. Existing multi-modal VQA models achieve promising…

计算机视觉与模式识别 · 计算机科学 2022-12-20 Difei Gao , Luowei Zhou , Lei Ji , Linchao Zhu , Yi Yang , Mike Zheng Shou