English
Related papers

Related papers: YTCommentQA: Video Question Answerability in Instr…

200 papers

Recent years have witnessed an increasing interest in image-based question-answering (QA) tasks. However, due to data limitations, there has been much less work on video-based QA. In this paper, we present TVQA, a large-scale video QA…

Computation and Language · Computer Science 2019-05-09 Jie Lei , Licheng Yu , Mohit Bansal , Tamara L. Berg

Video-based Question Answering (Video QA) is a challenging task and becomes even more intricate when addressing Socially Intelligent Question Answering (SIQA). SIQA requires context understanding, temporal reasoning, and the integration of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Aviral Agrawal , Carlos Mateo Samudio Lezcano , Iqui Balam Heredia-Marin , Prabhdeep Singh Sethi

Video Question Answering (VideoQA) has made significant strides by leveraging multimodal learning to align visual and textual modalities. However, current benchmarks overwhelmingly focus on questions answerable through explicit visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Sirnam Swetha , Rohit Gupta , Parth Parag Kulkarni , David G Shatwell , Jeffrey A Chan Santiago , Nyle Siddiqui , Joseph Fioresi , Mubarak Shah

Video question answering (VQA) is a multimodal task that requires the interpretation of a video to answer a given question. Existing VQA methods primarily utilize question and answer (Q&A) pairs to learn the spatio-temporal characteristics…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Ju-Young Oh , Ho-Joong Kim , Seong-Whan Lee

Video Question Answering (VideoQA) aims to answer natural language questions based on the given video, with prior work primarily focusing on identifying the duration of relevant segments, referred to as explicit visual evidence. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Tieyuan Chen , Huabin Liu , Yi Wang , Chaofan Gan , Mingxi Lyu , Ziran Qin , Shijie Li , Liquan Shen , Junhui Hou , Zheng Wang , Weiyao Lin

Video understanding has achieved great success in representation learning, such as video caption, video object grounding, and video descriptive question-answer. However, current methods still struggle on video reasoning, including evidence…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Jiangtong Li , Li Niu , Liqing Zhang

Video Question Answering is a challenging problem in visual information retrieval, which provides the answer to the referenced video content according to the question. However, the existing visual question answering approaches mainly tackle…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Yunan Ye , Zhou Zhao , Yimeng Li , Long Chen , Jun Xiao , Yueting Zhuang

Surprising videos, such as funny clips, creative performances, or visual illusions, attract significant attention. Enjoyment of these videos is not simply a response to visual stimuli; rather, it hinges on the human capacity to understand…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Binzhu Xie , Sicheng Zhang , Zitang Zhou , Bo Li , Yuanhan Zhang , Jack Hessel , Jingkang Yang , Ziwei Liu

Visual Question Answering (VQA) presents a unique challenge as it requires the ability to understand and encode the multi-modal inputs - in terms of image processing and natural language processing. The algorithm further needs to learn how…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Supriya Pandhre , Shagun Sodhani

Visual question answering (VQA) is a Multidisciplinary research problem that pursued through practices of natural language processing and computer vision. Visual question answering automatically answers natural language questions according…

Computer Vision and Pattern Recognition · Computer Science 2024-09-01 Param Ahir , Hiteishi Diwanji

While significant advancements have been made in video question answering (VideoQA), the potential benefits of enhancing model generalization through tailored difficulty scheduling have been largely overlooked in existing research. This…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Haopeng Li , Mohammed Bennamoun , Jun Liu , Hossein Rahmani , Qiuhong Ke

What does it take to design a machine that learns to answer natural questions about a video? A Video QA system must simultaneously understand language, represent visual content over space-time, and iteratively transform these…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Thao Minh Le , Vuong Le , Svetha Venkatesh , Truyen Tran

Video Question Answering (VideoQA) is a task that requires a model to analyze and understand both the visual content given by the input video and the textual part given by the question, and the interaction between them in order to produce a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Alex Falcon , Oswald Lanz , Giuseppe Serra

We present a framework to analyze various aspects of models for video question answering (VideoQA) using customizable synthetic datasets, which are constructed automatically from gameplay videos. Our work is motivated by the fact that…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Jonghwan Mun , Paul Hongsuck Seo , Ilchae Jung , Bohyung Han

Video Large Language Models (Video-LLMs) are flourishing and has advanced many video-language tasks. As a golden testbed, Video Question Answering (VideoQA) plays pivotal role in Video-LLM developing. This work conducts a timely and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Junbin Xiao , Nanxin Huang , Hangyu Qin , Dongyang Li , Yicong Li , Fengbin Zhu , Zhulin Tao , Jianxing Yu , Liang Lin , Tat-Seng Chua , Angela Yao

Questioning is a fundamental aspect of education, as it helps assess students' understanding, promotes critical thinking, and encourages active engagement. With the rise of artificial intelligence in education, there is a growing interest…

Computation and Language · Computer Science 2025-01-22 Nong Ming , Sachin Sharma , Jiho Noh

Video Question Answering (VQA) inherently relies on multimodal reasoning, integrating visual, temporal, and linguistic cues to achieve a deeper understanding of video content. However, many existing methods rely on feeding frame-level…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Noriyuki Kugo , Xiang Li , Zixin Li , Ashish Gupta , Arpandeep Khatua , Nidhish Jain , Chaitanya Patel , Yuta Kyuragi , Yasunori Ishii , Masamoto Tanabiki , Kazuki Kozuka , Ehsan Adeli

Video question answering that requires external knowledge beyond the visual content remains a significant challenge in AI systems. While models can effectively answer questions based on direct visual observations, they often falter when…

Information Retrieval · Computer Science 2025-02-19 Md Zarif Ul Alam , Hamed Zamani

Mathematical reasoning in real-world video settings presents a fundamentally different challenge than in static images or text. It requires interpreting fine-grained visual information, accurately reading handwritten or digital text, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Hanoona Rasheed , Abdelrahman Shaker , Anqi Tang , Muhammad Maaz , Ming-Hsuan Yang , Salman Khan , Fahad Shahbaz Khan

Reasoning about causal and temporal event relations in videos is a new destination of Video Question Answering (VideoQA).The major stumbling block to achieve this purpose is the semantic gap between language and video since they are at…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Shaoning Xiao , Long Chen , Kaifeng Gao , Zhao Wang , Yi Yang , Zhimeng Zhang , Jun Xiao