中文
相关论文

相关论文: Video Question Answering with Phrases via Semantic…

200 篇论文

Video Large Language Models (Video-LLMs) are flourishing and has advanced many video-language tasks. As a golden testbed, Video Question Answering (VideoQA) plays pivotal role in Video-LLM developing. This work conducts a timely and…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Junbin Xiao , Nanxin Huang , Hangyu Qin , Dongyang Li , Yicong Li , Fengbin Zhu , Zhulin Tao , Jianxing Yu , Liang Lin , Tat-Seng Chua , Angela Yao

Video Question Answering (VQA) is a recent emerging challenging task in the field of Computer Vision. Several visual information retrieval techniques like Video Captioning/Description and Video-guided Machine Translation have preceded the…

计算机视觉与模式识别 · 计算机科学 2021-03-19 Devshree Patel , Ratnam Parikh , Yesha Shastri

This paper focuses on answering fill-in-the-blank style multiple choice questions from the Visual Madlibs dataset. Previous approaches to Visual Question Answering (VQA) have mainly used generic image features from networks trained on the…

计算机视觉与模式识别 · 计算机科学 2016-08-12 Tatiana Tommasi , Arun Mallya , Bryan Plummer , Svetlana Lazebnik , Alexander C. Berg , Tamara L. Berg

Visual question answering (VQA) is an interesting learning setting for evaluating the abilities and shortcomings of current systems for image understanding. Many of the recently proposed VQA systems include attention or memory mechanisms…

计算机视觉与模式识别 · 计算机科学 2016-11-24 Allan Jabri , Armand Joulin , Laurens van der Maaten

Visual Question Answering (VQA) deep-learning systems tend to capture superficial statistical correlations in the training data because of strong language priors and fail to generalize to test data with a significantly different…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Jialin Wu , Raymond J. Mooney

In visual question answering (VQA), an algorithm must answer text-based questions about images. While multiple datasets for VQA have been created since late 2014, they all have flaws in both their content and the way algorithms are…

计算机视觉与模式识别 · 计算机科学 2017-09-15 Kushal Kafle , Christopher Kanan

Video Question Answering (VideoQA) has emerged as a challenging frontier in the field of multimedia processing, requiring intricate interactions between visual and textual modalities. Simply uniformly sampling frames or indiscriminately…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Jianxin Liang , Xiaojun Meng , Yueqian Wang , Chang Liu , Qun Liu , Dongyan Zhao

In question-answering scenarios, humans can assess whether the available information is sufficient and seek additional information if necessary, rather than providing a forced answer. In contrast, Vision Language Models (VLMs) typically…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Li Liu , Diji Yang , Sijia Zhong , Kalyana Suma Sree Tholeti , Lei Ding , Yi Zhang , Leilani H. Gilpin

Methodologies for training visual question answering (VQA) models assume the availability of datasets with human-annotated \textit{Image-Question-Answer} (I-Q-A) triplets. This has led to heavy reliance on datasets and a lack of…

计算机视觉与模式识别 · 计算机科学 2021-05-31 Pratyay Banerjee , Tejas Gokhale , Yezhou Yang , Chitta Baral

Scaling Visual Question Answering (VQA) to the open-domain and multi-hop nature of web searches, requires fundamental advances in visual representation learning, knowledge aggregation, and language generation. In this work, we introduce…

计算与语言 · 计算机科学 2022-03-29 Yingshan Chang , Mridu Narang , Hisami Suzuki , Guihong Cao , Jianfeng Gao , Yonatan Bisk

Visual Question Answering (VQA) is challenging due to the complex cross-modal relations. It has received extensive attention from the research community. From the human perspective, to answer a visual question, one needs to read the…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Hantao Huang , Tao Han , Wei Han , Deep Yap , Cheng-Ming Chiang

Visual question answering (VQA) is one of the crucial vision-and-language tasks. Yet, existing VQA research has mostly focused on the English language, due to a lack of suitable evaluation resources. Previous work on cross-lingual VQA has…

计算与语言 · 计算机科学 2023-06-12 Chen Liu , Jonas Pfeiffer , Anna Korhonen , Ivan Vulić , Iryna Gurevych

Video question-answering (QA) is a core task in video understanding. Evaluating the quality of video QA and video caption data quality for training video large language models (VideoLLMs) is an essential challenge. Although various methods…

计算机视觉与模式识别 · 计算机科学 2025-02-07 Hao Liang , Zirong Chen , Hejun Dong , Wentao Zhang

Visual Question Answering (VQA) is a challenging multimodal task to answer questions about an image. Many works concentrate on how to reduce language bias which makes models answer questions ignoring visual content and language context.…

计算机视觉与模式识别 · 计算机科学 2020-12-22 Chao Yang , Su Feng , Dongsheng Li , Huawei Shen , Guoqing Wang , Bin Jiang

Visual Question Answering (VQA) has been a popular task that combines vision and language, with numerous relevant implementations in literature. Even though there are some attempts that approach explainability and robustness issues in VQA…

计算与语言 · 计算机科学 2024-05-06 Theodoti Stoikou , Maria Lymperaiou , Giorgos Stamou

Embodied Question Answering (EQA) is a recently proposed task, where an agent is placed in a rich 3D environment and must act based solely on its egocentric input to answer a given question. The desired outcome is that the agent learns to…

计算机视觉与模式识别 · 计算机科学 2019-08-15 Cătălina Cangea , Eugene Belilovsky , Pietro Liò , Aaron Courville

Visual question answering requires a deep understanding of both images and natural language. However, most methods mainly focus on visual concept; such as the relationships between various objects. The limited use of object categories…

计算机视觉与模式识别 · 计算机科学 2021-01-25 Jung-Jun Kim , Dong-Gyu Lee , Jialin Wu , Hong-Gyu Jung , Seong-Whan Lee

Video question answering (VQA) is a multimodal task that requires the interpretation of a video to answer a given question. Existing VQA methods primarily utilize question and answer (Q&A) pairs to learn the spatio-temporal characteristics…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Ju-Young Oh , Ho-Joong Kim , Seong-Whan Lee

Video Question Answering is a challenging task, which requires the model to reason over multiple frames and understand the interaction between different objects to answer questions based on the context provided within the video, especially…

Recent advancements in Large Video Language Models (LVLMs) have highlighted their potential for multi-modal understanding, yet evaluating their factual grounding in videos remains a critical unsolved challenge. To address this gap, we…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Meng Cao , Pengfei Hu , Yingyao Wang , Jihao Gu , Haoran Tang , Haoze Zhao , Chen Wang , Jiahua Dong , Wangbo Yu , Ge Zhang , Jun Song , Xiang Li , Bo Zheng , Ian Reid , Xiaodan Liang