中文
相关论文

相关论文: Robust Explanations for Visual Question Answering

200 篇论文

Visual Question Answering (VQA) models take an image and a natural-language question as input and infer the answer to the question. Recently, VQA systems in medical imaging have gained popularity thanks to potential advantages such as…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

Deep models are the defacto standard in visual decision problems due to their impressive performance on a wide array of visual tasks. On the other hand, their opaqueness has led to a surge of interest in explainable systems. In this work,…

计算机视觉与模式识别 · 计算机科学 2017-11-21 Dong Huk Park , Lisa Anne Hendricks , Zeynep Akata , Anna Rohrbach , Bernt Schiele , Trevor Darrell , Marcus Rohrbach

We study visually grounded VideoQA in response to the emerging trends of utilizing pretraining techniques for video-language understanding. Specifically, by forcing vision-language models (VLMs) to answer questions and simultaneously…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Junbin Xiao , Angela Yao , Yicong Li , Tat Seng Chua

Visual Question Answering (VQA) methods have made incredible progress, but suffer from a failure to generalize. This is visible in the fact that they are vulnerable to learning coincidental correlations in the data rather than deeper…

计算机视觉与模式识别 · 计算机科学 2020-02-27 Xinyu Wang , Yuliang Liu , Chunhua Shen , Chun Chet Ng , Canjie Luo , Lianwen Jin , Chee Seng Chan , Anton van den Hengel , Liangwei Wang

Visual question answering (VQA) is the task of answering questions about an image. The task assumes an understanding of both the image and the question to provide a natural language answer. VQA has gained popularity in recent years due to…

计算机视觉与模式识别 · 计算机科学 2023-11-01 Deepanway Ghosal , Navonil Majumder , Roy Ka-Wei Lee , Rada Mihalcea , Soujanya Poria

Visual Question Answering (VQA) is an extremely stimulating and challenging research area where Computer Vision (CV) and Natural Language Processig (NLP) have recently met. In image captioning and video summarization, the semantic…

计算机视觉与模式识别 · 计算机科学 2021-03-09 Silvio Barra , Carmen Bisogni , Maria De Marsico , Stefano Ricciardi

How to select relevant key objects and reason about the complex relationships cross vision and linguistic domain are two key issues in many multi-modality applications such as visual question answering (VQA). In this work, we incorporate…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Zongzhao Li , Xiangyu Zhu , Xi Zhang , Zhaoxiang Zhang , Zhen Lei

Zero-shot Visual Question Answering (VQA) is a prominent vision-language task that examines both the visual and textual understanding capability of systems in the absence of training data. Recently, by converting the images into captions,…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Yunshi Lan , Xiang Li , Xin Liu , Yang Li , Wei Qin , Weining Qian

Video text-based visual question answering (Video TextVQA) is a practical task that aims to answer questions by jointly reasoning textual and visual information in a given video. Inspired by the development of TextVQA in image domain,…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Yan Zhang , Gangyan Zeng , Huawen Shen , Daiqing Wu , Yu Zhou , Can Ma

The observation that computer vision methods overfit to dataset specifics has inspired diverse attempts to make object recognition models robust to domain shifts. However, similar work on domain-robust visual question answering methods is…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Mingda Zhang , Tristan Maidment , Ahmad Diab , Adriana Kovashka , Rebecca Hwa

Video-based Question Answering (Video QA) is a challenging task and becomes even more intricate when addressing Socially Intelligent Question Answering (SIQA). SIQA requires context understanding, temporal reasoning, and the integration of…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Aviral Agrawal , Carlos Mateo Samudio Lezcano , Iqui Balam Heredia-Marin , Prabhdeep Singh Sethi

Establishing a clear link between model predictions and the visual evidence that supports them is critical for transparency and reliability in multimodal reasoning, yet current multimodal large language model (MLLM) evaluations do not…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Mozhgan Nasr Azadani , Yimu Wang , Yongpeng Zhu , Lihong Chen , Milan Ganai , Sean Sedwards , Marco Pavone , Krzysztof Czarnecki

Visual Question Answering (VQA) has emerged as a highly engaging field in recent years, with increasing research focused on enhancing VQA accuracy through advanced models such as Transformers. Despite this growing interest, limited work has…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Zhilin Zhang , Fangyu Wu

This work deals with the challenge of learning and reasoning over language and vision data for the related downstream tasks such as visual question answering (VQA) and natural language for visual reasoning (NLVR). We design a novel…

计算与语言 · 计算机科学 2020-05-14 Chen Zheng , Quan Guo , Parisa Kordjamshidi

This paper proposes the first video-grounded entailment tree reasoning method for commonsense video question answering (VQA). Despite the remarkable progress of large visual-language models (VLMs), there are growing concerns that they learn…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Huabin Liu , Filip Ilievski , Cees G. M. Snoek

Medical Visual Question Answering~(VQA) is a combination of medical artificial intelligence and popular VQA challenges. Given a medical image and a clinically relevant question in natural language, the medical VQA system is expected to…

计算机视觉与模式识别 · 计算机科学 2023-06-12 Zhihong Lin , Donghao Zhang , Qingyi Tao , Danli Shi , Gholamreza Haffari , Qi Wu , Mingguang He , Zongyuan Ge

Visual Question Answering (VQA) has received a lot of attention over the past couple of years. A number of deep learning models have been proposed for this task. However, it has been shown that these models are heavily driven by superficial…

计算机视觉与模式识别 · 计算机科学 2017-04-27 Aishwarya Agrawal , Aniruddha Kembhavi , Dhruv Batra , Devi Parikh

Visual Question Answering (VQA) is a challenging multimodal task to answer questions about an image. Many works concentrate on how to reduce language bias which makes models answer questions ignoring visual content and language context.…

计算机视觉与模式识别 · 计算机科学 2020-12-22 Chao Yang , Su Feng , Dongsheng Li , Huawei Shen , Guoqing Wang , Bin Jiang

Deep Neural Networks have been successfully used for the task of Visual Question Answering for the past few years owing to the availability of relevant large scale datasets. However these datasets are created in artificial settings and…

计算机视觉与模式识别 · 计算机科学 2020-06-17 Shaunak Halbe

Visual question answering (VQA) systems are emerging from a desire to empower users to ask any natural language question about visual content and receive a valid answer in response. However, close examination of the VQA problem reveals an…

人工智能 · 计算机科学 2016-08-30 Danna Gurari , Kristen Grauman