中文
相关论文

相关论文: Barlow constrained optimization for Visual Questio…

200 篇论文

Knowledge-Based Visual Question Answering (KBVQA) is a bi-modal task requiring external world knowledge in order to correctly answer a text question and associated image. Recent single modality text work has shown knowledge injection into…

计算与语言 · 计算机科学 2022-05-30 Diego Garcia-Olano , Yasumasa Onoe , Joydeep Ghosh

Visual Question Answering (VQA) requires integration of feature maps with drastically different structures and focus of the correct regions. Image descriptors have structures at multiple spatial scales, while lexical inputs inherently…

计算机视觉与模式识别 · 计算机科学 2018-07-20 Yang Shi , Tommaso Furlanello , Sheng Zha , Animashree Anandkumar

The Visual Question Answering (VQA) task combines challenges for processing data with both Visual and Linguistic processing, to answer basic `common sense' questions about given images. Given an image and a question in natural language, the…

计算机视觉与模式识别 · 计算机科学 2020-12-24 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey , Snehasis Mukherjee

Visual question answering (VQA) usesimage processing algorithms to process the image and natural language processing methods to understand and answer the question. VQA is helpful to a visually impaired person, can be used for the security…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Param Ahir , Hiteishi M. Diwanji

Recent advancements in deep learning have led to the development of powerful language models (LMs) that excel in various tasks. Despite these achievements, there is still room for improvement, particularly in enhancing reasoning abilities…

计算与语言 · 计算机科学 2023-12-27 Abhinav Arun , Dipendra Singh Mal , Mehul Soni , Tomohiro Sawada

Visual question answering (VQA) demands simultaneous comprehension of both the image visual content and natural language questions. In some cases, the reasoning needs the help of common sense or general knowledge which usually appear in the…

计算机视觉与模式识别 · 计算机科学 2018-11-30 Hui Li , Peng Wang , Chunhua Shen , Anton van den Hengel

Visual question answering (VQA) is an interesting learning setting for evaluating the abilities and shortcomings of current systems for image understanding. Many of the recently proposed VQA systems include attention or memory mechanisms…

计算机视觉与模式识别 · 计算机科学 2016-11-24 Allan Jabri , Armand Joulin , Laurens van der Maaten

In visual question answering (VQA), an algorithm must answer text-based questions about images. While multiple datasets for VQA have been created since late 2014, they all have flaws in both their content and the way algorithms are…

计算机视觉与模式识别 · 计算机科学 2017-09-15 Kushal Kafle , Christopher Kanan

While multimodal large language models excel at tasks that integrate visual perception with symbolic reasoning, their performance is often undermined by a critical vulnerability: perception-induced errors that propagate through the…

Models for Visual Question Answering (VQA) often rely on the spurious correlations, i.e., the language priors, that appear in the biased samples of training set, which make them brittle against the out-of-distribution (OOD) test data.…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Qingyi Si , Yuanxin Liu , Fandong Meng , Zheng Lin , Peng Fu , Yanan Cao , Weiping Wang , Jie Zhou

Since its appearance, Visual Question Answering (VQA, i.e. answering a question posed over an image), has always been treated as a classification problem over a set of predefined answers. Despite its convenience, this classification…

计算机视觉与模式识别 · 计算机科学 2021-04-09 Corentin Kervadec , Grigory Antipov , Moez Baccouche , Christian Wolf

This paper presents a new framework for visual bag-of-words (BOW) refinement and reduction to overcome the drawbacks associated with the visual BOW model which has been widely used for image classification. Although very influential in the…

计算机视觉与模式识别 · 计算机科学 2017-07-04 Zhiwu Lu , Liwei Wang , Ji-Rong Wen

The recent advancements in Vision Language Models (VLMs) have demonstrated progress toward true intelligence requiring robust reasoning capabilities. Beyond pattern recognition, linguistic reasoning must integrate with visual comprehension,…

人工智能 · 计算机科学 2026-04-06 Yunfei Bai , Amit Dhanda , Shekhar Jain

Visual Question Answering (VQA) has emerged as a highly engaging field in recent years, with increasing research focused on enhancing VQA accuracy through advanced models such as Transformers. Despite this growing interest, limited work has…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Zhilin Zhang , Fangyu Wu

Visual question answering (VQA) has witnessed great progress since May, 2015 as a classic problem unifying visual and textual data into a system. Many enlightening VQA works explore deep into the image and question encodings and fusing…

计算机视觉与模式识别 · 计算机科学 2017-02-23 Yuetan Lin , Zhangyang Pang , Donghui Wang , Yueting Zhuang

Several studies have recently pointed that existing Visual Question Answering (VQA) models heavily suffer from the language prior problem, which refers to capturing superficial statistical correlations between the question type and the…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Yudong Han , Liqiang Nie , Jianhua Yin , Jianlong Wu , Yan Yan

Deep neural networks have been critical in the task of Visual Question Answering (VQA), with research traditionally focused on improving model accuracy. Recently, however, there has been a trend towards evaluating the robustness of these…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Jia-Hong Huang , Modar Alfadly , Bernard Ghanem , Marcel Worring

Visual question answering (VQA) is challenging because it requires a simultaneous understanding of both visual content of images and textual content of questions. To support the VQA task, we need to find good solutions for the following…

计算机视觉与模式识别 · 计算机科学 2019-05-17 Zhou Yu , Jun Yu , Chenchao Xiang , Jianping Fan , Dacheng Tao

Visual question answering (VQA) is a task that combines both the techniques of computer vision and natural language processing. It requires models to answer a text-based question according to the information contained in a visual. In recent…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Yeyun Zou , Qiyu Xie

Bridging the semantic gap between image and question is an important step to improve the accuracy of the Visual Question Answering (VQA) task. However, most of the existing VQA methods focus on attention mechanisms or visual relations for…

计算机视觉与模式识别 · 计算机科学 2022-04-20 Binh X. Nguyen , Tuong Do , Huy Tran , Erman Tjiputra , Quang D. Tran , Anh Nguyen