中文
相关论文

相关论文: An experimental study of the vision-bottleneck in …

200 篇论文

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…

This study explores innovative methods for improving Visual Question Answering (VQA) using Generative Adversarial Networks (GANs), autoencoders, and attention mechanisms. Leveraging a balanced VQA dataset, we investigate three distinct…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Panfeng Li , Qikai Yang , Xieming Geng , Wenjing Zhou , Zhicheng Ding , Yi Nian

Vision and language understanding has emerged as a subject undergoing intense study in Artificial Intelligence. Among many tasks in this line of research, visual question answering (VQA) has been one of the most successful ones, where the…

计算机视觉与模式识别 · 计算机科学 2017-12-05 Yunseok Jang , Yale Song , Youngjae Yu , Youngjin Kim , Gunhee Kim

Visual question answering (VQA) is a challenging task, which has attracted more and more attention in the field of computer vision and natural language processing. However, the current visual question answering has the problem of language…

计算机视觉与模式识别 · 计算机科学 2021-11-17 Desen Yuan

Artificial Intelligence (AI) and its applications have sparked extraordinary interest in recent years. This achievement can be ascribed in part to advances in AI subfields including Machine Learning (ML), Computer Vision (CV), and Natural…

计算机视觉与模式识别 · 计算机科学 2023-01-02 Rufai Yusuf Zakari , Jim Wilson Owusu , Hailin Wang , Ke Qin , Zaharaddeen Karami Lawal , Yuezhou Dong

The various limitations of Generative AI, such as hallucinations and model failures, have made it crucial to understand the role of different modalities in Visual Language Model (VLM) predictions. Our work investigates how the integration…

人工智能 · 计算机科学 2024-10-03 Kenza Amara , Lukas Klein , Carsten Lüth , Paul Jäger , Hendrik Strobelt , Mennatallah El-Assady

Visual Question Answering (VQA) concerns providing answers to Natural Language questions about images. Several deep neural network approaches have been proposed to model the task in an end-to-end fashion. Whereas the task is grounded in…

人工智能 · 计算机科学 2020-02-03 Mehrdad Alizadeh , Barbara Di Eugenio

Taking an image and question as the input of our method, it can output the text-based answer of the query question about the given image, so called Visual Question Answering (VQA). There are two main modules in our algorithm. Given a…

计算机视觉与模式识别 · 计算机科学 2017-08-30 Jia-Hong Huang , Modar Alfadly , Bernard Ghanem

Visual Question Answering systems target answering open-ended textual questions given input images. They are a testbed for learning high-level reasoning with a primary use in HCI, for instance assistance for the visually impaired. Recent…

计算机视觉与模式识别 · 计算机科学 2021-07-21 Theo Jaunet , Corentin Kervadec , Romain Vuillemot , Grigory Antipov , Moez Baccouche , Christian Wolf

Visual question answering (VQA) is the task of answering questions about an image. The task assumes an understanding of both the image and the question to provide a natural language answer. VQA has gained popularity in recent years due to…

计算机视觉与模式识别 · 计算机科学 2023-11-01 Deepanway Ghosal , Navonil Majumder , Roy Ka-Wei Lee , Rada Mihalcea , Soujanya Poria

Visual Question Answering (VQA) emerges as one of the most fascinating topics in computer vision recently. Many state of the art methods naively use holistic visual features with language features into a Long Short-Term Memory (LSTM)…

计算机视觉与模式识别 · 计算机科学 2015-11-19 Aiwen Jiang , Fang Wang , Fatih Porikli , Yi Li

Visual question answering (VQA) is one of the crucial vision-and-language tasks. Yet, existing VQA research has mostly focused on the English language, due to a lack of suitable evaluation resources. Previous work on cross-lingual VQA has…

计算与语言 · 计算机科学 2023-06-12 Chen Liu , Jonas Pfeiffer , Anna Korhonen , Ivan Vulić , Iryna Gurevych

Knowledge-based Vision Question Answering (KB-VQA) extends general Vision Question Answering (VQA) by not only requiring the understanding of visual and textual inputs but also extensive range of knowledge, enabling significant advancements…

计算机视觉与模式识别 · 计算机科学 2025-04-25 Jiaqi Deng , Zonghan Wu , Huan Huo , Guandong Xu

Knowledge-based visual question answering (KB-VQA) is a challenging task, which requires the model to leverage external knowledge for comprehending and answering questions grounded in visual content. Recent studies retrieve the knowledge…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Dongze Hao , Jian Jia , Longteng Guo , Qunbo Wang , Te Yang , Yan Li , Yanhua Cheng , Bo Wang , Quan Chen , Han Li , Jing Liu

Different approaches have been proposed to Visual Question Answering (VQA). However, few works are aware of the behaviors of varying joint modality methods over question type prior knowledge extracted from data in constraining answer search…

计算机视觉与模式识别 · 计算机科学 2020-09-24 Tuong Do , Binh X. Nguyen , Huy Tran , Erman Tjiputra , Quang D. Tran , Thanh-Toan Do

The Visual Question Answering (VQA) task utilizes both visual image and language analysis to answer a textual question with respect to an image. It has been a popular research topic with an increasing number of real-world applications in…

Vision language models (VLMs) have achieved remarkable success in broad visual understanding, yet they remain challenged by object-centric reasoning on rare objects due to the scarcity of such instances in pretraining data. While prior…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Xin Hu , Haomiao Ni , Yunbei Zhang , Jihun Hamm , Zechen Li , Zhengming Ding

Humans apprehend the world through various sensory modalities, yet language is their predominant communication channel. Machine learning systems need to draw on the same multimodal richness to have informed discourses with humans in natural…

计算机视觉与模式识别 · 计算机科学 2022-08-25 Min Wang , Ata Mahjoubfar , Anupama Joshi

We propose the task of free-form and open-ended Visual Question Answering (VQA). Given an image and a natural language question about the image, the task is to provide an accurate natural language answer. Mirroring real-world scenarios,…

计算与语言 · 计算机科学 2016-10-28 Aishwarya Agrawal , Jiasen Lu , Stanislaw Antol , Margaret Mitchell , C. Lawrence Zitnick , Dhruv Batra , Devi Parikh

Visual Question and Answering (VQA) problems are attracting increasing interest from multiple research disciplines. Solving VQA problems requires techniques from both computer vision for understanding the visual contents of a presented…

计算机视觉与模式识别 · 计算机科学 2016-04-07 Ilija Ilievski , Shuicheng Yan , Jiashi Feng