中文
相关论文

相关论文: Reducing Language Biases in Visual Question Answer…

200 篇论文

Since its inception, Visual Question Answering (VQA) is notoriously known as a task, where models are prone to exploit biases in datasets to find shortcuts instead of performing high-level reasoning. Classical methods address this by…

计算机视觉与模式识别 · 计算机科学 2021-04-09 Corentin Kervadec , Theo Jaunet , Grigory Antipov , Moez Baccouche , Romain Vuillemot , Christian Wolf

The Visual Question Answering (VQA) system offers a user-friendly interface and enables human-computer interaction. However, VQA models commonly face the challenge of language bias, resulting from the learned superficial correlation between…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Zhenghang Yuan , Lichao Mou , Xiao Xiang Zhu

Current work on Visual Question Answering (VQA) explore deterministic approaches conditioned on various types of image and question features. We posit that, in addition to image and question pairs, other modalities are useful for teaching…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Zixu Wang , Yishu Miao , Lucia Specia

Part of the appeal of Visual Question Answering (VQA) is its promise to answer new questions about previously unseen images. Most current methods demand training questions that illustrate every possible concept, and will therefore never…

计算机视觉与模式识别 · 计算机科学 2016-11-22 Damien Teney , Anton van den Hengel

Visual Question Answering (VQA) requires integration of feature maps with drastically different structures and focus of the correct regions. Image descriptors have structures at multiple spatial scales, while lexical inputs inherently…

计算机视觉与模式识别 · 计算机科学 2018-07-20 Yang Shi , Tommaso Furlanello , Sheng Zha , Animashree Anandkumar

Medical visual question answering (Med-VQA) is a machine learning task that aims to create a system that can answer natural language questions based on given medical images. Although there has been rapid progress on the general VQA task,…

计算机视觉与模式识别 · 计算机科学 2023-09-21 Louisa Canepa , Sonit Singh , Arcot Sowmya

We propose the task of free-form and open-ended Visual Question Answering (VQA). Given an image and a natural language question about the image, the task is to provide an accurate natural language answer. Mirroring real-world scenarios,…

计算与语言 · 计算机科学 2016-10-28 Aishwarya Agrawal , Jiasen Lu , Stanislaw Antol , Margaret Mitchell , C. Lawrence Zitnick , Dhruv Batra , Devi Parikh

This paper presents a state-of-the-art model for visual question answering (VQA), which won the first place in the 2017 VQA Challenge. VQA is a task of significant importance for research in artificial intelligence, given its multimodal…

计算机视觉与模式识别 · 计算机科学 2017-08-10 Damien Teney , Peter Anderson , Xiaodong He , Anton van den Hengel

Recent studies have pointed out that many well-developed Visual Question Answering (VQA) models are heavily affected by the language prior problem, which refers to making predictions based on the co-occurrence pattern between textual…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Yangyang Guo , Liqiang Nie , Zhiyong Cheng , Qi Tian , Min Zhang

Visual Question Answering (VQA) is an important task in multimodal AI, and it is often used to test the ability of vision-language models to understand and reason on knowledge present in both visual and textual data. However, most of the…

计算机视觉与模式识别 · 计算机科学 2024-11-05 David Romero , Chenyang Lyu , Haryo Akbarianto Wibowo , Teresa Lynn , Injy Hamed , Aditya Nanda Kishore , Aishik Mandal , Alina Dragonetti , Artem Abzaliev , Atnafu Lambebo Tonja , Bontu Fufa Balcha , Chenxi Whitehouse , Christian Salamea , Dan John Velasco , David Ifeoluwa Adelani , David Le Meur , Emilio Villa-Cueva , Fajri Koto , Fauzan Farooqui , Frederico Belcavello , Ganzorig Batnasan , Gisela Vallejo , Grainne Caulfield , Guido Ivetta , Haiyue Song , Henok Biadglign Ademtew , Hernán Maina , Holy Lovenia , Israel Abebe Azime , Jan Christian Blaise Cruz , Jay Gala , Jiahui Geng , Jesus-German Ortiz-Barajas , Jinheon Baek , Jocelyn Dunstan , Laura Alonso Alemany , Kumaranage Ravindu Yasas Nagasinghe , Luciana Benotti , Luis Fernando D'Haro , Marcelo Viridiano , Marcos Estecha-Garitagoitia , Maria Camila Buitrago Cabrera , Mario Rodríguez-Cantelar , Mélanie Jouitteau , Mihail Mihaylov , Mohamed Fazli Mohamed Imam , Muhammad Farid Adilazuarda , Munkhjargal Gochoo , Munkh-Erdene Otgonbold , Naome Etori , Olivier Niyomugisha , Paula Mónica Silva , Pranjal Chitale , Raj Dabre , Rendi Chevi , Ruochen Zhang , Ryandito Diandaru , Samuel Cahyawijaya , Santiago Góngora , Soyeong Jeong , Sukannya Purkayastha , Tatsuki Kuribayashi , Teresa Clifford , Thanmay Jayakumar , Tiago Timponi Torrent , Toqeer Ehsan , Vladimir Araujo , Yova Kementchedjhieva , Zara Burzo , Zheng Wei Lim , Zheng Xin Yong , Oana Ignat , Joan Nwatu , Rada Mihalcea , Thamar Solorio , Alham Fikri Aji

Visual Question Answering with Natural Language Explanation (VQA-NLE) task is challenging due to its high demand for reasoning-based inference. Recent VQA-NLE studies focus on enhancing model networks to amplify the model's reasoning…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Su Hyeon Lim , Minkuk Kim , Hyeon Bae Kim , Seong Tae Kim

Visual Question Answering (VQA) research seeks to create AI systems to answer natural language questions in images, yet VQA methods often yield overly simplistic and short answers. This paper aims to advance the field by introducing Visual…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Jialu Li , Manish Kumar Thota , Ruslan Gokhman , Radek Holik , Youshan Zhang

Despite remarkable progress in recent years, Vision Language Models (VLMs) remain prone to overconfidence and hallucinations on tasks such as Visual Question Answering (VQA) and Visual Reasoning. Bayesian methods can potentially improve…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Tobias Jan Wieczorek , Nathalie Daun , Mohammad Emtiyaz Khan , Marcus Rohrbach

Visual Question Answering (VQA) systems are tasked with answering natural language questions corresponding to a presented image. Traditional VQA datasets typically contain questions related to the spatial information of objects, object…

In traditional Visual Question Generation (VQG), most images have multiple concepts (e.g. objects and categories) for which a question could be generated, but models are trained to mimic an arbitrary choice of concept as given in their…

机器学习 · 计算机科学 2022-07-27 Nihir Vedd , Zixu Wang , Marek Rei , Yishu Miao , Lucia Specia

Problems at the intersection of language and vision, like visual question answering, have recently been gaining a lot of attention in the field of multi-modal machine learning as computer vision research moves beyond traditional recognition…

计算与语言 · 计算机科学 2018-09-25 Khyathi Raghavi Chandu , Mary Arpita Pyreddy , Matthieu Felix , Narendra Nath Joshi

Multiple Choice Question Answering (MCQA) benchmarks are an established standard for measuring Vision Language Model (VLM) performance in driving tasks. However, we observe the known phenomenon that synthetically generated MCQAs are highly…

机器学习 · 计算机科学 2026-02-23 Sutej Kulgod , Sean Ye , Sanchit Tanwar , Christoffer Heckman

Transformers for visual-language representation learning have been getting a lot of interest and shown tremendous performance on visual question answering (VQA) and grounding. But most systems that show good performance of those tasks still…

计算机视觉与模式识别 · 计算机科学 2022-07-07 Aisha Urooj Khan , Hilde Kuehne , Chuang Gan , Niels Da Vitoria Lobo , Mubarak Shah

Visual question answering (VQA) usesimage processing algorithms to process the image and natural language processing methods to understand and answer the question. VQA is helpful to a visually impaired person, can be used for the security…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Param Ahir , Hiteishi M. Diwanji

Visual Question Answering (VQA) is a challenging task of predicting the answer to a question about the content of an image. Prior works directly evaluate the answering models by simply calculating the accuracy of predicted answers. However,…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Kun Li , George Vosselman , Michael Ying Yang