中文
相关论文

相关论文: Augmenting Visual Question Answering with Semantic…

200 篇论文

A key solution to visual question answering (VQA) exists in how to fuse visual and language features extracted from an input image and question. We show that an attention mechanism that enables dense, bi-directional interactions between the…

计算机视觉与模式识别 · 计算机科学 2018-12-04 Duy-Kien Nguyen , Takayuki Okatani

Visual Question Answering (VQA) is one of the most important tasks in autonomous driving, which requires accurate recognition and complex situation evaluations. However, datasets annotated in a QA format, which guarantees precise language…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Yuichi Inoue , Yuki Yada , Kotaro Tanahashi , Yu Yamaguchi

Visual Question Answering (VQA) is the task of answering a question about an image and requires processing multimodal input and reasoning to obtain the answer. Modular solutions that use declarative representations within the reasoning…

人工智能 · 计算机科学 2024-10-15 Thomas Eiter , Jan Hadl , Nelson Higuera , Johannes Oetsch

Knowledge-based visual question answering (KB-VQA) requires vision-language models to understand images and use external knowledge, especially for rare entities and long-tail facts. Most existing retrieval-augmented generation (RAG) methods…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Zhuohong Chen , Zhenxian Wu , Yunyao Yu , Hangrui Xu , Zirui Liao , Zhifang Liu , Xiangwen Deng , Pen Jiao , Haoqian Wang

In this paper, we establish a benchmark for table visual question answering, referred to as the TableVQA-Bench, derived from pre-existing table question-answering (QA) and table structure recognition datasets. It is important to note that…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Yoonsik Kim , Moonbin Yim , Ka Yeon Song

Visual Question Answering (VQA) aims to automatically answer natural language questions related to given image content. Existing VQA methods integrate vision modeling and language understanding to explore the deep semantics of the question.…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Xiangrui Su , Qi Zhang , Chongyang Shi , Jiachang Liu , Liang Hu

In multimodal assistant, where vision is also one of the input modalities, the identification of user intent becomes a challenging task as visual input can influence the outcome. Current digital assistants take spoken input and try to…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Alkesh Patel , Joel Ruben Antony Moniz , Roman Nguyen , Nick Tzou , Hadas Kotek , Vincent Renkens

Visual question answering (VQA) has the potential to make the Internet more accessible in an interactive way, allowing people who cannot see images to ask questions about them. However, multiple studies have shown that people who are blind…

计算与语言 · 计算机科学 2023-08-31 Nandita Naik , Christopher Potts , Elisa Kreiss

Visual Query Answering (VQA) is of great significance in offering people convenience: one can raise a question for details of objects, or high-level understanding about the scene, over an image. This paper proposes a novel method to address…

计算机视觉与模式识别 · 计算机科学 2019-03-19 Peixi Xiong , Huayi Zhan , Xin Wang , Baivab Sinha , Ying Wu

Visual Question Answering (VQA) is a challenging task of predicting the answer to a question about the content of an image. Prior works directly evaluate the answering models by simply calculating the accuracy of predicted answers. However,…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Kun Li , George Vosselman , Michael Ying Yang

While a lot of work has been done on developing models to tackle the problem of Visual Question Answering, the ability of these models to relate the question to the image features still remain less explored. We present an empirical study of…

计算机视觉与模式识别 · 计算机科学 2022-02-08 Harsh Raj , Janhavi Dadhania , Akhilesh Bhardwaj , Prabuchandran KJ

Visual question answering (VQA) is the multi-modal task of answering natural language questions about an input image. Through cross-dataset adaptation methods, it is possible to transfer knowledge from a source dataset with larger train…

计算机视觉与模式识别 · 计算机科学 2022-01-25 Arjun R. Akula

Visual question answering is concerned with answering free-form questions about an image. Since it requires a deep linguistic understanding of the question and the ability to associate it with various objects that are present in the image,…

机器学习 · 计算机科学 2020-07-03 Marcel Hildebrandt , Hang Li , Rajat Koner , Volker Tresp , Stephan Günnemann

In this paper, we make a simple observation that questions about images often contain premises - objects and relationships implied by the question - and that reasoning about premises can help Visual Question Answering (VQA) models respond…

计算机视觉与模式识别 · 计算机科学 2017-08-21 Aroma Mahendru , Viraj Prabhu , Akrit Mohapatra , Dhruv Batra , Stefan Lee

Visual question answering (VQA) is challenging not only because the model has to handle multi-modal information, but also because it is just so hard to collect sufficient training examples -- there are too many questions one can ask about…

计算机视觉与模式识别 · 计算机科学 2022-11-10 Jihyung Kil , Cheng Zhang , Dong Xuan , Wei-Lun Chao

Visual Question Answering (VQA) deep-learning systems tend to capture superficial statistical correlations in the training data because of strong language priors and fail to generalize to test data with a significantly different…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Jialin Wu , Raymond J. Mooney

Visual Question Answering (VQA) is a fundamental multimodal task that requires models to jointly understand visual and textual information. Early VQA systems relied heavily on language biases, motivating subsequent work to emphasize visual…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Nguyen Anh Tuong , Phan Ba Duc , Nguyen Trung Quoc , Tran Dac Thinh , Dang Duy Lan , Nguyen Quoc Thinh , Tung Le

Visual Question Answering (VQA) is a fundamental task in computer vision and natural language process fields. Although the ``pre-training & finetuning'' learning paradigm significantly improves the VQA performance, the adversarial…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Ziyi Yin , Muchao Ye , Tianrong Zhang , Jiaqi Wang , Han Liu , Jinghui Chen , Ting Wang , Fenglong Ma

Visual Question Answering (VQA) is a challenging multimodal task to answer questions about an image. Many works concentrate on how to reduce language bias which makes models answer questions ignoring visual content and language context.…

计算机视觉与模式识别 · 计算机科学 2020-12-22 Chao Yang , Su Feng , Dongsheng Li , Huawei Shen , Guoqing Wang , Bin Jiang

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…