中文
相关论文

相关论文: Answer Them All! Toward Universal Visual Question …

200 篇论文

We present an empirical study of active learning for Visual Question Answering, where a deep VQA model selects informative question-image pairs from a pool and queries an oracle for answers to maximally improve its performance under a…

计算机视觉与模式识别 · 计算机科学 2017-11-07 Xiao Lin , Devi Parikh

We propose Encyclopedic-VQA, a large scale visual question answering (VQA) dataset featuring visual questions about detailed properties of fine-grained categories and instances. It contains 221k unique question+answer pairs each matched…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Thomas Mensink , Jasper Uijlings , Lluis Castrejon , Arushi Goel , Felipe Cadar , Howard Zhou , Fei Sha , André Araujo , Vittorio Ferrari

Visual question answering (VQA) is a task where an image is given, and a series of questions are asked about the image. To build an efficient VQA algorithm, a large amount of QA data is required which is very expensive. Generating synthetic…

计算与语言 · 计算机科学 2024-08-23 Taehee Kim , Yeongjae Cho , Heejun Shin , Yohan Jo , Dongmyung Shin

Visual question answering (VQA) is challenging not only because the model has to handle multi-modal information, but also because it is just so hard to collect sufficient training examples -- there are too many questions one can ask about…

计算机视觉与模式识别 · 计算机科学 2022-11-10 Jihyung Kil , Cheng Zhang , Dong Xuan , Wei-Lun Chao

Medical visual question answering (VQA) aims to answer clinically relevant questions regarding input medical images. This technique has the potential to improve the efficiency of medical professionals while relieving the burden on the…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Xinyue Hu , Lin Gu , Kazuma Kobayashi , Qiyuan An , Qingyu Chen , Zhiyong Lu , Chang Su , Tatsuya Harada , Yingying Zhu

Studies have shown that a dominant class of questions asked by visually impaired users on images of their surroundings involves reading text in the image. But today's VQA models can not read! Our paper takes a first step towards addressing…

计算与语言 · 计算机科学 2019-05-15 Amanpreet Singh , Vivek Natarajan , Meet Shah , Yu Jiang , Xinlei Chen , Dhruv Batra , Devi Parikh , Marcus Rohrbach

Question answering over knowledge bases (KBQA) has become a popular approach to help users extract information from knowledge bases. Although several systems exist, choosing one suitable for a particular application scenario is difficult.…

计算与语言 · 计算机科学 2022-11-16 Khiem Vinh Tran , Hao Phu Phan , Khang Nguyen Duc Quach , Ngan Luu-Thuy Nguyen , Jun Jo , Thanh Tam Nguyen

Visual question answering (VQA) is challenging because it requires a simultaneous understanding of both visual content of images and textual content of questions. To support the VQA task, we need to find good solutions for the following…

计算机视觉与模式识别 · 计算机科学 2019-05-17 Zhou Yu , Jun Yu , Chenchao Xiang , Jianping Fan , Dacheng Tao

Large Language Models (LLMs) have achieved impressive results in knowledge-based Visual Question Answering (VQA). However existing methods still have challenges: the inability to use external tools autonomously, and the inability to work in…

计算与语言 · 计算机科学 2025-08-08 Zhongjian Hu , Peng Yang , Bing Li , Zhenqi Wang

Accurate diagnosis of ophthalmic diseases relies heavily on the interpretation of multimodal ophthalmic images, a process often time-consuming and expertise-dependent. Visual Question Answering (VQA) presents a potential interdisciplinary…

图像与视频处理 · 电气工程与系统科学 2024-10-23 Xiaolan Chen , Ruoyu Chen , Pusheng Xu , Weiyi Zhang , Xianwen Shang , Mingguang He , Danli Shi

Visual Grounding (VG) methods in Visual Question Answering (VQA) attempt to improve VQA performance by strengthening a model's reliance on question-relevant visual information. The presence of such relevant information in the visual input…

计算机视觉与模式识别 · 计算机科学 2024-02-16 Daniel Reich , Tanja Schultz

Visual question answering requires a deep understanding of both images and natural language. However, most methods mainly focus on visual concept; such as the relationships between various objects. The limited use of object categories…

计算机视觉与模式识别 · 计算机科学 2021-01-25 Jung-Jun Kim , Dong-Gyu Lee , Jialin Wu , Hong-Gyu Jung , Seong-Whan Lee

We have seen great progress in basic perceptual tasks such as object recognition and detection. However, AI models still fail to match humans in high-level vision tasks due to the lack of capacities for deeper reasoning. Recently the new…

计算机视觉与模式识别 · 计算机科学 2016-04-12 Yuke Zhu , Oliver Groth , Michael Bernstein , Li Fei-Fei

Currently nearing human-level performance, Visual Question Answering (VQA) is an emerging area in artificial intelligence. Established as a multi-disciplinary field in machine learning, both computer vision and natural language processing…

计算机视觉与模式识别 · 计算机科学 2021-09-07 Bhanuka Manesha Samarasekara Vitharana Gamage , Lim Chern Hong

Recently, a number of deep-learning based models have been proposed for the task of Visual Question Answering (VQA). The performance of most models is clustered around 60-70%. In this paper we propose systematic methods to analyze the…

计算与语言 · 计算机科学 2016-10-05 Aishwarya Agrawal , Dhruv Batra , Devi Parikh

Many vision and language tasks require commonsense reasoning beyond data-driven image and natural language processing. Here we adopt Visual Question Answering (VQA) as an example task, where a system is expected to answer a question in…

计算机视觉与模式识别 · 计算机科学 2018-03-26 Somak Aditya , Yezhou Yang , Chitta Baral

Visual Question Answering (VQA) is a task that requires computers to give correct answers for the input questions based on the images. This task can be solved by humans with ease but is a challenge for computers. The VLSP2022-EVJVQA shared…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Triet Minh Thai , Son T. Luu

Visual Question Answering (VQA) has benefited from increasingly sophisticated models, but has not enjoyed the same level of engagement in terms of data creation. In this paper, we propose a method that automatically derives VQA examples at…

计算机视觉与模式识别 · 计算机科学 2022-05-05 Soravit Changpinyo , Doron Kukliansky , Idan Szpektor , Xi Chen , Nan Ding , Radu Soricut

Visual question answering (VQA) has recently been introduced to remote sensing to make information extraction from overhead imagery more accessible to everyone. VQA considers a question (in natural language, therefore easy to formulate)…

计算机视觉与模式识别 · 计算机科学 2021-09-27 Christel Chappuis , Sylvain Lobry , Benjamin Kellenberger , Bertrand Le Saux , Devis Tuia

Visual Question-Answering (VQA) has become key to user experience, particularly after improved generalization capabilities of Vision-Language Models (VLMs). But evaluating VLMs for an application requirement using a standardized framework…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Neelabh Sinha , Vinija Jain , Aman Chadha