中文
相关论文

相关论文: Object Attribute Matters in Visual Question Answer…

200 篇论文

Visual Question Answering (VQA) is the task of taking as input an image and a free-form natural language question about the image, and producing an accurate answer. In this work we view VQA as a "feature extraction" module to extract image…

计算机视觉与模式识别 · 计算机科学 2016-09-02 Xiao Lin , Devi Parikh

Visual Question Answering (VQA) is a fundamental task in computer vision and natural language process fields. Although the ``pre-training & finetuning'' learning paradigm significantly improves the VQA performance, the adversarial…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Ziyi Yin , Muchao Ye , Tianrong Zhang , Jiaqi Wang , Han Liu , Jinghui Chen , Ting Wang , Fenglong Ma

Knowledge-based Visual Question Answering (KVQA) requires external knowledge beyond the visible content to answer questions about an image. This ability is challenging but indispensable to achieve general VQA. One limitation of existing…

人工智能 · 计算机科学 2020-11-04 Jing Yu , Zihao Zhu , Yujing Wang , Weifeng Zhang , Yue Hu , Jianlong Tan

Visual Question Answering (VQA) is a challenging task that has received increasing attention from both the computer vision and the natural language processing communities. Given an image and a question in natural language, it requires…

计算机视觉与模式识别 · 计算机科学 2016-07-21 Qi Wu , Damien Teney , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

Answering semantically-complicated questions according to an image is challenging in Visual Question Answering (VQA) task. Although the image can be well represented by deep learning, the question is always simply embedded and cannot well…

计算机视觉与模式识别 · 计算机科学 2021-12-15 JianJian Cao , Xiameng Qin , Sanyuan Zhao , Jianbing Shen

Visual Question Answering (VQA) emerges as one of the most fascinating topics in computer vision recently. Many state of the art methods naively use holistic visual features with language features into a Long Short-Term Memory (LSTM)…

计算机视觉与模式识别 · 计算机科学 2015-11-19 Aiwen Jiang , Fang Wang , Fatih Porikli , Yi Li

We propose a cross-modal attention distillation framework to train a dual-encoder model for vision-language understanding tasks, such as visual reasoning and visual question answering. Dual-encoder models have a faster inference speed than…

计算与语言 · 计算机科学 2022-10-18 Zekun Wang , Wenhui Wang , Haichao Zhu , Ming Liu , Bing Qin , Furu Wei

Medical visual question answering (VQA) is a challenging task that requires answering clinical questions of a given medical image, by taking consider of both visual and language information. However, due to the small scale of training data…

计算机视觉与模式识别 · 计算机科学 2023-07-12 Pengfei Li , Gang Liu , Jinlong He , Zixu Zhao , Shenjun Zhong

In this paper, we propose a novel approach for solving the Visual Question Answering (VQA) task in autonomous driving by integrating Vision-Language Models (VLMs) with continual learning. In autonomous driving, VQA plays a vital role in…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Yuxin Lin , Mengshi Qi , Liang Liu , Huadong Ma

Humans explain inter-object relationships with semantic labels that demonstrate a high-level understanding required to perform complex Vision-Language tasks such as Visual Question Answering (VQA). However, existing VQA models represent…

计算机视觉与模式识别 · 计算机科学 2020-10-06 Moshiur Farazi , Salman Khan , Nick Barnes

Due to the severe lack of labeled data, existing methods of medical visual question answering usually rely on transfer learning to obtain effective image feature representation and use cross-modal fusion of visual and linguistic features to…

多媒体 · 计算机科学 2021-05-04 Haifan Gong , Guanqi Chen , Sishuo Liu , Yizhou Yu , Guanbin Li

Medical Visual Question Answering (Med-VQA) answers clinical questions using medical images, aiding diagnosis. Designing the MedVQA system holds profound importance in assisting clinical diagnosis and enhancing diagnostic accuracy. Building…

计算机视觉与模式识别 · 计算机科学 2025-04-11 Junkai Zhang , Bin Li , Shoujun Zhou , Yue Du

We introduce a method for composing object-level visual prompts within a text-to-image diffusion model. Our approach addresses the task of generating semantically coherent compositions across diverse scenes and styles, similar to the…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Gaurav Parmar , Or Patashnik , Kuan-Chieh Wang , Daniil Ostashev , Srinivasa Narasimhan , Jun-Yan Zhu , Daniel Cohen-Or , Kfir Aberman

An ability to learn about new objects from a small amount of visual data and produce convincing linguistic justification about the presence/absence of certain concepts (that collectively compose the object) in novel scenarios is an…

计算机视觉与模式识别 · 计算机科学 2024-10-18 Shailaja Keyur Sampat , Maitreya Patel , Yezhou Yang , Chitta Baral

Questions that require counting a variety of objects in images remain a major challenge in visual question answering (VQA). The most common approaches to VQA involve either classifying answers based on fixed length representations of both…

人工智能 · 计算机科学 2018-03-05 Alexander Trott , Caiming Xiong , Richard Socher

Recently, attention-based Visual Question Answering (VQA) has achieved great success by utilizing question to selectively target different visual areas that are related to the answer. Existing visual attention models are generally planar,…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Jingkuan Song , Pengpeng Zeng , Lianli Gao , Heng Tao Shen

In object recognition applications, object images usually appear with different quality levels. Practically, it is very important to indicate object image qualities for better application performance, e.g. filtering out low-quality object…

计算机视觉与模式识别 · 计算机科学 2020-05-28 Jing Lu , Baorui Zou , Zhanzhan Cheng , Shiliang Pu , Shuigeng Zhou , Yi Niu , Fei Wu

With the new generation of satellite technologies, the archives of remote sensing (RS) images are growing very fast. To make the intrinsic information of each RS image easily accessible, visual question answering (VQA) has been introduced…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Tim Siebert , Kai Norman Clasen , Mahdyar Ravanbakhsh , Begüm Demir

Visual Question answering is a challenging problem requiring a combination of concepts from Computer Vision and Natural Language Processing. Most existing approaches use a two streams strategy, computing image and question features that are…

计算机视觉与模式识别 · 计算机科学 2018-11-02 Will Norcliffe-Brown , Efstathios Vafeias , Sarah Parisot

Recent research advances in Computer Vision and Natural Language Processing have introduced novel tasks that are paving the way for solving AI-complete problems. One of those tasks is called Visual Question Answering (VQA). A VQA system…

计算机视觉与模式识别 · 计算机科学 2020-07-30 Camila Kolling , Jônatas Wehrmann , Rodrigo C. Barros