中文
相关论文

相关论文: Structured Triplet Learning with POS-tag Guided At…

200 篇论文

Movie question answering, or MovieQA is a multimedia related task wherein one is provided with a video, the subtitle information, a question and candidate answers for it. The task is to predict the correct answer for the question using the…

多媒体 · 计算机科学 2021-11-19 Ankit Shah , Tzu-Hsiang Lin , Shijie Wu

Recently visual question answering (VQA) and visual question generation (VQG) are two trending topics in the computer vision, which have been explored separately. In this work, we propose an end-to-end unified framework, the Invertible…

计算机视觉与模式识别 · 计算机科学 2017-09-22 Yikang Li , Nan Duan , Bolei Zhou , Xiao Chu , Wanli Ouyang , Xiaogang Wang

In order to answer semantically-complicated questions about an image, a Visual Question Answering (VQA) model needs to fully understand the visual scene in the image, especially the interactive dynamics between different objects. We propose…

计算机视觉与模式识别 · 计算机科学 2019-10-11 Linjie Li , Zhe Gan , Yu Cheng , Jingjing Liu

This study explores innovative methods for improving Visual Question Answering (VQA) using Generative Adversarial Networks (GANs), autoencoders, and attention mechanisms. Leveraging a balanced VQA dataset, we investigate three distinct…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Panfeng Li , Qikai Yang , Xieming Geng , Wenjing Zhou , Zhicheng Ding , Yi Nian

Visual Question Answering (VQA) emerges as one of the most fascinating topics in computer vision recently. Many state of the art methods naively use holistic visual features with language features into a Long Short-Term Memory (LSTM)…

计算机视觉与模式识别 · 计算机科学 2015-11-19 Aiwen Jiang , Fang Wang , Fatih Porikli , Yi Li

Visual Question Answering (VQA) is an extremely stimulating and challenging research area where Computer Vision (CV) and Natural Language Processig (NLP) have recently met. In image captioning and video summarization, the semantic…

计算机视觉与模式识别 · 计算机科学 2021-03-09 Silvio Barra , Carmen Bisogni , Maria De Marsico , Stefano Ricciardi

Visual Question Answering (VQA) has become one of the key benchmarks of visual recognition progress. Multiple VQA extensions have been explored to better simulate real-world settings: different question formulations, changing training and…

计算机视觉与模式识别 · 计算机科学 2022-02-21 Arjun Mani , Nobline Yoo , Will Hinthorn , Olga Russakovsky

Visual question answering (VQA) is challenging not only because the model has to handle multi-modal information, but also because it is just so hard to collect sufficient training examples -- there are too many questions one can ask about…

计算机视觉与模式识别 · 计算机科学 2022-11-10 Jihyung Kil , Cheng Zhang , Dong Xuan , Wei-Lun Chao

Visual Question Answering (VQA) requires AI models to comprehend data in two domains, vision and text. Current state-of-the-art models use learned attention mechanisms to extract relevant information from the input domains to answer a…

人工智能 · 计算机科学 2019-03-27 Ahmed Osman , Wojciech Samek

Video-Question-Answering (VideoQA) comprises the capturing of complex visual relation changes over time, remaining a challenge even for advanced Video Language Models (VLM), i.a., because of the need to represent the visual content to a…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Sofian Chaybouti , Walid Bousselham , Moritz Wolter , Hilde Kuehne

Visual question answering (Visual QA) has attracted a lot of attention lately, seen essentially as a form of (visual) Turing test that artificial intelligence should strive to achieve. In this paper, we study a crucial component of this…

计算与语言 · 计算机科学 2018-06-12 Wei-Lun Chao , Hexiang Hu , Fei Sha

With the breakthrough of multi-modal large language models, answering complex visual questions that demand advanced reasoning abilities and world knowledge has become a much more important testbed for developing AI models than ever.…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Haibo Wang , Weifeng Ge

Visual Question Answering (VQA) is a fundamental task in computer vision and natural language process fields. Although the ``pre-training & finetuning'' learning paradigm significantly improves the VQA performance, the adversarial…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Ziyi Yin , Muchao Ye , Tianrong Zhang , Jiaqi Wang , Han Liu , Jinghui Chen , Ting Wang , Fenglong Ma

Answering open-ended questions is an essential capability for any intelligent agent. One of the most interesting recent open-ended question answering challenges is Visual Question Answering (VQA) which attempts to evaluate a system's visual…

计算与语言 · 计算机科学 2016-10-25 Omid Bakhshandeh , Trung Bui , Zhe Lin , Walter Chang

3D Visual Question Answering (3D VQA) is crucial for enabling models to perceive the physical world and perform spatial reasoning. In 3D VQA, the free-form nature of answers often leads to improper annotations that can confuse or mislead…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Shengli Zhou , Yang Liu , Feng Zheng

Medical visual question answering (VQA) aims to answer clinically relevant questions regarding input medical images. This technique has the potential to improve the efficiency of medical professionals while relieving the burden on the…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Xinyue Hu , Lin Gu , Kazuma Kobayashi , Qiyuan An , Qingyu Chen , Zhiyong Lu , Chang Su , Tatsuya Harada , Yingying Zhu

Medical visual question answering (Med-VQA) is a machine learning task that aims to create a system that can answer natural language questions based on given medical images. Although there has been rapid progress on the general VQA task,…

计算机视觉与模式识别 · 计算机科学 2023-09-21 Louisa Canepa , Sonit Singh , Arcot Sowmya

Visual question answering (VQA) has been gaining a lot of traction in the machine learning community in the recent years due to the challenges posed in understanding information coming from multiple modalities (i.e., images, language). In…

计算机视觉与模式识别 · 计算机科学 2021-11-11 Muralikrishnna G. Sethuraman , Ali Payani , Faramarz Fekri , J. Clayton Kerce

Current work on Visual Question Answering (VQA) explore deterministic approaches conditioned on various types of image and question features. We posit that, in addition to image and question pairs, other modalities are useful for teaching…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Zixu Wang , Yishu Miao , Lucia Specia

Learning visual similarity requires to learn relations, typically between triplets of images. Albeit triplet approaches being powerful, their computational complexity mostly limits training to only a subset of all possible training…

计算机视觉与模式识别 · 计算机科学 2020-03-31 Karsten Roth , Timo Milbich , Björn Ommer