中文
相关论文

相关论文: Answer Mining from a Pool of Images: Towards Retri…

200 篇论文

Medical Visual Question Answering (VQA) is a multi-modal challenging task widely considered by research communities of the computer vision and natural language processing. Since most current medical VQA models focus on visual content,…

计算机视觉与模式识别 · 计算机科学 2021-07-08 Haiwei Pan , Shuning He , Kejia Zhang , Bo Qu , Chunling Chen , Kun Shi

We tackle the challenge of Visual Question Answering in multi-image setting for the ISVQA dataset. Traditional VQA tasks have focused on a single-image setting where the target answer is generated from a single image. Image set VQA,…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Abhinav Khattar , Aviral Joshi , Har Simrat Singh , Pulkit Goel , Rohit Prakash Barnwal

The Visual Question Answering (VQA) task utilizes both visual image and language analysis to answer a textual question with respect to an image. It has been a popular research topic with an increasing number of real-world applications in…

Visual question answering (VQA) systems are emerging from a desire to empower users to ask any natural language question about visual content and receive a valid answer in response. However, close examination of the VQA problem reveals an…

人工智能 · 计算机科学 2016-08-30 Danna Gurari , Kristen Grauman

While a lot of work has been done on developing models to tackle the problem of Visual Question Answering, the ability of these models to relate the question to the image features still remain less explored. We present an empirical study of…

计算机视觉与模式识别 · 计算机科学 2022-02-08 Harsh Raj , Janhavi Dadhania , Akhilesh Bhardwaj , Prabuchandran KJ

The task of Outside Knowledge Visual Question Answering (OKVQA) requires an automatic system to answer natural language questions about pictures and images using external knowledge. We observe that many visual questions, which contain…

人工智能 · 计算机科学 2022-02-10 Jiawen Zhang , Abhijit Mishra , Avinesh P. V. S , Siddharth Patwardhan , Sachin Agarwal

Visual Question Answering(VQA) is a highly complex problem set, relying on many sub-problems to produce reasonable answers. In this paper, we present the hypothesis that Visual Question Answering should be viewed as a multi-task problem,…

计算机视觉与模式识别 · 计算机科学 2020-07-06 Amelia Elizabeth Pollard , Jonathan L. Shapiro

Knowledge-intensive visual question answering requires models to effectively use external knowledge to help answer visual questions. A typical pipeline includes a knowledge retriever and an answer generator. However, a retriever that…

计算与语言 · 计算机科学 2024-07-18 Haoyang Wen , Honglei Zhuang , Hamed Zamani , Alexander Hauptmann , Michael Bendersky

The extraction of visual features is an essential step in Visual Question Answering (VQA). Building a good visual representation of the analyzed scene is indeed one of the essential keys for the system to be able to correctly understand the…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Hichem Boussaid , Lucrezia Tosato , Flora Weissgerber , Camille Kurtz , Laurent Wendling , Sylvain Lobry

Visual question answering requires a system to provide an accurate natural language answer given an image and a natural language question. However, it is widely recognized that previous generic VQA methods often exhibit a tendency to…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Jie Ma , Pinghui Wang , Dechen Kong , Zewei Wang , Jun Liu , Hongbin Pei , Junzhou Zhao

One of the most intriguing features of the Visual Question Answering (VQA) challenge is the unpredictability of the questions. Extracting the information required to answer them demands a variety of image operations from detection and…

计算机视觉与模式识别 · 计算机科学 2016-12-19 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel

Video Question Answering (VideoQA) has been significantly advanced from the scaling of recent Large Language Models (LLMs). The key idea is to convert the visual information into the language feature space so that the capacity of LLMs can…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Junting Pan , Ziyi Lin , Yuying Ge , Xiatian Zhu , Renrui Zhang , Yi Wang , Yu Qiao , Hongsheng Li

Medical Visual Question Answering (MedVQA), which offers language responses to image-based medical inquiries, represents a challenging task and significant advancement in healthcare. It assists medical experts to swiftly interpret medical…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Xiaotang Gai , Chenyi Zhou , Jiaxiang Liu , Yang Feng , Jian Wu , Zuozhu Liu

Visual Question Answering (VQA) is an extremely stimulating and challenging research area where Computer Vision (CV) and Natural Language Processig (NLP) have recently met. In image captioning and video summarization, the semantic…

计算机视觉与模式识别 · 计算机科学 2021-03-09 Silvio Barra , Carmen Bisogni , Maria De Marsico , Stefano Ricciardi

Fact-based Visual Question Answering (FVQA) requires external knowledge beyond visible content to answer questions about an image, which is challenging but indispensable to achieve general VQA. One limitation of existing FVQA solutions is…

计算机视觉与模式识别 · 计算机科学 2020-11-05 Zihao Zhu , Jing Yu , Yujing Wang , Yajing Sun , Yue Hu , Qi Wu

Current visual question answering (VQA) models tend to be trained and evaluated on image-question pairs in isolation. However, the questions people ask are dependent on their informational needs and prior knowledge about the image content.…

计算与语言 · 计算机科学 2024-10-07 Nandita Shankar Naik , Christopher Potts , Elisa Kreiss

This paper focuses on answering fill-in-the-blank style multiple choice questions from the Visual Madlibs dataset. Previous approaches to Visual Question Answering (VQA) have mainly used generic image features from networks trained on the…

计算机视觉与模式识别 · 计算机科学 2016-08-12 Tatiana Tommasi , Arun Mallya , Bryan Plummer , Svetlana Lazebnik , Alexander C. Berg , Tamara L. Berg

Outside-knowledge visual question answering (OK-VQA) requires the agent to comprehend the image, make use of relevant knowledge from the entire web, and digest all the information to answer the question. Most previous works address the…

计算机视觉与模式识别 · 计算机科学 2022-01-17 Feng Gao , Qing Ping , Govind Thattai , Aishwarya Reganti , Ying Nian Wu , Prem Natarajan

Knowledge-based Visual Question Answering (KVQA) requires external knowledge beyond the visible content to answer questions about an image. This ability is challenging but indispensable to achieve general VQA. One limitation of existing…

人工智能 · 计算机科学 2020-11-04 Jing Yu , Zihao Zhu , Yujing Wang , Weifeng Zhang , Yue Hu , Jianlong Tan

Recent research advances in Computer Vision and Natural Language Processing have introduced novel tasks that are paving the way for solving AI-complete problems. One of those tasks is called Visual Question Answering (VQA). A VQA system…

计算机视觉与模式识别 · 计算机科学 2020-07-30 Camila Kolling , Jônatas Wehrmann , Rodrigo C. Barros