中文
相关论文

相关论文: Answer Them All! Toward Universal Visual Question …

200 篇论文

In recent years, visual question answering (VQA) has become topical. The premise of VQA's significance as a benchmark in AI, is that both the image and textual question need to be well understood and mutually grounded in order to infer the…

计算机视觉与模式识别 · 计算机科学 2018-03-20 Feng Liu , Tao Xiang , Timothy M. Hospedales , Wankou Yang , Changyin Sun

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

计算与语言 · 计算机科学 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

On the way towards general Visual Question Answering (VQA) systems that are able to answer arbitrary questions, the need arises for evaluation beyond single-metric leaderboards for specific datasets. To this end, we propose a browser-based…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Dirk Väth , Pascal Tilli , Ngoc Thang Vu

Visual Question Answering (VQA) is an important task in multimodal AI, and it is often used to test the ability of vision-language models to understand and reason on knowledge present in both visual and textual data. However, most of the…

计算机视觉与模式识别 · 计算机科学 2024-11-05 David Romero , Chenyang Lyu , Haryo Akbarianto Wibowo , Teresa Lynn , Injy Hamed , Aditya Nanda Kishore , Aishik Mandal , Alina Dragonetti , Artem Abzaliev , Atnafu Lambebo Tonja , Bontu Fufa Balcha , Chenxi Whitehouse , Christian Salamea , Dan John Velasco , David Ifeoluwa Adelani , David Le Meur , Emilio Villa-Cueva , Fajri Koto , Fauzan Farooqui , Frederico Belcavello , Ganzorig Batnasan , Gisela Vallejo , Grainne Caulfield , Guido Ivetta , Haiyue Song , Henok Biadglign Ademtew , Hernán Maina , Holy Lovenia , Israel Abebe Azime , Jan Christian Blaise Cruz , Jay Gala , Jiahui Geng , Jesus-German Ortiz-Barajas , Jinheon Baek , Jocelyn Dunstan , Laura Alonso Alemany , Kumaranage Ravindu Yasas Nagasinghe , Luciana Benotti , Luis Fernando D'Haro , Marcelo Viridiano , Marcos Estecha-Garitagoitia , Maria Camila Buitrago Cabrera , Mario Rodríguez-Cantelar , Mélanie Jouitteau , Mihail Mihaylov , Mohamed Fazli Mohamed Imam , Muhammad Farid Adilazuarda , Munkhjargal Gochoo , Munkh-Erdene Otgonbold , Naome Etori , Olivier Niyomugisha , Paula Mónica Silva , Pranjal Chitale , Raj Dabre , Rendi Chevi , Ruochen Zhang , Ryandito Diandaru , Samuel Cahyawijaya , Santiago Góngora , Soyeong Jeong , Sukannya Purkayastha , Tatsuki Kuribayashi , Teresa Clifford , Thanmay Jayakumar , Tiago Timponi Torrent , Toqeer Ehsan , Vladimir Araujo , Yova Kementchedjhieva , Zara Burzo , Zheng Wei Lim , Zheng Xin Yong , Oana Ignat , Joan Nwatu , Rada Mihalcea , Thamar Solorio , Alham Fikri Aji

Medical visual question answering (Med-VQA) is a machine learning task that aims to create a system that can answer natural language questions based on given medical images. Although there has been rapid progress on the general VQA task,…

计算机视觉与模式识别 · 计算机科学 2023-09-21 Louisa Canepa , Sonit Singh , Arcot Sowmya

The ideal form of Visual Question Answering requires understanding, grounding and reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most existing VQA benchmarks are…

计算机视觉与模式识别 · 计算机科学 2023-03-07 Kang Chen , Xiangqian Wu

Video Question Answering (VideoQA) aims to answer natural language questions according to the given videos. It has earned increasing attention with recent research trends in joint vision and language understanding. Yet, compared with…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Yaoyao Zhong , Junbin Xiao , Wei Ji , Yicong Li , Weihong Deng , Tat-Seng Chua

Attention mechanisms have been widely used in Visual Question Answering (VQA) solutions due to their capacity to model deep cross-domain interactions. Analyzing attention maps offers us a perspective to find out limitations of current VQA…

计算机视觉与模式识别 · 计算机科学 2018-10-10 Wei Li , Zehuan Yuan , Xiangzhong Fang , Changhu Wang

Visual Question Answering (VQA) is a challenging task that requires cross-modal understanding and reasoning of visual image and natural language question. To inspect the association of VQA models to human cognition, we designed a survey to…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Liben Chen , Long Chen , Tian Ellison-Chen , Zhuoyuan Xu

Knowledge-based Visual Question Answering (KVQA) requires external knowledge beyond the visible content to answer questions about an image. This ability is challenging but indispensable to achieve general VQA. One limitation of existing…

人工智能 · 计算机科学 2020-11-04 Jing Yu , Zihao Zhu , Yujing Wang , Weifeng Zhang , Yue Hu , Jianlong Tan

Though beneficial for encouraging the Visual Question Answering (VQA) models to discover the underlying knowledge by exploiting the input-output correlation beyond image and text contexts, the existing knowledge VQA datasets are mostly…

计算机视觉与模式识别 · 计算机科学 2020-12-15 Qingxing Cao , Bailin Li , Xiaodan Liang , Keze Wang , Liang Lin

We propose the inverse problem of Visual question answering (iVQA), and explore its suitability as a benchmark for visuo-linguistic understanding. The iVQA task is to generate a question that corresponds to a given image and answer pair.…

计算机视觉与模式识别 · 计算机科学 2018-03-19 Feng Liu , Tao Xiang , Timothy M. Hospedales , Wankou Yang , Changyin Sun

Most recent state-of-the-art Visual Question Answering (VQA) systems are opaque black boxes that are only trained to fit the answer distribution given the question and visual content. As a result, these systems frequently take shortcuts,…

计算机视觉与模式识别 · 计算机科学 2020-06-30 Jialin Wu , Liyan Chen , Raymond J. Mooney

Visual Question Answering (VQA) methods have made incredible progress, but suffer from a failure to generalize. This is visible in the fact that they are vulnerable to learning coincidental correlations in the data rather than deeper…

计算机视觉与模式识别 · 计算机科学 2020-02-27 Xinyu Wang , Yuliang Liu , Chunhua Shen , Chun Chet Ng , Canjie Luo , Lianwen Jin , Chee Seng Chan , Anton van den Hengel , Liangwei Wang

Visual Question Answering (VQA) is challenging due to the complex cross-modal relations. It has received extensive attention from the research community. From the human perspective, to answer a visual question, one needs to read the…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Hantao Huang , Tao Han , Wei Han , Deep Yap , Cheng-Ming Chiang

We propose a novel probabilistic model for visual question answering (Visual QA). The key idea is to infer two sets of embeddings: one for the image and the question jointly and the other for the answers. The learning objective is to learn…

计算机视觉与模式识别 · 计算机科学 2018-06-12 Hexiang Hu , Wei-Lun Chao , Fei Sha

Visual Question Answering (VQA) systems are tasked with answering natural language questions corresponding to a presented image. Traditional VQA datasets typically contain questions related to the spatial information of objects, object…

Part of the appeal of Visual Question Answering (VQA) is its promise to answer new questions about previously unseen images. Most current methods demand training questions that illustrate every possible concept, and will therefore never…

计算机视觉与模式识别 · 计算机科学 2016-11-22 Damien Teney , Anton van den Hengel

The Visual Question Answering (VQA) task utilizes both visual image and language analysis to answer a textual question with respect to an image. It has been a popular research topic with an increasing number of real-world applications in…

Visual question answering (VQA) is a Multidisciplinary research problem that pursued through practices of natural language processing and computer vision. Visual question answering automatically answers natural language questions according…

计算机视觉与模式识别 · 计算机科学 2024-09-01 Param Ahir , Hiteishi Diwanji