中文
相关论文

相关论文: VQA Therapy: Exploring Answer Differences by Visua…

200 篇论文

Designing datasets for Visual Question Answering (VQA) is a difficult and complex task that requires NLP for parsing and computer vision for analysing the relevant aspects of the image for answering the question asked. Several benchmark…

计算机视觉与模式识别 · 计算机科学 2025-02-06 Madhuri Latha Madaka , Chakravarthy Bhagvati

Scaling Visual Question Answering (VQA) to the open-domain and multi-hop nature of web searches, requires fundamental advances in visual representation learning, knowledge aggregation, and language generation. In this work, we introduce…

计算与语言 · 计算机科学 2022-03-29 Yingshan Chang , Mridu Narang , Hisami Suzuki , Guihong Cao , Jianfeng Gao , Yonatan Bisk

Visual Question Answering (VQA) is challenging due to the complex cross-modal relations. It has received extensive attention from the research community. From the human perspective, to answer a visual question, one needs to read the…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Hantao Huang , Tao Han , Wei Han , Deep Yap , Cheng-Ming Chiang

Video Question Answering (VideoQA) is the task of answering questions about a video. At its core is understanding the alignments between visual scenes in video and linguistic semantics in question to yield the answer. In leading VideoQA…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Yicong Li , Xiang Wang , Junbin Xiao , Wei Ji , Tat-Seng Chua

Aesthetic assessment of images can be categorized into two main forms: numerical assessment and language assessment. Aesthetics caption of photographs is the only task of aesthetic language assessment that has been addressed. In this paper,…

计算机视觉与模式识别 · 计算机科学 2022-08-12 Xin Jin , Wu Zhou , Xinghui Zhou , Shuai Cui , Le Zhang , Jianwen Lv , Shu Zhao

Answering questions related to art pieces (paintings) is a difficult task, as it implies the understanding of not only the visual information that is shown in the picture, but also the contextual knowledge that is acquired through the study…

计算机视觉与模式识别 · 计算机科学 2020-08-31 Noa Garcia , Chentao Ye , Zihua Liu , Qingtao Hu , Mayu Otani , Chenhui Chu , Yuta Nakashima , Teruko Mitamura

Medical Visual Question Answering (VQA) is an important challenge, as it would lead to faster and more accurate diagnoses and treatment decisions. Most existing methods approach it as a multi-class classification problem, which restricts…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Tom van Sonsbeek , Mohammad Mahdi Derakhshani , Ivona Najdenkoska , Cees G. M. Snoek , Marcel Worring

The intersection of medical Visual Question Answering (Med-VQA) is a challenging research topic with advantages including patient engagement and clinical expert involvement for second opinions. However, existing Med-VQA methods based on…

机器学习 · 计算机科学 2024-06-24 Lin Fan , Xun Gong , Cenyang Zheng , Yafei Ou

The multimodal task of Visual Question Answering (VQA) encompassing elements of Computer Vision (CV) and Natural Language Processing (NLP), aims to generate answers to questions on any visual input. Over time, the scope of VQA has expanded…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Md Farhan Ishmam , Md Sakib Hossain Shovon , M. F. Mridha , Nilanjan Dey

Despite the great progress of Visual Question Answering (VQA), current VQA models heavily rely on the superficial correlation between the question type and its corresponding frequent answers (i.e., language priors) to make predictions,…

计算与语言 · 计算机科学 2022-09-20 Yike Wu , Yu Zhao , Shiwan Zhao , Ying Zhang , Xiaojie Yuan , Guoqing Zhao , Ning Jiang

The task of answering questions about images has garnered attention as a practical service for assisting populations with visual impairments as well as a visual Turing test for the artificial intelligence community. Our first aim is to…

人机交互 · 计算机科学 2020-10-08 Xiaoyu Zeng , Yanan Wang , Tai-Yin Chiu , Nilavra Bhattacharya , Danna Gurari

Visual Question Answering (VQA) is a challenging task that requires the joint understanding of natural language and visual content. While early research primarily focused on recognizing objects and scene context, it often overlooked scene…

We introduce FigureQA, a visual reasoning corpus of over one million question-answer pairs grounded in over 100,000 images. The images are synthetic, scientific-style figures from five classes: line plots, dot-line plots, vertical and…

计算机视觉与模式识别 · 计算机科学 2018-02-26 Samira Ebrahimi Kahou , Vincent Michalski , Adam Atkinson , Akos Kadar , Adam Trischler , Yoshua Bengio

Modern social intelligence includes the ability to watch videos and answer questions about social and theory-of-mind-related content, e.g., for a scene in Harry Potter, "Is the father really upset about the boys flying the car?" Social…

Visual Question Answering (VQA) has become an important benchmark for assessing how large multimodal models (LMMs) interpret images. However, most VQA datasets focus on real-world images or simple diagrammatic analysis, with few focused on…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Jill P. Naiman , Daniel J. Evans , JooYoung Seo

Visual Question and Answering (VQA) problems are attracting increasing interest from multiple research disciplines. Solving VQA problems requires techniques from both computer vision for understanding the visual contents of a presented…

计算机视觉与模式识别 · 计算机科学 2016-04-07 Ilija Ilievski , Shuicheng Yan , Jiashi Feng

Visual Question Answering (VQA) has been a popular task that combines vision and language, with numerous relevant implementations in literature. Even though there are some attempts that approach explainability and robustness issues in VQA…

计算与语言 · 计算机科学 2024-05-06 Theodoti Stoikou , Maria Lymperaiou , Giorgos Stamou

Vision-and-language tasks have increasingly drawn more attention as a means to evaluate human-like reasoning in machine learning models. A popular task in the field is visual question answering (VQA), which aims to answer questions about…

计算机视觉与模式识别 · 计算机科学 2022-06-06 Yusuke Hirota , Yuta Nakashima , Noa Garcia

Vision and language understanding has emerged as a subject undergoing intense study in Artificial Intelligence. Among many tasks in this line of research, visual question answering (VQA) has been one of the most successful ones, where the…

计算机视觉与模式识别 · 计算机科学 2017-12-05 Yunseok Jang , Yale Song , Youngjae Yu , Youngjin Kim , Gunhee Kim

The visual question generation (VQG) task aims to generate human-like questions from an image and potentially other side information (e.g. answer type). Previous works on VQG fall in two aspects: i) They suffer from one image to many…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Kai Shen , Lingfei Wu , Siliang Tang , Fangli Xu , Bo Long , Yueting Zhuang , Jian Pei