中文
相关论文

相关论文: Attention on Attention: Architectures for Visual Q…

200 篇论文

Visual Question answering is a challenging problem requiring a combination of concepts from Computer Vision and Natural Language Processing. Most existing approaches use a two streams strategy, computing image and question features that are…

计算机视觉与模式识别 · 计算机科学 2018-11-02 Will Norcliffe-Brown , Efstathios Vafeias , Sarah Parisot

Visual Question Answering (VQA) is an important task in multimodal AI, and it is often used to test the ability of vision-language models to understand and reason on knowledge present in both visual and textual data. However, most of the…

计算机视觉与模式识别 · 计算机科学 2024-11-05 David Romero , Chenyang Lyu , Haryo Akbarianto Wibowo , Teresa Lynn , Injy Hamed , Aditya Nanda Kishore , Aishik Mandal , Alina Dragonetti , Artem Abzaliev , Atnafu Lambebo Tonja , Bontu Fufa Balcha , Chenxi Whitehouse , Christian Salamea , Dan John Velasco , David Ifeoluwa Adelani , David Le Meur , Emilio Villa-Cueva , Fajri Koto , Fauzan Farooqui , Frederico Belcavello , Ganzorig Batnasan , Gisela Vallejo , Grainne Caulfield , Guido Ivetta , Haiyue Song , Henok Biadglign Ademtew , Hernán Maina , Holy Lovenia , Israel Abebe Azime , Jan Christian Blaise Cruz , Jay Gala , Jiahui Geng , Jesus-German Ortiz-Barajas , Jinheon Baek , Jocelyn Dunstan , Laura Alonso Alemany , Kumaranage Ravindu Yasas Nagasinghe , Luciana Benotti , Luis Fernando D'Haro , Marcelo Viridiano , Marcos Estecha-Garitagoitia , Maria Camila Buitrago Cabrera , Mario Rodríguez-Cantelar , Mélanie Jouitteau , Mihail Mihaylov , Mohamed Fazli Mohamed Imam , Muhammad Farid Adilazuarda , Munkhjargal Gochoo , Munkh-Erdene Otgonbold , Naome Etori , Olivier Niyomugisha , Paula Mónica Silva , Pranjal Chitale , Raj Dabre , Rendi Chevi , Ruochen Zhang , Ryandito Diandaru , Samuel Cahyawijaya , Santiago Góngora , Soyeong Jeong , Sukannya Purkayastha , Tatsuki Kuribayashi , Teresa Clifford , Thanmay Jayakumar , Tiago Timponi Torrent , Toqeer Ehsan , Vladimir Araujo , Yova Kementchedjhieva , Zara Burzo , Zheng Wei Lim , Zheng Xin Yong , Oana Ignat , Joan Nwatu , Rada Mihalcea , Thamar Solorio , Alham Fikri Aji

Visual Question and Answering (VQA) problems are attracting increasing interest from multiple research disciplines. Solving VQA problems requires techniques from both computer vision for understanding the visual contents of a presented…

计算机视觉与模式识别 · 计算机科学 2016-04-07 Ilija Ilievski , Shuicheng Yan , Jiashi Feng

Recently, a number of deep-learning based models have been proposed for the task of Visual Question Answering (VQA). The performance of most models is clustered around 60-70%. In this paper we propose systematic methods to analyze the…

计算与语言 · 计算机科学 2016-10-05 Aishwarya Agrawal , Dhruv Batra , Devi Parikh

Visual question answering (VQA) is one of the crucial vision-and-language tasks. Yet, existing VQA research has mostly focused on the English language, due to a lack of suitable evaluation resources. Previous work on cross-lingual VQA has…

计算与语言 · 计算机科学 2023-06-12 Chen Liu , Jonas Pfeiffer , Anna Korhonen , Ivan Vulić , Iryna Gurevych

We propose a novel algorithm for visual question answering based on a recurrent deep neural network, where every module in the network corresponds to a complete answering unit with attention mechanism by itself. The network is optimized by…

计算机视觉与模式识别 · 计算机科学 2016-10-03 Hyeonwoo Noh , Bohyung Han

In this paper, we focus on the Audio-Visual Question Answering (AVQA) task, which aims to answer questions regarding different visual objects, sounds, and their associations in videos. The problem requires comprehensive multimodal…

计算机视觉与模式识别 · 计算机科学 2022-04-06 Guangyao Li , Yake Wei , Yapeng Tian , Chenliang Xu , Ji-Rong Wen , Di Hu

Visual Question Answering (VQA) is a task that requires computers to give correct answers for the input questions based on the images. This task can be solved by humans with ease but is a challenge for computers. The VLSP2022-EVJVQA shared…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Triet Minh Thai , Son T. Luu

Visual question answering (VQA) is of significant interest due to its potential to be a strong test of image understanding systems and to probe the connection between language and vision. Despite much recent progress, general VQA is far…

计算机视觉与模式识别 · 计算机科学 2018-01-25 Zhe Wang , Xiaoyi Liu , Liangjian Chen , Limin Wang , Yu Qiao , Xiaohui Xie , Charless Fowlkes

Visual Question Answering (VQA) presents a unique challenge by requiring models to understand and reason about visual content to answer questions accurately. Existing VQA models often struggle with biases introduced by the training data,…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Zhifei Li , Feng Qiu , Yiran Wang , Yujing Xia , Kui Xiao , Miao Zhang , Yan Zhang

Deep neural networks have been playing an essential role in the task of Visual Question Answering (VQA). Until recently, their accuracy has been the main focus of research. Now there is a trend toward assessing the robustness of these…

计算机视觉与模式识别 · 计算机科学 2022-03-04 Jia-Hong Huang , Modar Alfadly , Bernard Ghanem , Marcel Worring

The advent and proliferation of large multi-modal models (LMMs) have introduced new paradigms to computer vision, transforming various tasks into a unified visual question answering framework. Video Quality Assessment (VQA), a classic field…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Ziheng Jia , Zicheng Zhang , Jiaying Qian , Haoning Wu , Wei Sun , Chunyi Li , Xiaohong Liu , Weisi Lin , Guangtao Zhai , Xiongkuo Min

Visual Question Answering (VQA) in its ideal form lets us study reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most VQA benchmarks to date are focused on questions…

计算机视觉与模式识别 · 计算机科学 2019-09-05 Kenneth Marino , Mohammad Rastegari , Ali Farhadi , Roozbeh Mottaghi

Answering open-ended questions is an essential capability for any intelligent agent. One of the most interesting recent open-ended question answering challenges is Visual Question Answering (VQA) which attempts to evaluate a system's visual…

计算与语言 · 计算机科学 2016-10-25 Omid Bakhshandeh , Trung Bui , Zhe Lin , Walter Chang

Visual Question Answering (VQA) deep-learning systems tend to capture superficial statistical correlations in the training data because of strong language priors and fail to generalize to test data with a significantly different…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Jialin Wu , Raymond J. Mooney

Popularized as 'bottom-up' attention, bounding box (or region) based visual features have recently surpassed vanilla grid-based convolutional features as the de facto standard for vision and language tasks like visual question answering…

计算机视觉与模式识别 · 计算机科学 2020-04-06 Huaizu Jiang , Ishan Misra , Marcus Rohrbach , Erik Learned-Miller , Xinlei Chen

The multimodal task of Visual Question Answering (VQA) encompassing elements of Computer Vision (CV) and Natural Language Processing (NLP), aims to generate answers to questions on any visual input. Over time, the scope of VQA has expanded…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Md Farhan Ishmam , Md Sakib Hossain Shovon , M. F. Mridha , Nilanjan Dey

Recently visual question answering (VQA) and visual question generation (VQG) are two trending topics in the computer vision, which have been explored separately. In this work, we propose an end-to-end unified framework, the Invertible…

计算机视觉与模式识别 · 计算机科学 2017-09-22 Yikang Li , Nan Duan , Bolei Zhou , Xiao Chu , Wanli Ouyang , Xiaogang Wang

There has been a rapid progress in the task of Visual Question Answering with improved model architectures. Unfortunately, these models are usually computationally intensive due to their sheer size which poses a serious challenge for…

机器学习 · 计算机科学 2019-09-23 Vardaan Pahuja , Jie Fu , Christopher J. Pal

We propose a novel attention based deep learning architecture for visual question answering task (VQA). Given an image and an image related natural language question, VQA generates the natural language answer for the question. Generating…

计算机视觉与模式识别 · 计算机科学 2016-04-05 Kan Chen , Jiang Wang , Liang-Chieh Chen , Haoyuan Gao , Wei Xu , Ram Nevatia