English
Related papers

Related papers: Dataset and Benchmark for Urdu Natural Scenes Text…

200 papers

Visual question answering (VQA) is an important and challenging multimodal task in computer vision. Recently, a few efforts have been made to bring VQA task to aerial images, due to its potential real-world applications in disaster…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Kun Li , George Vosselman , Michael Ying Yang

In visual question answering (VQA), a machine must answer a question given an associated image. Recently, accessibility researchers have explored whether VQA can be deployed in a real-world setting where users with visual impairments learn…

Computation and Language · Computer Science 2022-10-28 Yang Trista Cao , Kyle Seelman , Kyungjun Lee , Hal Daumé

We present TUMTraffic-VideoQA, a novel dataset and benchmark designed for spatio-temporal video understanding in complex roadside traffic scenarios. The dataset comprises 1,000 videos, featuring 85,000 multiple-choice QA pairs, 2,300 object…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Xingcheng Zhou , Konstantinos Larintzakis , Hao Guo , Walter Zimmer , Mingyu Liu , Hu Cao , Jiajie Zhang , Venkatnarayanan Lakshminarasimhan , Leah Strand , Alois C. Knoll

The Visual Question Answering (VQA) task utilizes both visual image and language analysis to answer a textual question with respect to an image. It has been a popular research topic with an increasing number of real-world applications in…

Visual question answering (VQA) systems face significant challenges when adapting to real-world data shifts, especially in multi-modal contexts. While robust fine-tuning strategies are essential for maintaining performance across…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Chengyue Huang , Brisa Maneechotesuwan , Shivang Chopra , Zsolt Kira

Visual Question Answering (VQA) is the task of taking as input an image and a free-form natural language question about the image, and producing an accurate answer. In this work we view VQA as a "feature extraction" module to extract image…

Computer Vision and Pattern Recognition · Computer Science 2016-09-02 Xiao Lin , Devi Parikh

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

Computation and Language · Computer Science 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

Multilingual OCR and information extraction from receipts remains challenging, particularly for complex scripts like Arabic. We introduce \dataset, a comprehensive dataset designed for Arabic-English receipt understanding comprising 20,000…

We introduce KazQAD -- a Kazakh open-domain question answering (ODQA) dataset -- that can be used in both reading comprehension and full ODQA settings, as well as for information retrieval experiments. KazQAD contains just under 6,000…

Computation and Language · Computer Science 2024-04-09 Rustem Yeshpanov , Pavel Efimov , Leonid Boytsov , Ardak Shalkarbayuli , Pavel Braslavski

Visual question answering (VQA) is the multi-modal task of answering natural language questions about an input image. Through cross-dataset adaptation methods, it is possible to transfer knowledge from a source dataset with larger train…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Arjun R. Akula

Visual question answering (VQA) and image captioning require a shared body of general knowledge connecting language and vision. We present a novel approach to improve VQA performance that exploits this connection by jointly generating…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Jialin Wu , Zeyuan Hu , Raymond J. Mooney

Visual question answering is a multimodal task that requires the joint comprehension of visual and textual information. However, integrating visual and textual semantics solely through attention layers is insufficient to comprehensively…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Peize Li , Qingyi Si , Peng Fu , Zheng Lin , Yan Wang

This paper presents the system description submitted at the FIRE Shared Task: "The 2021 Fake News Detection in the Urdu Language". This challenge aims at automatically identifying Fake news written in Urdu. Our submitted results ranked…

Computation and Language · Computer Science 2022-04-08 Muhammad Humayoun

Audio-visual quality assessment (AVQA) research has been stalled by limitations of existing datasets: they are typically small in scale, with insufficient diversity in content and quality, and annotated only with overall scores. These…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Renyu Yang , Jian Jin , Lili Meng , Meiqin Liu , Yilin Wang , Balu Adsumilli , Weisi Lin

Visual question answering (VQA) usesimage processing algorithms to process the image and natural language processing methods to understand and answer the question. VQA is helpful to a visually impaired person, can be used for the security…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Param Ahir , Hiteishi M. Diwanji

Visual Question Answering (VQA) and Image Captioning (CAP), which are among the most popular vision-language tasks, have analogous scene-text versions that require reasoning from the text in the image. Despite their obvious resemblance, the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Roy Ganz , Oren Nuriel , Aviad Aberdam , Yair Kittenplon , Shai Mazor , Ron Litman

Visual similarities discovery (VSD) is an important task with broad e-commerce applications. Given an image of a certain object, the goal of VSD is to retrieve images of different objects with high perceptual visual similarity. Although…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Oren Barkan , Tal Reiss , Jonathan Weill , Ori Katz , Roy Hirsch , Itzik Malkiel , Noam Koenigstein

The multimodal task of Visual Question Answering (VQA) encompassing elements of Computer Vision (CV) and Natural Language Processing (NLP), aims to generate answers to questions on any visual input. Over time, the scope of VQA has expanded…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Md Farhan Ishmam , Md Sakib Hossain Shovon , M. F. Mridha , Nilanjan Dey

Text-based VQA aims at answering questions by reading the text present in the images. It requires a large amount of scene-text relationship understanding compared to the VQA task. Recent studies have shown that the question-answer pairs in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Shamanthak Hegde , Soumya Jahagirdar , Shankar Gangisetty

Existing video understanding datasets mostly focus on human interactions, with little attention being paid to the "in the wild" settings, where the videos are recorded outdoors. We propose WILDQA, a video understanding dataset of videos…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Santiago Castro , Naihao Deng , Pingxuan Huang , Mihai Burzo , Rada Mihalcea