English
Related papers

Related papers: Privacy-Aware Document Visual Question Answering

200 papers

Visual Question Answering (VQA) is a challenging task that has received increasing attention from both the computer vision and the natural language processing communities. Given an image and a question in natural language, it requires…

Computer Vision and Pattern Recognition · Computer Science 2016-07-21 Qi Wu , Damien Teney , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

Document question answering is a task of question answering on given documents such as reports, slides, pamphlets, and websites, and it is a truly demanding task as paper and electronic forms of documents are so common in our society. This…

Computation and Language · Computer Science 2024-03-29 Eri Onami , Shuhei Kurita , Taiki Miyanishi , Taro Watanabe

The massive use of digital documents due to the substantial trend of paperless initiatives confronted some companies to find ways to process thousands of documents per day automatically. To achieve this, they use automatic information…

Visual Question Answering (VQA) is an extremely stimulating and challenging research area where Computer Vision (CV) and Natural Language Processig (NLP) have recently met. In image captioning and video summarization, the semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Silvio Barra , Carmen Bisogni , Maria De Marsico , Stefano Ricciardi

The Visual Question Answering (VQA) task combines challenges for processing data with both Visual and Linguistic processing, to answer basic `common sense' questions about given images. Given an image and a question in natural language, the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey , Snehasis Mukherjee

Visual Question Answering (VQA) has attracted much attention since it offers insight into the relationships between the multi-modal analysis of images and natural language. Most of the current algorithms are incapable of answering…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Guohao Li , Hang Su , Wenwu Zhu

Visual question answering (VQA) has been gaining a lot of traction in the machine learning community in the recent years due to the challenges posed in understanding information coming from multiple modalities (i.e., images, language). In…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Muralikrishnna G. Sethuraman , Ali Payani , Faramarz Fekri , J. Clayton Kerce

Combining multiple perceptual inputs and performing combinatorial reasoning in complex scenarios is a sophisticated cognitive function in humans. With advancements in multi-modal large language models, recent benchmarks tend to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chao Wang , Luning Zhang , Zheng Wang , Yang Zhou

Document Visual Question Answering (DocVQA) enables end-to-end reasoning grounded on information present in a document input. While recent models have shown impressive capabilities, they remain vulnerable to adversarial attacks. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Marco Pintore , Maura Pintor , Dimosthenis Karatzas , Battista Biggio

Document understanding and information extraction include different tasks to understand a document and extract valuable information automatically. Recently, there has been a rising demand for developing document understanding among…

Information Retrieval · Computer Science 2023-08-01 Soyeon Caren Han , Yihao Ding , Siwen Luo , Josiah Poon , HeeGuen Yoon , Zhe Huang , Paul Duuring , Eun Jung Holden

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

Computation and Language · Computer Science 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

Document Visual Question Answering (VQA) aims to understand visually-rich documents to answer questions in natural language, which is an emerging research topic for both Natural Language Processing and Computer Vision. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Fengbin Zhu , Wenqiang Lei , Fuli Feng , Chao Wang , Haozhou Zhang , Tat-Seng Chua

Visual question answering (VQA) is a task that combines both the techniques of computer vision and natural language processing. It requires models to answer a text-based question according to the information contained in a visual. In recent…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Yeyun Zou , Qiyu Xie

Document Visual Question Answering (Document VQA) faces significant challenges when processing long documents in low-resource environments due to context limitations and insufficient training data. This paper presents AdaDocVQA, a unified…

Computation and Language · Computer Science 2025-08-20 Haoxuan Li , Wei Song , Aofan Liu , Peiwu Qin

Recent years have witnessed remarkable progress in developing Vision-Language Models (VLMs) capable of processing both textual and visual inputs. These models have demonstrated impressive performance, leading to their widespread adoption in…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Hanene F. Z. Brachemi Meftah , Wassim Hamidouche , Sid Ahmed Fezza , Olivier Déforges

Document Question Answering (QA) presents a challenge in understanding visually-rich documents (VRD), particularly those dominated by lengthy textual content like research journal articles. Existing studies primarily focus on real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yihao Ding , Kaixuan Ren , Jiabin Huang , Siwen Luo , Soyeon Caren Han

Document Visual Question Answering (DocVQA) requires vision-language models to reason not only about what information in a document is relevant to a question, but also where the answer is grounded on the page. Existing DocVQA models…

Machine Learning · Computer Science 2026-05-08 Kjetil Indrehus , Adrian Duric , Changkyu Choi , Ali Ramezani-Kebrya

Enterprise documents such as forms, invoices, receipts, reports, contracts, and other similar records, often carry rich semantics at the intersection of textual and spatial modalities. The visual cues offered by their complex layouts play a…

Computation and Language · Computer Science 2024-01-03 Dongsheng Wang , Natraj Raman , Mathieu Sibue , Zhiqiang Ma , Petr Babkin , Simerjot Kaur , Yulong Pei , Armineh Nourbakhsh , Xiaomo Liu

Document Visual Question Answering (VQA) demands robust integration of text detection, recognition, and spatial reasoning to interpret complex document layouts. In this work, we introduce DLaVA, a novel, training-free pipeline that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Ahmad Mohammadshirazi , Pinaki Prasad Guha Neogi , Ser-Nam Lim , Rajiv Ramnath

The emergence of Multimodal Large Language Models (MLLMs) and the widespread usage of MLLM cloud services such as GPT-4V raised great concerns about privacy leakage in visual data. As these models are typically deployed in cloud services,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xiaofei Hui , Qian Wu , Haoxuan Qu , Majid Mirmehdi , Hossein Rahmani , Jun Liu