中文
相关论文

相关论文: Human-Adversarial Visual Question Answering

200 篇论文

Machine learning fairness concerns about the biases towards certain protected or sensitive group of people when addressing the target tasks. This paper studies the debiasing problem in the context of image classification tasks. Our data…

计算机视觉与模式识别 · 计算机科学 2020-08-14 Yi Zhang , Jitao Sang

Visual Question Answering (VQA) is a challenging task that requires systems to provide accurate answers to questions based on image content. Current VQA models struggle with complex questions due to limitations in capturing and integrating…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Peiyuan Chen , Zecheng Zhang , Yiping Dong , Li Zhou , Han Wang

Visual Question Answering (VQA) has been a widely studied topic, with extensive research focusing on how VLMs respond to answerable questions based on real-world images. However, there has been limited exploration of how these models handle…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Asir Saadat , Syem Aziz , Shahriar Mahmud , Abdullah Ibne Masud Mahi , Sabbir Ahmed

Audio-Visual Question Answering (AVQA) is a complex multi-modal reasoning task, demanding intelligent systems to accurately respond to natural language queries based on audio-video input pairs. Nevertheless, prevalent AVQA approaches are…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Jie Ma , Min Hu , Pinghui Wang , Wangchun Sun , Lingyun Song , Hongbin Pei , Jun Liu , Youtian Du

The advent and proliferation of large multi-modal models (LMMs) have introduced new paradigms to computer vision, transforming various tasks into a unified visual question answering framework. Video Quality Assessment (VQA), a classic field…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Ziheng Jia , Zicheng Zhang , Jiaying Qian , Haoning Wu , Wei Sun , Chunyi Li , Xiaohong Liu , Weisi Lin , Guangtao Zhai , Xiongkuo Min

Despite recent progress, state-of-the-art question answering models remain vulnerable to a variety of adversarial attacks. While dynamic adversarial data collection, in which a human annotator tries to write examples that fool a…

计算与语言 · 计算机科学 2022-03-16 Max Bartolo , Tristan Thrush , Robin Jia , Sebastian Riedel , Pontus Stenetorp , Douwe Kiela

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

计算与语言 · 计算机科学 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

Document Visual Question Answering (DocVQA) enables end-to-end reasoning grounded on information present in a document input. While recent models have shown impressive capabilities, they remain vulnerable to adversarial attacks. In this…

计算机视觉与模式识别 · 计算机科学 2025-12-05 Marco Pintore , Maura Pintor , Dimosthenis Karatzas , Battista Biggio

To completely understand a document, the use of textual information is not enough. Understanding visual cues, such as layouts and charts, is also required. While the current state-of-the-art approaches for document understanding (both…

计算与语言 · 计算机科学 2024-10-07 Ashim Gupta , Vivek Gupta , Shuo Zhang , Yujie He , Ning Zhang , Shalin Shah

In this paper, we propose a novel deep multi-level attention model to address inverse visual question answering. The proposed model generates regional visual and semantic features at the object level and then enhances them with the answer…

计算机视觉与模式识别 · 计算机科学 2020-12-04 Yaser Alwattar , Yuhong Guo

In recent years, people have increasingly used AI to help them with their problems by asking questions on different topics. One of these topics can be software-related and programming questions. In this work, we focus on the questions which…

计算机视觉与模式识别 · 计算机科学 2024-05-20 Motahhare Mirzaei , Mohammad Javad Pirhadi , Sauleh Eetemadi

Teaching Visual Question Answering (VQA) models to refrain from answering unanswerable questions is necessary for building a trustworthy AI system. Existing studies, though have explored various aspects of VQA but somewhat ignored this…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Yangyang Guo , Fangkai Jiao , Zhiqi Shen , Liqiang Nie , Mohan Kankanhalli

Video Question Answering (VideoQA) aims to answer natural language questions according to the given videos. It has earned increasing attention with recent research trends in joint vision and language understanding. Yet, compared with…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Yaoyao Zhong , Junbin Xiao , Wei Ji , Yicong Li , Weihong Deng , Tat-Seng Chua

Designing datasets for Visual Question Answering (VQA) is a difficult and complex task that requires NLP for parsing and computer vision for analysing the relevant aspects of the image for answering the question asked. Several benchmark…

计算机视觉与模式识别 · 计算机科学 2025-02-06 Madhuri Latha Madaka , Chakravarthy Bhagvati

Visual Question Answering (VQA) entails answering questions about images. We introduce the first VQA dataset in which all contents originate from an authentic use case. Sourced from online question answering community forums, we call it…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Chongyan Chen , Mengchen Liu , Noel Codella , Yunsheng Li , Lu Yuan , Danna Gurari

Machine learning models are vulnerable to adversarial examples: small changes to images can cause computer vision models to make mistakes such as identifying a school bus as an ostrich. However, it is still an open question whether humans…

Document Visual Question Answering (VQA) models have evolved at an impressive rate over the past few years, coming close to or matching human performance on some benchmarks. We argue that common evaluation metrics used by popular benchmarks…

计算与语言 · 计算机科学 2025-03-26 Armineh Nourbakhsh , Siddharth Parekh , Pranav Shetty , Zhao Jin , Sameena Shah , Carolyn Rose

Humans explain inter-object relationships with semantic labels that demonstrate a high-level understanding required to perform complex Vision-Language tasks such as Visual Question Answering (VQA). However, existing VQA models represent…

计算机视觉与模式识别 · 计算机科学 2020-10-06 Moshiur Farazi , Salman Khan , Nick Barnes

In recent years, there has been a growing emphasis on the intersection of audio, vision, and text modalities, driving forward the advancements in multimodal research. However, strong bias that exists in any modality can lead to the model…

计算机视觉与模式识别 · 计算机科学 2023-10-11 Xiulong Liu , Zhikang Dong , Peng Zhang

Human-machine interaction is increasingly dependent on speech communication. Machine Learning models are usually applied to interpret human speech commands. However, these models can be fooled by adversarial examples, which are inputs…

音频与语音处理 · 电气工程与系统科学 2021-02-15 Jon Vadillo , Roberto Santana