中文
相关论文

相关论文: SQuINTing at VQA Models: Introspecting VQA Models …

200 篇论文

Product review websites provide an incredible lens into the wide variety of opinions and experiences of different people, and play a critical role in helping users discover products that match their personal needs and preferences. To help…

信息检索 · 计算机科学 2016-10-27 Mengting Wan , Julian McAuley

Visual Question Answering (VQA) in remote sensing (RS) is pivotal for interpreting Earth observation data. However, existing RS VQA datasets are constrained by limitations in annotation richness, question diversity, and the assessment of…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Xing Zi , Jinghao Xiao , Yunxiao Shi , Xian Tao , Jun Li , Ali Braytee , Mukesh Prasad

Visual Question and Answering (VQA) problems are attracting increasing interest from multiple research disciplines. Solving VQA problems requires techniques from both computer vision for understanding the visual contents of a presented…

计算机视觉与模式识别 · 计算机科学 2016-04-07 Ilija Ilievski , Shuicheng Yan , Jiashi Feng

Recent video question answering benchmarks indicate that state-of-the-art models struggle to answer compositional questions. However, it remains unclear which types of compositional reasoning cause models to mispredict. Furthermore, it is…

计算机视觉与模式识别 · 计算机科学 2022-05-25 Mona Gandhi , Mustafa Omer Gul , Eva Prakash , Madeleine Grunde-McLaughlin , Ranjay Krishna , Maneesh Agrawala

Recent advances in reasoning-enhanced Large Language Models such as OpenAI-o1/3 and DeepSeek-R1 have significantly improved performance on complex tasks. However, the quality and transparency of their internal reasoning processes remain…

计算与语言 · 计算机科学 2025-06-04 Juncheng Wu , Sheng Liu , Haoqin Tu , Hang Yu , Xiaoke Huang , James Zou , Cihang Xie , Yuyin Zhou

Methods for Visual Question Anwering (VQA) are notorious for leveraging dataset biases rather than performing reasoning, hindering generalization. It has been recently shown that better reasoning patterns emerge in attention layers of a…

计算机视觉与模式识别 · 计算机科学 2021-06-11 Corentin Kervadec , Christian Wolf , Grigory Antipov , Moez Baccouche , Madiha Nadri

Large language models perform well on many medical QA benchmarks, but real clinical reasoning often requires integrating evidence across multiple images rather than interpreting a single view. We introduce MedThinkVQA, an expert-annotated…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Zonghai Yao , Benlu Wang , Yifan Zhang , Junda Wang , Iris Xia , Zhipeng Tang , Shuo Han , Feiyun Ouyang , Zhichao Yang , Arman Cohan , Hong Yu

Visual question answering (VQA) requires joint comprehension of images and natural language questions, where many questions can't be directly or clearly answered from visual content but require reasoning from structured human knowledge with…

计算机视觉与模式识别 · 计算机科学 2018-06-14 Zhou Su , Chen Zhu , Yinpeng Dong , Dongqi Cai , Yurong Chen , Jianguo Li

Despite the rapid progress in multihop question-answering (QA), models still have trouble explaining why an answer is correct, with limited explanation training data available to learn from. To address this, we introduce three explanation…

计算与语言 · 计算机科学 2020-10-08 Harsh Jhamtani , Peter Clark

Visual Question Answering (VQA) concerns providing answers to Natural Language questions about images. Several deep neural network approaches have been proposed to model the task in an end-to-end fashion. Whereas the task is grounded in…

人工智能 · 计算机科学 2020-02-03 Mehrdad Alizadeh , Barbara Di Eugenio

Visual Question Answering (VQA) deep-learning systems tend to capture superficial statistical correlations in the training data because of strong language priors and fail to generalize to test data with a significantly different…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Jialin Wu , Raymond J. Mooney

Zero-shot Visual Question Answering (VQA) is a prominent vision-language task that examines both the visual and textual understanding capability of systems in the absence of training data. Recently, by converting the images into captions,…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Yunshi Lan , Xiang Li , Xin Liu , Yang Li , Wei Qin , Weining Qian

Visual question answering (VQA) has witnessed great progress since May, 2015 as a classic problem unifying visual and textual data into a system. Many enlightening VQA works explore deep into the image and question encodings and fusing…

计算机视觉与模式识别 · 计算机科学 2017-02-23 Yuetan Lin , Zhangyang Pang , Donghui Wang , Yueting Zhuang

Existing Visual Question Answering (VQA) models are often fragile and sensitive to input variations. In this paper, we propose a novel approach to address this issue based on modular networks, which creates two questions related by…

计算机视觉与模式识别 · 计算机科学 2020-12-24 Spencer Whitehead , Hui Wu , Yi Ren Fung , Heng Ji , Rogerio Feris , Kate Saenko

A multi-hop question answering (QA) dataset aims to test reasoning and inference skills by requiring a model to read multiple paragraphs to answer a given question. However, current datasets do not provide a complete explanation for the…

计算与语言 · 计算机科学 2020-11-13 Xanh Ho , Anh-Khoa Duong Nguyen , Saku Sugawara , Akiko Aizawa

A number of recent works have proposed attention models for Visual Question Answering (VQA) that generate spatial maps highlighting image regions relevant to answering the question. In this paper, we argue that in addition to modeling…

计算机视觉与模式识别 · 计算机科学 2017-01-20 Jiasen Lu , Jianwei Yang , Dhruv Batra , Devi Parikh

Visual Commonsense Reasoning (VCR), deemed as one challenging extension of the Visual Question Answering (VQA), endeavors to pursue a more high-level visual comprehension. It is composed of two indispensable processes: question answering…

计算机视觉与模式识别 · 计算机科学 2023-07-26 Zhenyang Li , Yangyang Guo , Kejie Wang , Yinwei Wei , Liqiang Nie , Mohan Kankanhalli

In visual question answering (VQA), a machine must answer a question given an associated image. Recently, accessibility researchers have explored whether VQA can be deployed in a real-world setting where users with visual impairments learn…

计算与语言 · 计算机科学 2022-10-28 Yang Trista Cao , Kyle Seelman , Kyungjun Lee , Hal Daumé

The last several years have seen intensive interest in exploring neural-network-based models for machine comprehension (MC) and question answering (QA). In this paper, we approach the problems by closely modelling questions in a neural…

计算与语言 · 计算机科学 2017-03-28 Junbei Zhang , Xiaodan Zhu , Qian Chen , Lirong Dai , Si Wei , Hui Jiang

Recent advancements in reasoning language models have demonstrated remarkable performance in complex tasks, but their extended chain-of-thought reasoning process increases inference overhead. While quantization has been widely adopted to…

计算与语言 · 计算机科学 2025-08-19 Ruikang Liu , Yuxuan Sun , Manyi Zhang , Haoli Bai , Xianzhi Yu , Tiezheng Yu , Chun Yuan , Lu Hou