中文
相关论文

相关论文: VisQA: X-raying Vision and Language Reasoning in T…

200 篇论文

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…

Video Question Answering (VideoQA) is a challenging task that requires understanding complex visual and temporal relationships within videos to answer questions accurately. In this work, we introduce \textbf{ReasVQA} (Reasoning-enhanced…

计算机视觉与模式识别 · 计算机科学 2025-01-24 Jianxin Liang , Xiaojun Meng , Huishuai Zhang , Yueqian Wang , Jiansheng Wei , Dongyan Zhao

This paper revisits visual representation in knowledge-based visual question answering (VQA) and demonstrates that using regional information in a better way can significantly improve the performance. While visual representation is…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Yuanze Lin , Yujia Xie , Dongdong Chen , Yichong Xu , Chenguang Zhu , Lu Yuan

Abductive reasoning seeks the likeliest possible explanation for partial observations. Although abduction is frequently employed in human daily reasoning, it is rarely explored in computer vision literature. In this paper, we propose a new…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Chen Liang , Wenguan Wang , Tianfei Zhou , Yi Yang

Despite remarkable progress in recent years, Vision Language Models (VLMs) remain prone to overconfidence and hallucinations on tasks such as Visual Question Answering (VQA) and Visual Reasoning. Bayesian methods can potentially improve…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Tobias Jan Wieczorek , Nathalie Daun , Mohammad Emtiyaz Khan , Marcus Rohrbach

Visual Question Answering (VQA) is a fundamental task in computer vision and natural language process fields. Although the ``pre-training & finetuning'' learning paradigm significantly improves the VQA performance, the adversarial…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Ziyi Yin , Muchao Ye , Tianrong Zhang , Jiaqi Wang , Han Liu , Jinghui Chen , Ting Wang , Fenglong Ma

Vision-Language-Action (VLA) models improve action generation by conditioning policies on rich vision-language information. However, current auto-regressive policies are constrained by three bottlenecks: (1) architectural bias drives models…

机器人学 · 计算机科学 2026-03-31 Yichi Zhang , Weihao Yuan , Yizhuo Zhang , Xidong Zhang , Jia Wan

Knowledge-based Visual Question Answering (KVQA) requires external knowledge beyond the visible content to answer questions about an image. This ability is challenging but indispensable to achieve general VQA. One limitation of existing…

人工智能 · 计算机科学 2020-11-04 Jing Yu , Zihao Zhu , Yujing Wang , Weifeng Zhang , Yue Hu , Jianlong Tan

Existing benchmarks for visual question answering lack in visual grounding and complexity, particularly in evaluating spatial reasoning skills. We introduce FlowVQA, a novel benchmark aimed at assessing the capabilities of visual…

计算与语言 · 计算机科学 2024-07-01 Shubhankar Singh , Purvi Chaurasia , Yerram Varun , Pranshu Pandya , Vatsal Gupta , Vivek Gupta , Dan Roth

Recently, Visual Question Answering (VQA) has emerged as one of the most significant tasks in multimodal learning as it requires understanding both visual and textual modalities. Existing methods mainly rely on extracting image and question…

计算机视觉与模式识别 · 计算机科学 2018-07-23 Pan Lu , Lei Ji , Wei Zhang , Nan Duan , Ming Zhou , Jianyong Wang

Multi-modal tasks involving vision and language in deep learning continue to rise in popularity and are leading to the development of newer models that can generalize beyond the extent of their training data. The current models lack…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Ethan Shen , Scotty Singh , Bhavesh Kumar

Vision language tasks, such as answering questions about or generating captions that describe an image, are difficult tasks for computers to perform. A relatively recent body of research has adapted the pretrained transformer architecture…

计算机视觉与模式识别 · 计算机科学 2023-07-10 Clayton Fields , Casey Kennington

Effectiveness and interpretability are two essential properties for trustworthy AI systems. Most recent studies in visual reasoning are dedicated to improving the accuracy of predicted answers, and less attention is paid to explaining the…

计算机视觉与模式识别 · 计算机科学 2022-03-14 Shi Chen , Qi Zhao

Data visualizations are powerful tools for communicating patterns in quantitative data. Yet understanding any data visualization is no small feat -- succeeding requires jointly making sense of visual, numerical, and linguistic inputs…

人机交互 · 计算机科学 2025-05-26 Arnav Verma , Kushin Mukherjee , Christopher Potts , Elisa Kreiss , Judith E. Fan

Most recent state-of-the-art Visual Question Answering (VQA) systems are opaque black boxes that are only trained to fit the answer distribution given the question and visual content. As a result, these systems frequently take shortcuts,…

计算机视觉与模式识别 · 计算机科学 2020-06-30 Jialin Wu , Liyan Chen , Raymond J. Mooney

Visual question answering (Visual QA) has attracted a lot of attention lately, seen essentially as a form of (visual) Turing test that artificial intelligence should strive to achieve. In this paper, we study a crucial component of this…

计算与语言 · 计算机科学 2018-06-12 Wei-Lun Chao , Hexiang Hu , Fei Sha

Image Quality Assessment (IQA) is a long-standing problem in computer vision. Previous methods typically focus on predicting numerical scores without explanation or providing low-level descriptions lacking precise scores. Recent…

计算机视觉与模式识别 · 计算机科学 2026-01-16 Guoqiang Liang , Jianyi Wang , Zhonghua Wu , Shangchen Zhou

Visual Question Answering (VQA) methods have made incredible progress, but suffer from a failure to generalize. This is visible in the fact that they are vulnerable to learning coincidental correlations in the data rather than deeper…

计算机视觉与模式识别 · 计算机科学 2020-02-27 Xinyu Wang , Yuliang Liu , Chunhua Shen , Chun Chet Ng , Canjie Luo , Lianwen Jin , Chee Seng Chan , Anton van den Hengel , Liangwei Wang

Visual Question Answering (VQA) attracts much attention from both industry and academia. As a multi-modality task, it is challenging since it requires not only visual and textual understanding, but also the ability to align cross-modality…

计算机视觉与模式识别 · 计算机科学 2022-01-27 Peixi Xiong , Quanzeng You , Pei Yu , Zicheng Liu , Ying Wu

Visual Question Answering (VQA) is challenging due to the complex cross-modal relations. It has received extensive attention from the research community. From the human perspective, to answer a visual question, one needs to read the…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Hantao Huang , Tao Han , Wei Han , Deep Yap , Cheng-Ming Chiang