中文
相关论文

相关论文: A Focused Dynamic Attention Model for Visual Quest…

200 篇论文

Rich and dense human labeled datasets are among the main enabling factors for the recent advance on vision-language understanding. Many seemingly distant annotations (e.g., semantic segmentation and visual question answering (VQA)) are…

计算机视觉与模式识别 · 计算机科学 2017-08-17 Chuang Gan , Yandong Li , Haoxiang Li , Chen Sun , Boqing Gong

In this paper, we propose a method to obtain robust explanations for visual question answering(VQA) that correlate well with the answers. Our model explains the answers obtained through a VQA model by providing visual and textual…

计算机视觉与模式识别 · 计算机科学 2020-01-24 Badri N. Patro , Shivansh Pate , Vinay P. Namboodiri

Decoding visual content from fMRI signals recorded while a person views images, and specifically answering questions about the seen images, is a long-standing challenge. While significant progress has been made in recent years in visual…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Roman Beliy , Matias Cosarinsky , Oliver Heinimann , Navve Wasserman , Michal Irani

Visual Question Answering (VQA) has become one of the key benchmarks of visual recognition progress. Multiple VQA extensions have been explored to better simulate real-world settings: different question formulations, changing training and…

计算机视觉与模式识别 · 计算机科学 2022-02-21 Arjun Mani , Nobline Yoo , Will Hinthorn , Olga Russakovsky

We investigate the problem of cross-dataset adaptation for visual question answering (Visual QA). Our goal is to train a Visual QA model on a source dataset but apply it to another target one. Analogous to domain adaptation for visual…

计算机视觉与模式识别 · 计算机科学 2018-06-12 Wei-Lun Chao , Hexiang Hu , Fei Sha

Video quality assessment (VQA) is an important processing task, aiming at predicting the quality of videos in a manner highly consistent with human judgments of perceived quality. Traditional VQA models based on natural image and/or video…

图像与视频处理 · 电气工程与系统科学 2024-12-12 Qi Zheng , Yibo Fan , Leilei Huang , Tianyu Zhu , Jiaming Liu , Zhijian Hao , Shuo Xing , Chia-Ju Chen , Xiongkuo Min , Alan C. Bovik , Zhengzhong Tu

Visual Question Answering (VQA) is a complex semantic task requiring both natural language processing and visual recognition. In this paper, we explore whether VQA is solvable when images are captured in a sub-Nyquist compressive paradigm.…

计算机视觉与模式识别 · 计算机科学 2018-06-12 Li-Chi Huang , Kuldeep Kulkarni , Anik Jha , Suhas Lohit , Suren Jayasuriya , Pavan Turaga

Video Question Answering (VQA) inherently relies on multimodal reasoning, integrating visual, temporal, and linguistic cues to achieve a deeper understanding of video content. However, many existing methods rely on feeding frame-level…

Visual Question Answering (VQA) has achieved great success thanks to the fast development of deep neural networks (DNN). On the other hand, the data augmentation, as one of the major tricks for DNN, has been widely used in many computer…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Ruixue Tang , Chao Ma , Wei Emma Zhang , Qi Wu , Xiaokang Yang

Visual question answering (VQA) is a challenging multi-modal task that requires not only the semantic understanding of both images and questions, but also the sound perception of a step-by-step reasoning process that would lead to the…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Siwen Luo , Soyeon Caren Han , Kaiyuan Sun , Josiah Poon

Having revolutionized natural language processing (NLP) applications, large language models (LLMs) are expanding into the realm of multimodal inputs. Owing to their ability to interpret images, multimodal LLMs (MLLMs) have been primarily…

计算机视觉与模式识别 · 计算机科学 2024-02-14 Jusung Lee , Sungguk Cha , Younghyun Lee , Cheoljong Yang

Visual Question Answering (VQA) has attracted attention from both computer vision and natural language processing communities. Most existing approaches adopt the pipeline of representing an image via pre-trained CNNs, and then using the…

计算机视觉与模式识别 · 计算机科学 2018-01-30 Qing Li , Jianlong Fu , Dongfei Yu , Tao Mei , Jiebo Luo

Medical visual question answering (VQA) bridges the gap between visual information and clinical decision-making, enabling doctors to extract understanding from clinical images and videos. In particular, surgical VQA can enhance the…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Long Bai , Guankun Wang , Mobarakol Islam , Lalithkumar Seenivasan , An Wang , Hongliang Ren

Visual Question Answering(VQA) is a highly complex problem set, relying on many sub-problems to produce reasonable answers. In this paper, we present the hypothesis that Visual Question Answering should be viewed as a multi-task problem,…

计算机视觉与模式识别 · 计算机科学 2020-07-06 Amelia Elizabeth Pollard , Jonathan L. Shapiro

Though beneficial for encouraging the Visual Question Answering (VQA) models to discover the underlying knowledge by exploiting the input-output correlation beyond image and text contexts, the existing knowledge VQA datasets are mostly…

计算机视觉与模式识别 · 计算机科学 2020-12-15 Qingxing Cao , Bailin Li , Xiaodan Liang , Keze Wang , Liang Lin

We present a method that learns to answer visual questions by selecting image regions relevant to the text-based query. Our method exhibits significant improvements in answering questions such as "what color," where it is necessary to…

计算机视觉与模式识别 · 计算机科学 2016-01-12 Kevin J. Shih , Saurabh Singh , Derek Hoiem

To contribute to automating the medical vision-language model, we propose a novel Chest-Xray Difference Visual Question Answering (VQA) task. Given a pair of main and reference images, this task attempts to answer several questions on both…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Xinyue Hu , Lin Gu , Qiyuan An , Mengliang Zhang , Liangchen Liu , Kazuma Kobayashi , Tatsuya Harada , Ronald M. Summers , Yingying Zhu

Recent works in self-supervised learning have shown impressive results on single-object images, but they struggle to perform well on complex multi-object images as evidenced by their poor visual grounding. To demonstrate this concretely, we…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Aishwarya Agarwal , Srikrishna Karanam , Balaji Vasan Srinivasan

Knowledge-based visual question answering (KB-VQA) requires vision-language models to understand images and use external knowledge, especially for rare entities and long-tail facts. Most existing retrieval-augmented generation (RAG) methods…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Zhuohong Chen , Zhenxian Wu , Yunyao Yu , Hangrui Xu , Zirui Liao , Zhifang Liu , Xiangwen Deng , Pen Jiao , Haoqian Wang

Learning-based video quality assessment (VQA) has advanced rapidly, yet progress is increasingly constrained by a disconnect between model design and dataset curation. Model-centric approaches often iterate on fixed benchmarks, while…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Jian Zou , Xiaoyu Xu , Zhihua Wang , Yilin Wang , Balu Adsumilli , Kede Ma