中文
相关论文

相关论文: RUArt: A Novel Text-Centered Solution for Text-Bas…

200 篇论文

Video text-based visual question answering (Video TextVQA) aims to answer questions by explicitly reading and reasoning about the text involved in a video. Most works in this field follow a frame-level framework which suffers from redundant…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Yan Zhang , Gangyan Zeng , Daiqing Wu , Huawen Shen , Binbin Li , Yu Zhou , Can Ma , Xiaojun Bi

We have seen great progress in basic perceptual tasks such as object recognition and detection. However, AI models still fail to match humans in high-level vision tasks due to the lack of capacities for deeper reasoning. Recently the new…

计算机视觉与模式识别 · 计算机科学 2016-04-12 Yuke Zhu , Oliver Groth , Michael Bernstein , Li Fei-Fei

Visual Question Answering (VQA) is an interdisciplinary field that bridges the gap between computer vision (CV) and natural language processing(NLP), enabling Artificial Intelligence(AI) systems to answer questions about images. Since its…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Anupam Pandey , Deepjyoti Bodo , Arpan Phukan , Asif Ekbal

Much recent progress in Vision-to-Language problems has been achieved through a combination of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs). This approach does not explicitly represent high-level semantic…

计算机视觉与模式识别 · 计算机科学 2016-12-19 Qi Wu , Chunhua Shen , Anton van den Hengel , Peng Wang , Anthony Dick

Answering visual questions need acquire daily common knowledge and model the semantic connection among different parts in images, which is too difficult for VQA systems to learn from images with the only supervision from answers. Meanwhile,…

计算与语言 · 计算机科学 2018-05-23 Jialin Wu , Zeyuan Hu , Raymond J. Mooney

Problems at the intersection of language and vision, like visual question answering, have recently been gaining a lot of attention in the field of multi-modal machine learning as computer vision research moves beyond traditional recognition…

计算与语言 · 计算机科学 2018-09-25 Khyathi Raghavi Chandu , Mary Arpita Pyreddy , Matthieu Felix , Narendra Nath Joshi

This paper revisits the bilinear attention networks in the visual question answering task from a graph perspective. The classical bilinear attention networks build a bilinear attention map to extract the joint representation of words in the…

计算机视觉与模式识别 · 计算机科学 2020-02-04 Dalu Guo , Chang Xu , Dacheng Tao

Visual question answering (VQA) models respond to open-ended natural language questions about images. While VQA is an increasingly popular area of research, it is unclear to what extent current VQA architectures learn key semantic…

计算机视觉与模式识别 · 计算机科学 2018-07-25 Gabriel Grand , Aron Szanto , Yoon Kim , Alexander Rush

Video text-based visual question answering (Video TextVQA) task aims to answer questions about videos by leveraging the visual text appearing within the videos. This task poses significant challenges, requiring models to accurately perceive…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Haibin He , Qihuang Zhong , Juhua Liu , Bo Du , Peng Wang , Jing Zhang

Deep neural networks have shown striking progress and obtained state-of-the-art results in many AI research fields in the recent years. However, it is often unsatisfying to not know why they predict what they do. In this paper, we address…

计算机视觉与模式识别 · 计算机科学 2016-09-12 Yash Goyal , Akrit Mohapatra , Devi Parikh , Dhruv Batra

Visual Question Answering (VQA) is the task of answering natural-language questions about images. We introduce the novel problem of determining the relevance of questions to images in VQA. Current VQA models do not reason about whether a…

计算机视觉与模式识别 · 计算机科学 2016-09-27 Arijit Ray , Gordon Christie , Mohit Bansal , Dhruv Batra , Devi Parikh

Video text-based visual question answering (Video TextVQA) is a practical task that aims to answer questions by jointly reasoning textual and visual information in a given video. Inspired by the development of TextVQA in image domain,…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Yan Zhang , Gangyan Zeng , Huawen Shen , Daiqing Wu , Yu Zhou , Can Ma

Visual Question Answering (VQA) methods have made incredible progress, but suffer from a failure to generalize. This is visible in the fact that they are vulnerable to learning coincidental correlations in the data rather than deeper…

计算机视觉与模式识别 · 计算机科学 2020-02-27 Xinyu Wang , Yuliang Liu , Chunhua Shen , Chun Chet Ng , Canjie Luo , Lianwen Jin , Chee Seng Chan , Anton van den Hengel , Liangwei Wang

How far can we go with textual representations for understanding pictures? In image understanding, it is essential to use concise but detailed image representations. Deep visual features extracted by vision models, such as Faster R-CNN, are…

计算机视觉与模式识别 · 计算机科学 2021-06-28 Yusuke Hirota , Noa Garcia , Mayu Otani , Chenhui Chu , Yuta Nakashima , Ittetsu Taniguchi , Takao Onoye

Visual Question Answering (VQA) is concerned with answering free-form questions about an image. Since it requires a deep semantic and linguistic understanding of the question and the ability to associate it with various objects that are…

计算机视觉与模式识别 · 计算机科学 2021-07-15 Rajat Koner , Hang Li , Marcel Hildebrandt , Deepan Das , Volker Tresp , Stephan Günnemann

Question answering (QA) systems are designed to answer natural language questions. Visual QA (VQA) and Spoken QA (SQA) systems extend the textual QA system to accept visual and spoken input respectively. This work aims to create a system…

音频与语音处理 · 电气工程与系统科学 2025-05-30 Nimrod Shabtay , Zvi Kons , Avihu Dekel , Hagai Aronowitz , Ron Hoory , Assaf Arbelle

Visual question answering (Visual QA) has attracted significant attention these years. While a variety of algorithms have been proposed, most of them are built upon different combinations of image and language features as well as…

计算机视觉与模式识别 · 计算机科学 2019-07-30 Cheng Zhang , Wei-Lun Chao , Dong Xuan

Visual Question Answering (VQA) is of tremendous interest to the research community with important applications such as aiding visually impaired users and image-based search. In this work, we explore the use of scene graphs for solving the…

计算机视觉与模式识别 · 计算机科学 2021-01-19 Vinay Damodaran , Sharanya Chakravarthy , Akshay Kumar , Anjana Umapathy , Teruko Mitamura , Yuta Nakashima , Noa Garcia , Chenhui Chu

The extraction of visual features is an essential step in Visual Question Answering (VQA). Building a good visual representation of the analyzed scene is indeed one of the essential keys for the system to be able to correctly understand the…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Hichem Boussaid , Lucrezia Tosato , Flora Weissgerber , Camille Kurtz , Laurent Wendling , Sylvain Lobry

In this work, we introduce VQA 360, a novel task of visual question answering on 360 images. Unlike a normal field-of-view image, a 360 image captures the entire visual content around the optical center of a camera, demanding more…

计算机视觉与模式识别 · 计算机科学 2020-01-13 Shih-Han Chou , Wei-Lun Chao , Wei-Sheng Lai , Min Sun , Ming-Hsuan Yang