中文
相关论文

相关论文: Visual Question Answering (VQA) on Images with Sup…

200 篇论文

Visual Question Answering (VQA) is challenging due to the complex cross-modal relations. It has received extensive attention from the research community. From the human perspective, to answer a visual question, one needs to read the…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Hantao Huang , Tao Han , Wei Han , Deep Yap , Cheng-Ming Chiang

Question categorization and expert retrieval methods have been crucial for information organization and accessibility in community question & answering (CQA) platforms. Research in this area, however, has dealt with only the text modality.…

计算与语言 · 计算机科学 2019-05-28 Avikalp Srivastava , Hsin Wen Liu , Sumio Fujita

Part of the appeal of Visual Question Answering (VQA) is its promise to answer new questions about previously unseen images. Most current methods demand training questions that illustrate every possible concept, and will therefore never…

计算机视觉与模式识别 · 计算机科学 2016-11-22 Damien Teney , Anton van den Hengel

Current visual question answering (VQA) models tend to be trained and evaluated on image-question pairs in isolation. However, the questions people ask are dependent on their informational needs and prior knowledge about the image content.…

计算与语言 · 计算机科学 2024-10-07 Nandita Shankar Naik , Christopher Potts , Elisa Kreiss

The ideal form of Visual Question Answering requires understanding, grounding and reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most existing VQA benchmarks are…

计算机视觉与模式识别 · 计算机科学 2023-03-07 Kang Chen , Xiangqian Wu

Deep neural networks have shown striking progress and obtained state-of-the-art results in many AI research fields in the recent years. However, it is often unsatisfying to not know why they predict what they do. In this paper, we address…

计算机视觉与模式识别 · 计算机科学 2016-09-12 Yash Goyal , Akrit Mohapatra , Devi Parikh , Dhruv Batra

Visual question answering (VQA) usesimage processing algorithms to process the image and natural language processing methods to understand and answer the question. VQA is helpful to a visually impaired person, can be used for the security…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Param Ahir , Hiteishi M. Diwanji

Visual Question Answering (VQA) in its ideal form lets us study reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most VQA benchmarks to date are focused on questions…

计算机视觉与模式识别 · 计算机科学 2019-09-05 Kenneth Marino , Mohammad Rastegari , Ali Farhadi , Roozbeh Mottaghi

Transformer-based architectures have recently demonstrated remarkable performance in the Visual Question Answering (VQA) task. However, such models are likely to disregard crucial visual cues and often rely on multimodal shortcuts and…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Maria Parelli , Dimitrios Mallis , Markos Diomataris , Vassilis Pitsikalis

Visual Question Answering (VQA) is a complex semantic task requiring both natural language processing and visual recognition. In this paper, we explore whether VQA is solvable when images are captured in a sub-Nyquist compressive paradigm.…

计算机视觉与模式识别 · 计算机科学 2018-06-12 Li-Chi Huang , Kuldeep Kulkarni , Anik Jha , Suhas Lohit , Suren Jayasuriya , Pavan Turaga

The recent success of large language and vision models (LLVMs) on vision question answering (VQA), particularly their applications in medicine (Med-VQA), has shown a great potential of realizing effective visual assistants for healthcare.…

计算与语言 · 计算机科学 2024-04-04 Jinge Wu , Yunsoo Kim , Honghan Wu

Visual attention mechanisms are widely used in multimodal tasks, as visual question answering (VQA). One drawback of softmax-based attention mechanisms is that they assign some probability mass to all image regions, regardless of their…

计算与语言 · 计算机科学 2021-07-09 Pedro Henrique Martins , Vlad Niculae , Zita Marinho , André Martins

Visual question answering (VQA) task not only bridges the gap between images and language, but also requires that specific contents within the image are understood as indicated by linguistic context of the question, in order to generate the…

计算机视觉与模式识别 · 计算机科学 2017-05-05 Kuniaki Saito , Andrew Shin , Yoshitaka Ushiku , Tatsuya Harada

The complex compositional structure of language makes problems at the intersection of vision and language challenging. But language also provides a strong prior that can result in good superficial performance, without the underlying models…

计算与语言 · 计算机科学 2016-04-20 Peng Zhang , Yash Goyal , Douglas Summers-Stay , Dhruv Batra , Devi Parikh

Providing visual summaries of scientific publications can increase information access for readers and thereby help deal with the exponential growth in the number of scientific publications. Nonetheless, efforts in providing visual…

信息检索 · 计算机科学 2021-01-15 Shintaro Yamamoto , Anne Lauscher , Simone Paolo Ponzetto , Goran Glavaš , Shigeo Morishima

This paper presents a state-of-the-art model for visual question answering (VQA), which won the first place in the 2017 VQA Challenge. VQA is a task of significant importance for research in artificial intelligence, given its multimodal…

计算机视觉与模式识别 · 计算机科学 2017-08-10 Damien Teney , Peter Anderson , Xiaodong He , Anton van den Hengel

Visual Question Answering (VQA) has achieved great success thanks to the fast development of deep neural networks (DNN). On the other hand, the data augmentation, as one of the major tricks for DNN, has been widely used in many computer…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Ruixue Tang , Chao Ma , Wei Emma Zhang , Qi Wu , Xiaokang Yang

Recently, there has been an increasing interest in building question answering (QA) models that reason across multiple modalities, such as text and images. However, QA using images is often limited to just picking the answer from a…

In this paper, we make a simple observation that questions about images often contain premises - objects and relationships implied by the question - and that reasoning about premises can help Visual Question Answering (VQA) models respond…

计算机视觉与模式识别 · 计算机科学 2017-08-21 Aroma Mahendru , Viraj Prabhu , Akrit Mohapatra , Dhruv Batra , Stefan Lee

We have seen great progress in basic perceptual tasks such as object recognition and detection. However, AI models still fail to match humans in high-level vision tasks due to the lack of capacities for deeper reasoning. Recently the new…

计算机视觉与模式识别 · 计算机科学 2016-04-12 Yuke Zhu , Oliver Groth , Michael Bernstein , Li Fei-Fei