中文
相关论文

相关论文: Enhancing Visual Question Answering through Questi…

200 篇论文

Compared with Large Language Models (LLMs), Large Vision-Language Models (LVLMs) can also accept images as input, thus showcasing more interesting emergent capabilities and demonstrating impressive performance on various vision-language…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Runpeng Yu , Weihao Yu , Xinchao Wang

Visual Question Answering (VQA) has attracted a lot of attention in both Computer Vision and Natural Language Processing communities, not least because it offers insight into the relationships between two important sources of information.…

计算机视觉与模式识别 · 计算机科学 2017-08-09 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel , Anthony Dick

Current visual question answering (VQA) models tend to be trained and evaluated on image-question pairs in isolation. However, the questions people ask are dependent on their informational needs and prior knowledge about the image content.…

计算与语言 · 计算机科学 2024-10-07 Nandita Shankar Naik , Christopher Potts , Elisa Kreiss

Visual Question Answering (VQA) requires integration of feature maps with drastically different structures and focus of the correct regions. Image descriptors have structures at multiple spatial scales, while lexical inputs inherently…

计算机视觉与模式识别 · 计算机科学 2018-07-20 Yang Shi , Tommaso Furlanello , Sheng Zha , Animashree Anandkumar

Visual Question and Answering (VQA) problems are attracting increasing interest from multiple research disciplines. Solving VQA problems requires techniques from both computer vision for understanding the visual contents of a presented…

计算机视觉与模式识别 · 计算机科学 2016-04-07 Ilija Ilievski , Shuicheng Yan , Jiashi Feng

A key solution to visual question answering (VQA) exists in how to fuse visual and language features extracted from an input image and question. We show that an attention mechanism that enables dense, bi-directional interactions between the…

计算机视觉与模式识别 · 计算机科学 2018-12-04 Duy-Kien Nguyen , Takayuki Okatani

Knowledge-based visual question answering (VQA) requires external knowledge beyond the image to answer the question. Early studies retrieve required knowledge from explicit knowledge bases (KBs), which often introduces irrelevant…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Zhou Yu , Xuecheng Ouyang , Zhenwei Shao , Meng Wang , Jun Yu

Aesthetic assessment of images can be categorized into two main forms: numerical assessment and language assessment. Aesthetics caption of photographs is the only task of aesthetic language assessment that has been addressed. In this paper,…

计算机视觉与模式识别 · 计算机科学 2022-08-12 Xin Jin , Wu Zhou , Xinghui Zhou , Shuai Cui , Le Zhang , Jianwen Lv , Shu Zhao

Visual question answering (VQA) has the potential to make the Internet more accessible in an interactive way, allowing people who cannot see images to ask questions about them. However, multiple studies have shown that people who are blind…

计算与语言 · 计算机科学 2023-08-31 Nandita Naik , Christopher Potts , Elisa Kreiss

Multimodal large language models (MLLMs) still struggle with complex reasoning tasks in Visual Question Answering (VQA). While current methods have advanced by incorporating visual prompts, our study uncovers critical limitations: these…

计算与语言 · 计算机科学 2025-06-03 Songtao Jiang , Chenyi Zhou , Yan Zhang , Yeying Jin , Zuozhu Liu

Generative vision-language models (VLMs) have shown impressive performance in zero-shot vision-language tasks like image captioning and visual question answering. However, improving their zero-shot reasoning typically requires second-stage…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Rongjie Li , Yu Wu , Xuming He

We have seen great progress in basic perceptual tasks such as object recognition and detection. However, AI models still fail to match humans in high-level vision tasks due to the lack of capacities for deeper reasoning. Recently the new…

计算机视觉与模式识别 · 计算机科学 2016-04-12 Yuke Zhu , Oliver Groth , Michael Bernstein , Li Fei-Fei

Visual Question Answering (VQA) is a challenging task that requires systems to provide accurate answers to questions based on image content. Current VQA models struggle with complex questions due to limitations in capturing and integrating…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Peiyuan Chen , Zecheng Zhang , Yiping Dong , Li Zhou , Han Wang

Visual question answering (VQA) is challenging because it requires a simultaneous understanding of both visual content of images and textual content of questions. To support the VQA task, we need to find good solutions for the following…

计算机视觉与模式识别 · 计算机科学 2019-05-17 Zhou Yu , Jun Yu , Chenchao Xiang , Jianping Fan , Dacheng Tao

This paper focuses on answering fill-in-the-blank style multiple choice questions from the Visual Madlibs dataset. Previous approaches to Visual Question Answering (VQA) have mainly used generic image features from networks trained on the…

计算机视觉与模式识别 · 计算机科学 2016-08-12 Tatiana Tommasi , Arun Mallya , Bryan Plummer , Svetlana Lazebnik , Alexander C. Berg , Tamara L. Berg

We tackle the challenge of Visual Question Answering in multi-image setting for the ISVQA dataset. Traditional VQA tasks have focused on a single-image setting where the target answer is generated from a single image. Image set VQA,…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Abhinav Khattar , Aviral Joshi , Har Simrat Singh , Pulkit Goel , Rohit Prakash Barnwal

Recent advancements in Video Question Answering (VideoQA) have introduced LLM-based agents, modular frameworks, and procedural solutions, yielding promising results. These systems use dynamic agents and memory-based mechanisms to break down…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Tony Montes , Fernando Lozano

Question answering (QA) systems are designed to answer natural language questions. Visual QA (VQA) and Spoken QA (SQA) systems extend the textual QA system to accept visual and spoken input respectively. This work aims to create a system…

音频与语音处理 · 电气工程与系统科学 2025-05-30 Nimrod Shabtay , Zvi Kons , Avihu Dekel , Hagai Aronowitz , Ron Hoory , Assaf Arbelle

Visual Question Answering (VQA) attracts much attention from both industry and academia. As a multi-modality task, it is challenging since it requires not only visual and textual understanding, but also the ability to align cross-modality…

计算机视觉与模式识别 · 计算机科学 2022-01-27 Peixi Xiong , Quanzeng You , Pei Yu , Zicheng Liu , Ying Wu

Visual Question Answering (VQA) is challenging due to the complex cross-modal relations. It has received extensive attention from the research community. From the human perspective, to answer a visual question, one needs to read the…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Hantao Huang , Tao Han , Wei Han , Deep Yap , Cheng-Ming Chiang