English
Related papers

Related papers: IQA: Visual Question Answering in Interactive Envi…

200 papers

Recent years have witnessed an increasing interest in image-based question-answering (QA) tasks. However, due to data limitations, there has been much less work on video-based QA. In this paper, we present TVQA, a large-scale video QA…

Computation and Language · Computer Science 2019-05-09 Jie Lei , Licheng Yu , Mohit Bansal , Tamara L. Berg

Visual question answering (VQA) has recently been introduced to remote sensing to make information extraction from overhead imagery more accessible to everyone. VQA considers a question (in natural language, therefore easy to formulate)…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Christel Chappuis , Sylvain Lobry , Benjamin Kellenberger , Bertrand Le Saux , Devis Tuia

Over the last twenty years, significant progress has been made in designing and implementing Question Answering (QA) systems. However, addressing complex questions, the answers to which are spread across multiple documents, remains a…

Computation and Language · Computer Science 2026-02-26 Sourav Saha , Dwaipayan Roy , Mandar Mitra

Learning-based image quality assessment (IQA) has made remarkable progress in the past decade, but nearly all consider the two key components -- model and data -- in isolation. Specifically, model-centric IQA focuses on developing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Peibei Cao , Dingquan Li , Kede Ma

Visual Question Answering (VQA) is the task of taking as input an image and a free-form natural language question about the image, and producing an accurate answer. In this work we view VQA as a "feature extraction" module to extract image…

Computer Vision and Pattern Recognition · Computer Science 2016-09-02 Xiao Lin , Devi Parikh

Visual question answering (VQA) is challenging not only because the model has to handle multi-modal information, but also because it is just so hard to collect sufficient training examples -- there are too many questions one can ask about…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Jihyung Kil , Cheng Zhang , Dong Xuan , Wei-Lun Chao

A key limitation in current datasets for multi-hop reasoning is that the required steps for answering the question are mentioned in it explicitly. In this work, we introduce StrategyQA, a question answering (QA) benchmark where the required…

Computation and Language · Computer Science 2021-01-08 Mor Geva , Daniel Khashabi , Elad Segal , Tushar Khot , Dan Roth , Jonathan Berant

Embodied Question Answering (EQA) has primarily focused on indoor environments, leaving the complexities of urban settings-spanning environment, action, and perception-largely unexplored. To bridge this gap, we introduce CityEQA, a new task…

Artificial Intelligence · Computer Science 2025-05-23 Yong Zhao , Kai Xu , Zhengqiu Zhu , Yue Hu , Zhiheng Zheng , Yingfeng Chen , Yatai Ji , Chen Gao , Yong Li , Jincai Huang

Visual Question Answering (VQA) is concerned with answering free-form questions about an image. Since it requires a deep semantic and linguistic understanding of the question and the ability to associate it with various objects that are…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Rajat Koner , Hang Li , Marcel Hildebrandt , Deepan Das , Volker Tresp , Stephan Günnemann

Continual Learning in Visual Question Answering (VQACL) requires models to acquire new visual-linguistic skills (plasticity) while preserving previously learned knowledge (stability). The inherent multimodality of VQACL exacerbates this…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Imad Eddine Marouf , Enzo Tartaglione , Stephane Lathuiliere , Joost van de Weijer

Existing Embodied Question Answering (EQA) benchmarks primarily focus on household environments, often overlooking safety-critical aspects and reasoning processes pertinent to industrial settings. This drawback limits the evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yifan Li , Yuhang Chen , Anh Dao , Lichi Li , Zhongyi Cai , Zhen Tan , Tianlong Chen , Yu Kong

Recently, the Visual Question Answering (VQA) task has gained increasing attention in artificial intelligence. Existing VQA methods mainly adopt the visual attention mechanism to associate the input question with corresponding image regions…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Pan Lu , Hongsheng Li , Wei Zhang , Jianyong Wang , Xiaogang Wang

Technology and the fruition of cultural heritage are becoming increasingly more entwined, especially with the advent of smart audio guides, virtual and augmented reality, and interactive installations. Machine learning and computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-12-30 Pietro Bongini , Federico Becattini , Andrew D. Bagdanov , Alberto Del Bimbo

Recent advances in multimodal question answering have primarily focused on combining heterogeneous modalities or fine-tuning multimodal large language models. While these approaches have shown strong performance, they often rely on a…

Computation and Language · Computer Science 2026-04-22 Krishna Singh Rajput , Tejas Anvekar , Chitta Baral , Vivek Gupta

Current Visual Question Answering (VQA) systems can answer intelligent questions about `Known' visual content. However, their performance drops significantly when questions about visually and linguistically `Unknown' concepts are presented…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Moshiur R Farazi , Salman H Khan , Nick Barnes

The field of visual question answering (VQA) has recently seen a surge in research focused on providing explanations for predicted answers. However, current systems mostly rely on separate models to predict answers and generate…

Computation and Language · Computer Science 2023-02-14 Chenxi Whitehouse , Tillman Weyde , Pranava Madhyastha

In this work, we introduce VQA 360, a novel task of visual question answering on 360 images. Unlike a normal field-of-view image, a 360 image captures the entire visual content around the optical center of a camera, demanding more…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Shih-Han Chou , Wei-Lun Chao , Wei-Sheng Lai , Min Sun , Ming-Hsuan Yang

Image quality assessment (IQA) is very important for both end-users and service providers since a high-quality image can significantly improve the user's quality of experience (QoE) and also benefit lots of computer vision algorithms. Most…

Multimedia · Computer Science 2023-04-28 Wei Sun , Xiongkuo Min , Danyang Tu , Guangtao Zhai , Siwei Ma

The complex compositional structure of language makes problems at the intersection of vision and language challenging. But language also provides a strong prior that can result in good superficial performance, without the underlying models…

Computation and Language · Computer Science 2016-04-20 Peng Zhang , Yash Goyal , Douglas Summers-Stay , Dhruv Batra , Devi Parikh

Having an intelligent dialogue agent that can engage in conversational question answering (ConvQA) is now no longer limited to Sci-Fi movies only and has, in fact, turned into a reality. These intelligent agents are required to understand…

Computation and Language · Computer Science 2023-04-17 Munazza Zaib , Quan Z. Sheng , Wei Emma Zhang , Adnan Mahmood