English
Related papers

Related papers: A Survey on Visual Query Systems in the Web Era (e…

200 papers

The task of Outside Knowledge Visual Question Answering (OKVQA) requires an automatic system to answer natural language questions about pictures and images using external knowledge. We observe that many visual questions, which contain…

Artificial Intelligence · Computer Science 2022-02-10 Jiawen Zhang , Abhijit Mishra , Avinesh P. V. S , Siddharth Patwardhan , Sachin Agarwal

Visual Question Answering (VQA) has become an important benchmark for assessing how large multimodal models (LMMs) interpret images. However, most VQA datasets focus on real-world images or simple diagrammatic analysis, with few focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Jill P. Naiman , Daniel J. Evans , JooYoung Seo

Most recent state-of-the-art Visual Question Answering (VQA) systems are opaque black boxes that are only trained to fit the answer distribution given the question and visual content. As a result, these systems frequently take shortcuts,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Jialin Wu , Liyan Chen , Raymond J. Mooney

We introduce VEXUS, an interactive visualization framework for exploring user data to fulfill tasks such as finding a set of experts, forming discussion groups and analyzing collective behaviors. User data is characterized by a combination…

In visual question answering (VQA), an algorithm must answer text-based questions about images. While multiple datasets for VQA have been created since late 2014, they all have flaws in both their content and the way algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Kushal Kafle , Christopher Kanan

Free-form and open-ended Visual Question Answering systems solve the problem of providing an accurate natural language answer to a question pertaining to an image. Current VQA systems do not evaluate if the posed question is relevant to the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Prakruthi Prabhakar , Nitish Kulkarni , Linghao Zhang

Visual Question Answering (VQA) has attracted a lot of attention in both Computer Vision and Natural Language Processing communities, not least because it offers insight into the relationships between two important sources of information.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel , Anthony Dick

The increasingly rapid growth of data production and the consequent need to explore data to obtain answers to the most varied questions have promoted the development of tools to facilitate the manipulation and construction of data…

Human-Computer Interaction · Computer Science 2020-02-17 Raul de Araújo Lima , Simone Diniz Junqueira Barbosa

A typical problem in Visual Analytics is that users are highly trained experts in their application domains, but have mostly no experience in using VA systems. Thus, users often have difficulties interpreting and working with visual…

Human-Computer Interaction · Computer Science 2023-08-21 Christina Stoiber , Davide Ceneda , Markus Wagner , Victor Schetinger , Theresia Gschwandtner , Marc Streit , Silvia Miksch , Wolfgang Aigner

Visual Query Answering (VQA) is of great significance in offering people convenience: one can raise a question for details of objects, or high-level understanding about the scene, over an image. This paper proposes a novel method to address…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Peixi Xiong , Huayi Zhan , Xin Wang , Baivab Sinha , Ying Wu

In this paper we present an overview of several visualization techniques to support the search process in Digital Libraries (DLs). The search process typically can be separated into three major phases: query formulation and refinement,…

Digital Libraries · Computer Science 2013-04-16 Wilko van Hoek , Philipp Mayr

Visual question answering (VQA) is a Multidisciplinary research problem that pursued through practices of natural language processing and computer vision. Visual question answering automatically answers natural language questions according…

Computer Vision and Pattern Recognition · Computer Science 2024-09-01 Param Ahir , Hiteishi Diwanji

With increasing amounts of visual data being created in the form of videos and images, visual data selection and summarization are becoming ever increasing problems. We present Vis-DSS, an open-source toolkit for Visual Data Selection and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-25 Rishabh Iyer , Pratik Dubal , Kunal Dargan , Suraj Kothawade , Rohan Mahadev , Vishal Kaushal

Knowing how to construct text-based Search Queries (SQs) for use in Search Engines (SEs) such as Google or Wikipedia has become a fundamental skill. Though much data are available through such SEs, most structured datasets live outside…

Human-Computer Interaction · Computer Science 2022-08-03 Leonardo Christino , Martha D. Ferreira , Fernando V. Paulovich

The multimodal task of Visual Question Answering (VQA) encompassing elements of Computer Vision (CV) and Natural Language Processing (NLP), aims to generate answers to questions on any visual input. Over time, the scope of VQA has expanded…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Md Farhan Ishmam , Md Sakib Hossain Shovon , M. F. Mridha , Nilanjan Dey

In visual question answering (VQA) context, users often pose ambiguous questions to visual language models (VLMs) due to varying expression habits. Existing research addresses such ambiguities primarily by rephrasing questions. These…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Pu Jian , Donglei Yu , Wen Yang , Shuo Ren , Jiajun Zhang

We propose Encyclopedic-VQA, a large scale visual question answering (VQA) dataset featuring visual questions about detailed properties of fine-grained categories and instances. It contains 221k unique question+answer pairs each matched…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Thomas Mensink , Jasper Uijlings , Lluis Castrejon , Arushi Goel , Felipe Cadar , Howard Zhou , Fei Sha , André Araujo , Vittorio Ferrari

Deep neural networks have shown striking progress and obtained state-of-the-art results in many AI research fields in the recent years. However, it is often unsatisfying to not know why they predict what they do. In this paper, we address…

Computer Vision and Pattern Recognition · Computer Science 2016-09-12 Yash Goyal , Akrit Mohapatra , Devi Parikh , Dhruv Batra

Data quality assessment process is essential to ensure reliable analytical outcomes. This process depends on human supervision-driven approaches since it is impossible to determine a defect based only on data. Visualization systems belong…

Databases · Computer Science 2018-09-27 João Marcelo Borovina Josko , João Eduardo Ferreira

Chart question answering (CQA) is a crucial area of Visual Language Understanding. However, the robustness and consistency of current Visual Language Models (VLMs) in this field remain under-explored. This paper evaluates state-of-the-art…

Computation and Language · Computer Science 2024-10-07 Srija Mukhopadhyay , Adnan Qidwai , Aparna Garimella , Pritika Ramu , Vivek Gupta , Dan Roth