English
Related papers

Related papers: Image-Question-Answer Synergistic Network for Visu…

200 papers

In this paper, we propose to employ the convolutional neural network (CNN) for the image question answering (QA). Our proposed CNN provides an end-to-end framework with convolutional architectures for learning not only the image and…

Computation and Language · Computer Science 2015-11-16 Lin Ma , Zhengdong Lu , Hang Li

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…

Visual dialog (VisDial) is a task of answering a sequence of questions grounded in an image, using the dialog history as context. Prior work has trained the dialog agents solely on VisDial data via supervised learning or leveraged…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Gi-Cheon Kang , Sungdong Kim , Jin-Hwa Kim , Donghyun Kwak , Byoung-Tak Zhang

Conversational interfaces that allow for intuitive and comprehensive access to digitally stored information remain an ambitious goal. In this thesis, we lay foundations for designing conversational search systems by analyzing the…

Information Retrieval · Computer Science 2019-12-17 Svitlana Vakulenko

This work aims to address the problem of image-based question-answering (QA) with new models and datasets. In our work, we propose to use neural networks and visual semantic embeddings, without intermediate stages such as object detection…

Machine Learning · Computer Science 2015-12-01 Mengye Ren , Ryan Kiros , Richard Zemel

Reasoning-based approaches have demonstrated their powerful ability for the task of image-text matching. In this work, two issues are addressed for image-text matching. First, for reasoning processing, conventional approaches have no…

Multimedia · Computer Science 2022-03-11 Ran Chen , Hanli Wang , Lei Wang , Sam Kwong

The intelligent dialogue system, aiming at communicating with humans harmoniously with natural language, is brilliant for promoting the advancement of human-machine interaction in the era of artificial intelligence. With the gradually…

Artificial Intelligence · Computer Science 2022-07-05 Hao Wang , Bin Guo , Yating Zeng , Yasan Ding , Chen Qiu , Ying Zhang , Lina Yao , Zhiwen Yu

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented…

Computation and Language · Computer Science 2018-11-29 Junki Ohmura , Maxine Eskenazi

Understanding and conversing about dynamic scenes is one of the key capabilities of AI agents that navigate the environment and convey useful information to humans. Video question answering is a specific scenario of such AI-human…

Computation and Language · Computer Science 2019-08-01 Guan-Lin Chao , Abhinav Rastogi , Semih Yavuz , Dilek Hakkani-Tür , Jindong Chen , Ian Lane

Chats emerge as an effective user-friendly approach for information retrieval, and are successfully employed in many domains, such as customer service, healthcare, and finance. However, existing image retrieval approaches typically address…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Matan Levy , Rami Ben-Ari , Nir Darshan , Dani Lischinski

Visual-semantic embedding is an interesting research topic because it is useful for various tasks, such as visual question answering (VQA), image-text retrieval, image captioning, and scene graph generation. In this paper, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Kazuya Ueki

Despite end-to-end neural systems making significant progress in the last decade for task-oriented as well as chit-chat based dialogue systems, most dialogue systems rely on hybrid approaches which use a combination of rule-based, retrieval…

Computation and Language · Computer Science 2021-05-07 Ashish Shrivastava , Kaustubh Dhole , Abhinav Bhatt , Sharvani Raghunath

As a technically challenging topic, visual storytelling aims at generating an imaginary and coherent story with narrative multi-sentences from a group of relevant images. Existing methods often generate direct and rigid descriptions of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Tengpeng Li , Hanli Wang , Bin He , Chang Wen Chen

This paper focuses on answering fill-in-the-blank style multiple choice questions from the Visual Madlibs dataset. Previous approaches to Visual Question Answering (VQA) have mainly used generic image features from networks trained on the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-12 Tatiana Tommasi , Arun Mallya , Bryan Plummer , Svetlana Lazebnik , Alexander C. Berg , Tamara L. Berg

Despite the promising progress of recent autoregressive models in text-to-image (T2I) generation, their ability to handle multi-attribute and ambiguous prompts remains limited. To address these limitations, existing works have applied…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Yaqi Li , Peng Chen , Mingyang Han , Pi Bu , Haoxiang Shi , Runzhou Zhao , Yang Yao , Xuan Zhang , Jun Song , Bo Zheng

Visual Question Answering (VQA) is a multi-modal task that involves answering questions from an input image, semantically understanding the contents of the image and answering it in natural language. Using VQA for disaster management is an…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Aditya Kane , V Manushree , Sahil Khose

Current work on Visual Question Answering (VQA) explore deterministic approaches conditioned on various types of image and question features. We posit that, in addition to image and question pairs, other modalities are useful for teaching…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Zixu Wang , Yishu Miao , Lucia Specia

Visual question answering (VQA) usesimage processing algorithms to process the image and natural language processing methods to understand and answer the question. VQA is helpful to a visually impaired person, can be used for the security…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Param Ahir , Hiteishi M. Diwanji

This paper presents a state-of-the-art model for visual question answering (VQA), which won the first place in the 2017 VQA Challenge. VQA is a task of significant importance for research in artificial intelligence, given its multimodal…

Computer Vision and Pattern Recognition · Computer Science 2017-08-10 Damien Teney , Peter Anderson , Xiaodong He , Anton van den Hengel

With the proliferation of the e-commerce industry, analyzing customer feedback is becoming indispensable to a service provider. In recent days, it can be noticed that customers upload the purchased product images with their review scores.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Chandranath Adak , Soumi Chattopadhyay , Muhammad Saqib