English
Related papers

Related papers: AIC-AB NET: A Neural Network for Image Captioning …

200 papers

Recently, attention based models have been used extensively in many sequence-to-sequence learning systems. Especially for image captioning, the attention based models are expected to ground correct image regions with proper generated words.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Fenglin Liu , Xuancheng Ren , Xian Wu , Wei Fan , Yuexian Zou , Xu Sun

There is amazing progress in Deep Learning based models for Image captioning and Low Light image enhancement. For the first time in literature, this paper develops a Deep Learning model that translates night scenes to sentences, opening new…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Rajagopal A , Nirmala V , Arun Muthuraj Vedamanickam

Gaze reflects how humans process visual scenes and is therefore increasingly used in computer vision systems. Previous works demonstrated the potential of gaze for object-centric tasks, such as object localization and recognition, but it…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Yusuke Sugano , Andreas Bulling

Recent progress on automatic generation of image captions has shown that it is possible to describe the most salient information conveyed by images with accurate and meaningful sentences. In this paper, we propose an image caption system…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Junqi Jin , Kun Fu , Runpeng Cui , Fei Sha , Changshui Zhang

Attention-based neural encoder-decoder frameworks have been widely used for image captioning. Many of these frameworks deploy their full focus on generating the caption from scratch by relying solely on the image features or the object…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Fawaz Sammani , Mahmoud Elsayed

Image captioning models have lately shown impressive results when applied to standard datasets. Switching to real-life scenarios, however, constitutes a challenge due to the larger variety of visual concepts which are not covered in…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Marco Cagrandi , Marcella Cornia , Matteo Stefanini , Lorenzo Baraldi , Rita Cucchiara

Automatically generating the descriptions of an image, i.e., image captioning, is an important and fundamental topic in artificial intelligence, which bridges the gap between computer vision and natural language processing. Based on the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Shiyang Yan , Yuan Xie , Fangyu Wu , Jeremy S. Smith , Wenjin Lu , Bailing Zhang

Recently, deep convolutional neural network (CNN) have been widely used in image restoration and obtained great success. However, most of existing methods are limited to local receptive field and equal treatment of different types of…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Yucheng Hang , Qingmin Liao , Wenming Yang , Yupeng Chen , Jie Zhou

Image captioning is a challenging computer vision task, which aims to generate a natural language description of an image. Most recent researches follow the encoder-decoder framework which depends heavily on the previous generated words for…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Zeliang Song , Xiaofei Zhou , Zhendong Mao , Jianlong Tan

The aim of image captioning is to generate textual description of a given image. Though seemingly an easy task for humans, it is challenging for machines as it requires the ability to comprehend the image (computer vision) and consequently…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Anubhav Shrimal , Tanmoy Chakraborty

In today's world, image processing plays a crucial role across various fields, from scientific research to industrial applications. But one particularly exciting application is image captioning. The potential impact of effective image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Md Alif Rahman Ridoy , M Mahmud Hasan , Shovon Bhowmick

Along with the prosperity of recurrent neural network in modelling sequential data and the power of attention mechanism in automatically identify salient information, image captioning, a.k.a., image description, has been remarkably advanced…

Computer Vision and Pattern Recognition · Computer Science 2016-12-16 Hao Liu , Yang Yang , Fumin Shen , Lixin Duan , Heng Tao Shen

Image aesthetic quality assessment has been a relatively hot topic during the last decade. Most recently, comments type assessment (aesthetic captions) has been proposed to describe the general aesthetic impression of an image using text.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Xin Jin , Le Wu , Geng Zhao , Xiaodong Li , Xiaokun Zhang , Shiming Ge , Dongqing Zou , Bin Zhou , Xinghui Zhou

Recent works attempt to improve scene parsing performance by exploring different levels of contexts, and typically train a well-designed convolutional network to exploit useful contexts across all pixels equally. However, in this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-11-06 Jun Fu , Jing Liu , Yuhang Wang , Yong Li , Yongjun Bao , Jinhui Tang , Hanqing Lu

Image captioning has attracted ever-increasing research attention in the multimedia community. To this end, most cutting-edge works rely on an encoder-decoder framework with attention mechanisms, which have achieved remarkable progress.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Chen Shen , Rongrong Ji , Fuhai Chen , Xiaoshuai Sun , Xiangming Li

Attention mechanisms have recently been introduced in deep learning for various tasks in natural language processing and computer vision. But despite their popularity, the "correctness" of the implicitly-learned attention maps has only been…

Computer Vision and Pattern Recognition · Computer Science 2016-11-24 Chenxi Liu , Junhua Mao , Fei Sha , Alan Yuille

Image captioning is the process of automatically generating a description of an image in natural language. Image captioning is one of the significant challenges in image understanding since it requires not only recognizing salient objects…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Ghadah Alabduljabbar , Hafida Benhidour , Said Kerrache

State-of-the-art approaches for image captioning require supervised training data consisting of captions with paired image data. These methods are typically unable to use unsupervised data such as textual data with no corresponding images,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Wenhu Chen , Aurelien Lucchi , Thomas Hofmann

Many top-performing image captioning models rely solely on object features computed with an object detection model to generate image descriptions. However, recent studies propose to directly use scene graphs to introduce information about…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Victor Milewski , Marie-Francine Moens , Iacer Calixto

Image captioning has attracted considerable attention in recent years. However, little work has been done for game image captioning which has some unique characteristics and requirements. In this work we propose a novel game image…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Jian Zheng , Sudha Krishnamurthy , Ruxin Chen , Min-Hung Chen , Zhenhao Ge , Xiaohua Li