English
Related papers

Related papers: AGIC: Attention-Guided Image Captioning to Improve…

200 papers

Existing approaches to image captioning usually generate the sentence word-by-word from left to right, with the constraint of conditioned on local context including the given image and history generated words. There have been many studies…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Zhengcong Fei , Junshi Huang , Xiaoming Wei , Xiaolin Wei

Automatically generating a human-like description for a given image is a potential research in artificial intelligence, which has attracted a great of attention recently. Most of the existing attention methods explore the mapping…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Feicheng Huang , Zhixin Li , Haiyang Wei , Canlong Zhang , Huifang Ma

Contextualized Image Captioning (CIC) evolves traditional image captioning into a more complex domain, necessitating the ability for multimodal reasoning. It aims to generate image captions given specific contextual information. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Shunqi Mao , Chaoyi Zhang , Hang Su , Hwanjun Song , Igor Shalyminov , Weidong Cai

Image captioning is a significant field across computer vision and natural language processing. We propose and present AIC-AB NET, a novel Attribute-Information-Combined Attention-Based Network that combines spatial attention architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Guoyun Tu , Ying Liu , Vladimir Vlassov

Image captioning is a challenging computer vision task, which aims to generate a natural language description of an image. Most recent researches follow the encoder-decoder framework which depends heavily on the previous generated words for…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Zeliang Song , Xiaofei Zhou , Zhendong Mao , Jianlong Tan

Attention mechanisms have attracted considerable interest in image captioning because of its powerful performance. Existing attention-based models use feedback information from the caption generator as guidance to determine which of the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Zhihao Zhu , Zhan Xue , Zejian Yuan

Image captioning has made substantial progress with huge supporting image collections sourced from the web. However, recent studies have pointed out that captioning datasets, such as COCO, contain gender bias found in web corpora. As a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Ruixiang Tang , Mengnan Du , Yuening Li , Zirui Liu , Na Zou , Xia Hu

Image captioning is a multimodal problem that has drawn extensive attention in both the natural language processing and computer vision community. In this paper, we present a novel image captioning architecture to better explore semantics…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Zhan Shi , Xu Zhou , Xipeng Qiu , Xiaodan Zhu

Image captioning has been recently gaining a lot of attention thanks to the impressive achievements shown by deep captioning architectures, which combine Convolutional Neural Networks to extract image representations, and Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

Aesthetic image captioning (AIC) refers to the multi-modal task of generating critical textual feedbacks for photographs. While in natural image captioning (NIC), deep models are trained in an end-to-end manner using large curated datasets…

Computer Vision and Pattern Recognition · Computer Science 2019-08-30 Koustav Ghosal , Aakanksha Rana , Aljosa Smolic

Image captioning systems have recently improved dramatically, but they still tend to produce captions that are insensitive to the communicative goals that captions should meet. To address this, we propose Issue-Sensitive Image Captioning…

Computation and Language · Computer Science 2020-10-07 Allen Nie , Reuben Cohn-Gordon , Christopher Potts

Recent progress on automatic generation of image captions has shown that it is possible to describe the most salient information conveyed by images with accurate and meaningful sentences. In this paper, we propose an image caption system…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Junqi Jin , Kun Fu , Runpeng Cui , Fei Sha , Changshui Zhang

Pretrained visual-language models have demonstrated impressive zero-shot abilities in image captioning, when accompanied by hand-crafted prompts. Meanwhile, hand-crafted prompts utilize human prior knowledge to guide the model. However, due…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Hongchen Wei , Zhenzhong Chen

State-of-the-art approaches for image captioning require supervised training data consisting of captions with paired image data. These methods are typically unable to use unsupervised data such as textual data with no corresponding images,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Wenhu Chen , Aurelien Lucchi , Thomas Hofmann

Current state-of-the-art approaches for image captioning typically adopt an autoregressive manner, i.e., generating descriptions word by word, which suffers from slow decoding issue and becomes a bottleneck in real-time applications.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Xu Yan , Zhengcong Fei , Zekang Li , Shuhui Wang , Qingming Huang , Qi Tian

Automatically generating a natural language description of an image has attracted interests recently both because of its importance in practical applications and because it connects two major artificial intelligence fields: computer vision…

Computer Vision and Pattern Recognition · Computer Science 2016-03-15 Quanzeng You , Hailin Jin , Zhaowen Wang , Chen Fang , Jiebo Luo

The use of attention models for automated image captioning has enabled many systems to produce accurate and meaningful descriptions for images. Over the years, many novel approaches have been proposed to enhance the attention process using…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Murad Popattia , Muhammad Rafi , Rizwan Qureshi , Shah Nawaz

Visual attention plays an important role to understand images and demonstrates its effectiveness in generating natural language descriptions of images. On the other hand, recent studies show that language associated with an image can steer…

Computer Vision and Pattern Recognition · Computer Science 2016-12-13 Jonghwan Mun , Minsu Cho , Bohyung Han

Automatic image captioning is a promising technique for conveying visual information using natural language. It can benefit various tasks in satellite remote sensing, such as environmental monitoring, resource management, disaster…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Yingxu He , Qiqi Sun

Recent neural models for image captioning usually employ an encoder-decoder framework with an attention mechanism. However, the attention mechanism in such a framework aligns one single (attended) image feature vector to one caption word,…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Lun Huang , Wenmin Wang , Yaxian Xia , Jie Chen
‹ Prev 1 2 3 10 Next ›