中文
相关论文

相关论文: Language Models for Image Captioning: The Quirks a…

200 篇论文

Automated image captioning is one of the applications of Deep Learning which involves fusion of work done in computer vision and natural language processing, and it is typically performed using Encoder-Decoder architectures. In this…

计算机视觉与模式识别 · 计算机科学 2021-05-25 Aditya Bhattacharya , Eshwar Shamanna Girishekar , Padmakar Anil Deshpande

Image captioning is a research hotspot where encoder-decoder models combining convolutional neural network (CNN) and long short-term memory (LSTM) achieve promising results. Despite significant progress, these models generate sentences…

计算机视觉与模式识别 · 计算机科学 2019-10-16 Hongwei Ge , Zehang Yan , Kai Zhang , Mingde Zhao , Liang Sun

Aided by recent advances in Deep Learning, Image Caption Generation has seen tremendous progress over the last few years. Most methods use transfer learning to extract visual information, in the form of image features, with the help of…

计算机视觉与模式识别 · 计算机科学 2021-02-24 Sulabh Katiyar , Samir Kumar Borgohain

Automatic image captioning, a multifaceted task bridging computer vision and natural language processing, aims to generate descriptive textual content from visual input. While Convolutional Neural Networks (CNNs) and Long Short-Term Memory…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Amanuel Tafese Dufera

State-of-the-art image captioning methods mostly focus on improving visual features, less attention has been paid to utilizing the inherent properties of language to boost captioning performance. In this paper, we show that vocabulary…

计算机视觉与模式识别 · 计算机科学 2019-09-02 Lei Ke , Wenjie Pei , Ruiyu Li , Xiaoyong Shen , Yu-Wing Tai

Automatically describing the content of an image is a fundamental problem in artificial intelligence that connects computer vision and natural language processing. In this paper, we present a generative model based on a deep recurrent…

计算机视觉与模式识别 · 计算机科学 2015-04-22 Oriol Vinyals , Alexander Toshev , Samy Bengio , Dumitru Erhan

Image captioning, an open research issue, has been evolved with the progress of deep neural networks. Convolutional neural networks (CNNs) and recurrent neural networks (RNNs) are employed to compute image features and generate natural…

计算机视觉与模式识别 · 计算机科学 2018-07-26 Boeun Kim , Young Han Lee , Hyedong Jung , Choongsang Cho

This paper presents a novel approach for automatically generating image descriptions: visual detectors, language models, and multimodal similarity models learnt directly from a dataset of image captions. We use multiple instance learning to…

In this paper, we propose multimodal convolutional neural networks (m-CNNs) for matching image and sentence. Our m-CNN provides an end-to-end framework with convolutional architectures to exploit image representation, word composition, and…

计算机视觉与模式识别 · 计算机科学 2015-09-01 Lin Ma , Zhengdong Lu , Lifeng Shang , Hang Li

We examine the possibility that recent promising results in automatic caption generation are due primarily to language models. By varying image representation quality produced by a convolutional neural network, we find that a…

计算与语言 · 计算机科学 2015-08-11 Jack Hessel , Nicolas Savva , Michael J. Wilber

In today's world, image processing plays a crucial role across various fields, from scientific research to industrial applications. But one particularly exciting application is image captioning. The potential impact of effective image…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Md Alif Rahman Ridoy , M Mahmud Hasan , Shovon Bhowmick

In image captioning where fluency is an important factor in evaluation, e.g., $n$-gram metrics, sequential models are commonly used; however, sequential models generally result in overgeneralized expressions that lack the details that may…

计算机视觉与模式识别 · 计算机科学 2020-07-14 Junjiao Tian , Jean Oh

Image captioning is a fast-growing research field of computer vision and natural language processing that involves creating text explanations for images. This study aims to develop a system that uses a pre-trained convolutional neural…

计算与语言 · 计算机科学 2022-03-04 Rashid Khan , M Shujah Islam , Khadija Kanwal , Mansoor Iqbal , Md. Imran Hossain , Zhongfu Ye

With great advances in vision and natural language processing, the generation of image captions becomes a need. In a recent paper, Mathews, Xie and He [1], extended a new model to generate styled captions by separating semantics and style.…

计算机视觉与模式识别 · 计算机科学 2022-02-03 Marzieh Heidari , Mehdi Ghatee , Ahmad Nickabadi , Arash Pourhasan Nezhad

Image captioning is the task of automatically generating sentences that describe an input image in the best way possible. The most successful techniques for automatically generating image captions have recently used attentive deep learning…

计算机视觉与模式识别 · 计算机科学 2021-12-01 Zanyar Zohourianshahzadi , Jugal K. Kalita

Image Captioning is a task that combines computer vision and natural language processing, where it aims to generate descriptive legends for images. It is a two-fold process relying on accurate image understanding and correct language…

计算机视觉与模式识别 · 计算机科学 2021-07-29 Ahmed Elhagry , Karima Kadaoui

Image captioning involves generating textual descriptions from input images, bridging the gap between computer vision and natural language processing. Recent advancements in transformer-based models have significantly improved caption…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Israa A. Albadarneh , Bassam H. Hammo , Omar S. Al-Kadi

Deep neural networks have achieved great successes on the image captioning task. However, most of the existing models depend heavily on paired image-sentence datasets, which are very expensive to acquire. In this paper, we make the first…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Yang Feng , Lin Ma , Wei Liu , Jiebo Luo

In this paper we explore the bi-directional mapping between images and their sentence-based descriptions. We propose learning this mapping using a recurrent neural network. Unlike previous approaches that map both sentences and images to a…

计算机视觉与模式识别 · 计算机科学 2014-11-21 Xinlei Chen , C. Lawrence Zitnick

Image captioning is a technology that produces text-based descriptions for an image. Deep learning-based solutions built on top of feature recognition may very well serve the purpose. But as with any other machine learning solution, the…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Rishi Kesav Mohan , Sanjay Sureshkumar , Vignesh Sivasubramaniam