中文
相关论文

相关论文: Bornon: Bengali Image Captioning with Transformer-…

200 篇论文

Image captioning models typically follow an encoder-decoder architecture which uses abstract image feature vectors as input to the encoder. One of the most successful algorithms uses feature vectors extracted from the region proposals…

计算机视觉与模式识别 · 计算机科学 2020-01-14 Simao Herdade , Armin Kappeler , Kofi Boakye , Joao Soares

In this work we formulate the problem of image captioning as a multimodal translation task. Analogous to machine translation, we present a sequence-to-sequence recurrent neural networks (RNN) model for image caption generation. Different…

计算机视觉与模式识别 · 计算机科学 2017-08-11 Chang Liu , Fuchun Sun , Changhu Wang , Feng Wang , Alan Yuille

Automatic captioning of images is a task that combines the challenges of image analysis and text generation. One important aspect in captioning is the notion of attention: How to decide what to describe and in which order. Inspired by the…

计算机视觉与模式识别 · 计算机科学 2020-10-06 Sen He , Wentong Liao , Hamed R. Tavakoli , Michael Yang , Bodo Rosenhahn , Nicolas Pugeault

The recent advances of deep learning in both computer vision (CV) and natural language processing (NLP) provide us a new way of understanding semantics, by which we can deal with more challenging tasks such as automatic description…

计算机视觉与模式识别 · 计算机科学 2019-02-12 Daouda Sow , Zengchang Qin , Mouhamed Niasse , Tao Wan

Image captioning involves generating textual descriptions from input images, bridging the gap between computer vision and natural language processing. Recent advancements in transformer-based models have significantly improved caption…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Israa A. Albadarneh , Bassam H. Hammo , Omar S. Al-Kadi

Image captioning is a challenging task that combines the field of computer vision and natural language processing. A variety of approaches have been proposed to achieve the goal of automatically describing an image, and recurrent neural…

计算机视觉与模式识别 · 计算机科学 2018-05-24 Qingzhong Wang , Antoni B. Chan

A novel variational autoencoder is developed to model images, as well as associated labels or captions. The Deep Generative Deconvolutional Network (DGDN) is used as a decoder of the latent image features, and a deep Convolutional Neural…

机器学习 · 统计学 2016-09-29 Yunchen Pu , Zhe Gan , Ricardo Henao , Xin Yuan , Chunyuan Li , Andrew Stevens , Lawrence Carin

Image captioning by the encoder-decoder framework has shown tremendous advancement in the last decade where CNN is mainly used as encoder and LSTM is used as a decoder. Despite such an impressive achievement in terms of accuracy in simple…

计算机视觉与模式识别 · 计算机科学 2023-01-09 Rana Adnan Ahmad , Muhammad Azhar , Hina Sattar

Automatic image captioning, a multifaceted task bridging computer vision and natural language processing, aims to generate descriptive textual content from visual input. While Convolutional Neural Networks (CNNs) and Long Short-Term Memory…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Amanuel Tafese Dufera

Extracting context from visual representations is of utmost importance in the advancement of Computer Science. Representation of such a format in Natural Language has a huge variety of applications such as helping the visually impaired etc.…

计算机视觉与模式识别 · 计算机科学 2020-02-25 Madhavan Seshadri , Malavika Srikanth , Mikhail Belov

Image captioning is a challenging task involving generating a textual description for an image using computer vision and natural language processing techniques. This paper proposes a deep neural framework for image caption generation using…

计算机视觉与模式识别 · 计算机科学 2023-10-12 Rashid Khan , Bingding Huang , Haseeb Hassan , Asim Zaman , Zhongfu Ye

This project aims to create an automated image captioning system that generates natural language descriptions for input images by integrating techniques from computer vision and natural language processing. We employ various different…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Joshua Adrian Cahyono , Jeremy Nathan Jusuf

The Convolutional Neural Network (CNN) has been the dominant image feature extractor in computer vision for years. However, it fails to get the relationship between images/objects and their hierarchical interactions which can be helpful for…

计算机视觉与模式识别 · 计算机科学 2019-12-05 Zheng-cong Fei

Recently, much advance has been made in image captioning, and an encoder-decoder framework has been adopted by all the state-of-the-art models. Under this framework, an input image is encoded by a convolutional neural network (CNN) and then…

计算机视觉与模式识别 · 计算机科学 2018-08-01 Wenhao Jiang , Lin Ma , Yu-Gang Jiang , Wei Liu , Tong Zhang

Recently, generative adversarial networks have gained a lot of popularity for image generation tasks. However, such models are associated with complex learning mechanisms and demand very large relevant datasets. This work borrows concepts…

机器学习 · 计算机科学 2018-09-28 Shagan Sah , Chi Zhang , Thang Nguyen , Dheeraj Kumar Peri , Ameya Shringi , Raymond Ptucha

Building correspondences across different modalities, such as video and language, has recently become critical in many visual recognition applications, such as video captioning. Inspired by machine translation, recent models tackle this…

计算机视觉与模式识别 · 计算机科学 2019-11-11 Silvio Olivastri , Gurkirt Singh , Fabio Cuzzolin

Captioning images is a challenging scene-understanding task that connects computer vision and natural language processing. While image captioning models have been successful in producing excellent descriptions, the field has primarily…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Aya Mahmoud Ahmed , Mohamed Yousef , Khaled F. Hussain , Yousef Bassyouni Mahdy

When a recurrent neural network language model is used for caption generation, the image information can be fed to the neural network either by directly incorporating it in the RNN -- conditioning the language model by `injecting' image…

神经与进化计算 · 计算机科学 2018-03-15 Marc Tanti , Albert Gatt , Kenneth P. Camilleri

Transformer-based models have achieved strong performance in remote sensing image captioning by capturing long-range dependencies and contextual information. However, their practical deployment is hindered by high computational costs,…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Swadhin Das , Divyansh Mundra , Priyanshu Dayal , Raksha Sharma

State-of-the-art image captioners can generate accurate sentences to describe images in a sequence to sequence manner without considering the controllability and interpretability. This, however, is far from making image captioning widely…

计算机视觉与模式识别 · 计算机科学 2022-05-26 Luka Maxwell