中文
相关论文

相关论文: Image to Bengali Caption Generation Using Deep CNN…

200 篇论文

The rise of fake news has made the need for effective detection methods, including in languages other than English, increasingly important. The study aims to address the challenges of Bangla which is considered a less important language. To…

The applications of recurrent neural networks in machine translation are increasing in natural language processing. Besides other languages, Bangla language contains a large amount of vocabulary. Improvement of English to Bangla machine…

计算与语言 · 计算机科学 2021-06-15 Shaykh Siddique , Tahmid Ahmed , Md. Rifayet Azam Talukder , Md. Mohsin Uddin

Generating audio captions is a new research area that combines audio and natural language processing to create meaningful textual descriptions for audio clips. To address this problem, previous studies mostly use the encoder-decoder based…

声音 · 计算机科学 2021-05-14 Ayşegül Özkaya Eren , Mustafa Sert

In this paper we explore the bi-directional mapping between images and their sentence-based descriptions. We propose learning this mapping using a recurrent neural network. Unlike previous approaches that map both sentences and images to a…

计算机视觉与模式识别 · 计算机科学 2014-11-21 Xinlei Chen , C. Lawrence Zitnick

Two recent approaches have achieved state-of-the-art results in image captioning. The first uses a pipelined process where a set of candidate words is generated by a convolutional neural network (CNN) trained on images, and then a maximum…

计算与语言 · 计算机科学 2015-10-16 Jacob Devlin , Hao Cheng , Hao Fang , Saurabh Gupta , Li Deng , Xiaodong He , Geoffrey Zweig , Margaret Mitchell

Generating natural language descriptions for images is a challenging task. The traditional way is to use the convolutional neural network (CNN) to extract image features, followed by recurrent neural network (RNN) to generate sentences. In…

计算机视觉与模式识别 · 计算机科学 2016-02-08 Shijian Tang , Song Han

We present the first approach to automated audio captioning. We employ an encoder-decoder scheme with an alignment model in between. The input to the encoder is a sequence of log mel-band energies calculated from an audio file, while the…

声音 · 计算机科学 2017-10-25 Konstantinos Drossos , Sharath Adavanne , Tuomas Virtanen

Existing image captioning methods just focus on understanding the relationship between objects or instances in a single image, without exploring the contextual correlation existed among contextual image. In this paper, we propose Dual Graph…

计算机视觉与模式识别 · 计算机科学 2021-08-06 Xinzhi Dong , Chengjiang Long , Wenju Xu , Chunxia Xiao

Image captioning by the encoder-decoder framework has shown tremendous advancement in the last decade where CNN is mainly used as encoder and LSTM is used as a decoder. Despite such an impressive achievement in terms of accuracy in simple…

计算机视觉与模式识别 · 计算机科学 2023-01-09 Rana Adnan Ahmad , Muhammad Azhar , Hina Sattar

Extracting context from visual representations is of utmost importance in the advancement of Computer Science. Representation of such a format in Natural Language has a huge variety of applications such as helping the visually impaired etc.…

计算机视觉与模式识别 · 计算机科学 2020-02-25 Madhavan Seshadri , Malavika Srikanth , Mikhail Belov

Exponential growths of social media and micro-blogging sites not only provide platforms for empowering freedom of expressions and individual voices but also enables people to express anti-social behaviour like online harassment,…

计算与语言 · 计算机科学 2020-04-21 Md. Rezaul Karim , Bharathi Raja Chakravarthi , John P. McCrae , Michael Cochez

Automatic generation of video captions is a fundamental challenge in computer vision. Recent techniques typically employ a combination of Convolutional Neural Networks (CNNs) and Recursive Neural Networks (RNNs) for video captioning. These…

计算机视觉与模式识别 · 计算机科学 2019-04-30 Nayyer Aafaq , Naveed Akhtar , Wei Liu , Syed Zulqarnain Gilani , Ajmal Mian

Image captioning is a challenging task that combines the field of computer vision and natural language processing. A variety of approaches have been proposed to achieve the goal of automatically describing an image, and recurrent neural…

计算机视觉与模式识别 · 计算机科学 2018-05-24 Qingzhong Wang , Antoni B. Chan

Audio captioning is a recently proposed task for automatically generating a textual description of a given audio clip. In this study, a novel deep network architecture with audio embeddings is presented to predict audio captions. Within the…

声音 · 计算机科学 2021-01-05 Ayşegül Özkaya Eren , Mustafa Sert

In today's world, image processing plays a crucial role across various fields, from scientific research to industrial applications. But one particularly exciting application is image captioning. The potential impact of effective image…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Md Alif Rahman Ridoy , M Mahmud Hasan , Shovon Bhowmick

Image captioning is the process of automatically generating a description of an image in natural language. Image captioning is one of the significant challenges in image understanding since it requires not only recognizing salient objects…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Ghadah Alabduljabbar , Hafida Benhidour , Said Kerrache

People commonly communicate in English, Arabic, and Bengali spoken languages through various mediums. However, deaf and hard-of-hearing individuals primarily use body language and sign language to express their needs and achieve…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Md Hadiuzzaman , Mohammed Sowket Ali , Tamanna Sultana , Abdur Raj Shafi , Abu Saleh Musa Miah , Jungpil Shin

Despite being one of the most spoken languages in the world ($6^{th}$ based on population), research regarding Bengali handwritten grapheme (smallest functional unit of a writing system) classification has not been explored widely compared…

计算机视觉与模式识别 · 计算机科学 2021-11-17 Tarun Roy , Hasib Hasan , Kowsar Hossain , Masuma Akter Rumi

Recently, much advance has been made in image captioning, and an encoder-decoder framework has been adopted by all the state-of-the-art models. Under this framework, an input image is encoded by a convolutional neural network (CNN) and then…

计算机视觉与模式识别 · 计算机科学 2018-08-01 Wenhao Jiang , Lin Ma , Yu-Gang Jiang , Wei Liu , Tong Zhang

A novel variational autoencoder is developed to model images, as well as associated labels or captions. The Deep Generative Deconvolutional Network (DGDN) is used as a decoder of the latent image features, and a deep Convolutional Neural…

机器学习 · 统计学 2016-09-29 Yunchen Pu , Zhe Gan , Ricardo Henao , Xin Yuan , Chunyuan Li , Andrew Stevens , Lawrence Carin