中文
相关论文

相关论文: Regularizing RNNs for Caption Generation by Recons…

200 篇论文

Training objectives based on predictive coding have recently been shown to be very effective at learning meaningful representations from unlabeled speech. One example is Autoregressive Predictive Coding (Chung et al., 2019), which trains an…

音频与语音处理 · 电气工程与系统科学 2020-04-14 Yu-An Chung , James Glass

Deep neural networks have achieved great successes on the image captioning task. However, most of the existing models depend heavily on paired image-sentence datasets, which are very expensive to acquire. In this paper, we make the first…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Yang Feng , Lin Ma , Wei Liu , Jiebo Luo

Two recent approaches have achieved state-of-the-art results in image captioning. The first uses a pipelined process where a set of candidate words is generated by a convolutional neural network (CNN) trained on images, and then a maximum…

计算与语言 · 计算机科学 2015-10-16 Jacob Devlin , Hao Cheng , Hao Fang , Saurabh Gupta , Li Deng , Xiaodong He , Geoffrey Zweig , Margaret Mitchell

Recurrent Neural Networks are an effective and prevalent tool used to model sequential data such as natural language text. However, their deep nature and massive number of parameters pose a challenge for those intending to study precisely…

计算与语言 · 计算机科学 2020-08-18 Lindsey Sawatzky , Steven Bergner , Fred Popowich

Most current captioning systems use language models trained on data from specific settings, such as image-based captioning via Amazon Mechanical Turk, limiting their ability to generalize to other modality distributions and contexts. This…

计算与语言 · 计算机科学 2025-01-07 Ariel Shaulov , Tal Shaharabany , Eitan Shaar , Gal Chechik , Lior Wolf

Image captioning aims to automatically generate a natural language description of a given image, and most state-of-the-art models have adopted an encoder-decoder framework. The framework consists of a convolution neural network (CNN)-based…

计算机视觉与模式识别 · 计算机科学 2019-05-21 Jun Yu , Jing Li , Zhou Yu , Qingming Huang

We examine the possibility that recent promising results in automatic caption generation are due primarily to language models. By varying image representation quality produced by a convolutional neural network, we find that a…

计算与语言 · 计算机科学 2015-08-11 Jack Hessel , Nicolas Savva , Michael J. Wilber

Image classification is a fundamental task in computer vision, and the quest to enhance DNN accuracy without inflating model size or latency remains a pressing concern. We make a couple of advances in this regard, leading to a novel…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Hasanul Mahmud , Kevin Desai , Palden Lama , Sushil K. Prasad

Recurrent Neural Networks (RNNs) are among the most successful machine learning models for sequence modelling, but tend to suffer from an exponential increase in the number of parameters when dealing with large multidimensional data. To…

机器学习 · 计算机科学 2021-05-12 Yao Lei Xu , Danilo P. Mandic

Along with the prosperity of recurrent neural network in modelling sequential data and the power of attention mechanism in automatically identify salient information, image captioning, a.k.a., image description, has been remarkably advanced…

计算机视觉与模式识别 · 计算机科学 2016-12-16 Hao Liu , Yang Yang , Fumin Shen , Lixin Duan , Heng Tao Shen

Neural audio codecs and autoencoders have emerged as versatile models for audio compression, transmission, feature-extraction, and latent-space generation. However, a key limitation is that most are trained to maximize reconstruction…

声音 · 计算机科学 2025-09-10 Dimitrios Bralios , Jonah Casebeer , Paris Smaragdis

Automatic Image Captioning is the never-ending effort of creating syntactically and validating the accuracy of textual descriptions of an image in natural language with context. The encoder-decoder structure used throughout existing Bengali…

计算机视觉与模式识别 · 计算机科学 2021-10-26 Md Aminul Haque Palash , MD Abdullah Al Nasim , Sourav Saha , Faria Afrin , Raisa Mallik , Sathishkumar Samiappan

Action recognition is a fundamental problem in computer vision with a lot of potential applications such as video surveillance, human computer interaction, and robot learning. Given pre-segmented videos, the task is to recognize actions…

计算机视觉与模式识别 · 计算机科学 2017-06-28 Ahsan Iqbal , Alexander Richard , Hilde Kuehne , Juergen Gall

Neural Network is a powerful Machine Learning tool that shows outstanding performance in Computer Vision, Natural Language Processing, and Artificial Intelligence. In particular, recently proposed ResNet architecture and its modifications…

机器学习 · 统计学 2018-11-13 Iurii Kemaev , Daniil Polykovskiy , Dmitry Vetrov

Recently, three dimensional (3D) convolutional neural networks (CNNs) have emerged as dominant methods to capture spatiotemporal representations in videos, by adding to pre-existing 2D CNNs a third, temporal dimension. Such 3D CNNs,…

计算机视觉与模式识别 · 计算机科学 2019-09-04 Gurkirt Singh , Fabio Cuzzolin

Several image processing tasks, such as image classification and object detection, have been significantly improved using Convolutional Neural Networks (CNN). Like ResNet and EfficientNet, many architectures have achieved outstanding…

计算机视觉与模式识别 · 计算机科学 2022-01-11 Claudio Filipi Gonçalves dos Santos , João Paulo Papa

In this work, we propose a novel recurrent neural network (RNN) architecture. The proposed RNN, gated-feedback RNN (GF-RNN), extends the existing approach of stacking multiple recurrent layers by allowing and controlling signals flowing…

神经与进化计算 · 计算机科学 2015-06-18 Junyoung Chung , Caglar Gulcehre , Kyunghyun Cho , Yoshua Bengio

In certain situations, neural networks will represent environment states in their hidden activations. Our goal is to visualize what environment states the networks are representing. We experiment with a recurrent neural network (RNN)…

机器学习 · 计算机科学 2024-05-13 Nevan Wichers , Victor Tao , Riccardo Volpato , Fazl Barez

Recurrent neural networks (RNNs) have demonstrated impressive results for virtual analog modeling of audio effects. These networks process time-domain audio signals using a series of matrix multiplication and nonlinear activation functions…

声音 · 计算机科学 2024-08-12 Yen-Tung Yeh , Wen-Yi Hsiao , Yi-Hsuan Yang

Image captioning is a task in the field of Artificial Intelligence that merges between computer vision and natural language processing. It is responsible for generating legends that describe images, and has various applications like…

计算机视觉与模式识别 · 计算机科学 2021-07-29 Ahmed Elhagry , Karima Kadaoui