English
Related papers

Related papers: CNN+CNN: Convolutional Decoders for Image Captioni…

200 papers

Sentence compression is a Natural Language Processing (NLP) task aimed at shortening original sentences and preserving their key information. Its applications can benefit many fields e.g. one can build tools for language education. However,…

Computation and Language · Computer Science 2020-09-24 Weiwei Hou , Hanna Suominen , Piotr Koniusz , Sabrina Caldwell , Tom Gedeon

Deep neural networks (DNNs) and, in particular, convolutional neural networks (CNNs) have brought significant advances in a wide range of modern computer application problems. However, the increasing availability of large amounts of…

Machine Learning · Computer Science 2024-07-03 Axel Klawonn , Martin Lanser , Janine Weber

We present a neural model for generating short stories from image sequences, which extends the image description model by Vinyals et al. (Vinyals et al., 2015). This extension relies on an encoder LSTM to compute a context vector of each…

Computation and Language · Computer Science 2018-06-05 Diana Gonzalez-Rico , Gibran Fuentes-Pineda

Research has shown that Convolutional Neural Networks (CNN) can be effectively applied to text classification as part of a predictive coding protocol. That said, most research to date has been conducted on data sets with short documents…

Information Retrieval · Computer Science 2019-12-23 Robert Keeling , Rishi Chhatwal , Nathaniel Huber-Fliflet , Jianping Zhang , Fusheng Wei , Haozhen Zhao , Shi Ye , Han Qin

RNNs and their variants have been widely adopted for image captioning. In RNNs, the production of a caption is driven by a sequence of latent states. Existing captioning models usually represent latent states as vectors, taking this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Bo Dai , Deming Ye , Dahua Lin

This paper describes our winning entry in the ImageCLEF 2015 image sentence generation task. We improve Google's CNN-LSTM model by introducing concept-based sentence reranking, a data-driven approach which exploits the large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Xirong Li , Qin Jin

This article presents a study on Nepali video captioning using deep neural networks. Through the integration of pre-trained CNNs and RNNs, the research focuses on generating precise and contextually relevant captions for Nepali videos. The…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Bipesh Subedi , Saugat Singh , Bal Krishna Bal

Typical techniques for video captioning follow the encoder-decoder framework, which can only focus on one source video being processed. A potential disadvantage of such design is that it cannot capture the multiple visual context…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Wenjie Pei , Jiyuan Zhang , Xiangrong Wang , Lei Ke , Xiaoyong Shen , Yu-Wing Tai

Recently, deep learning approach, especially deep Convolutional Neural Networks (ConvNets), have achieved overwhelming accuracy with fast processing speed for image classification. Incorporating temporal structure with deep ConvNets for…

Computer Vision and Pattern Recognition · Computer Science 2015-11-12 Pingbo Pan , Zhongwen Xu , Yi Yang , Fei Wu , Yueting Zhuang

The ability to describe images with natural language sentences is the hallmark for image and language understanding. Such a system has wide ranging applications such as annotating images and using natural sentences to search for images.In…

Machine Learning · Computer Science 2016-01-15 Afroze Ibrahim Baqapuri

One-hot CNN (convolutional neural network) has been shown to be effective for text categorization (Johnson & Zhang, 2015). We view it as a special case of a general framework which jointly trains a linear model with a non-linear feature…

Machine Learning · Statistics 2016-05-27 Rie Johnson , Tong Zhang

Automatically describing video content with natural language is a fundamental challenge of multimedia. Recurrent Neural Networks (RNN), which models sequence dynamics, has attracted increasing attention on visual interpretation. However,…

Computer Vision and Pattern Recognition · Computer Science 2015-06-05 Yingwei Pan , Tao Mei , Ting Yao , Houqiang Li , Yong Rui

For image classification problems, various neural network models are commonly used due to their success in yielding high accuracies. Convolutional Neural Network (CNN) is one of the most frequently used deep learning methods for image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ilkay Sikdokur , Inci Baytas , Arda Yurdakul

Traditional Recurrent Neural Networks (RNNs) and Long Short-Term Memory (LSTM) units operate on discrete time steps, often failing to capture the fluid temporal dynamics of real-world physical processes. Liquid Neural Networks (LNNs),…

Machine Learning · Computer Science 2026-05-28 Ye Kyaw Thu , Thazin Myint Oo , Thepchai Supnithi

Algorithmic image-based diagnosis and prognosis of neurodegenerative diseases on longitudinal data has drawn great interest from computer vision researchers. The current state-of-the-art models for many image classification tasks are based…

Computer Vision and Pattern Recognition · Computer Science 2017-09-04 Jie Zhang , Qingyang Li , Richard J. Caselli , Jieping Ye , Yalin Wang

Deep Convolutional Neural Networks (CNN) have exhibited superior performance in many visual recognition tasks including image classification, object detection, and scene label- ing, due to their large learning capacity and resistance to…

Computer Vision and Pattern Recognition · Computer Science 2016-10-12 Miao Sun , Tony X. Han , Xun Xu , Ming-Chang Liu , Ahmad Khodayari-Rostamabad

The Convolutional Neural Network (CNN) has achieved great success in image classification. The classification model can also be utilized at image or patch level for many other applications, such as object detection and segmentation. In this…

Computer Vision and Pattern Recognition · Computer Science 2014-12-23 Jun Yuan , Bingbing Ni , Ashraf A. Kassim

Porting state of the art deep learning algorithms to resource constrained compute platforms (e.g. VR, AR, wearables) is extremely challenging. We propose a fast, compact, and accurate model for convolutional neural networks that enables…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Hessam Bagherinezhad , Mohammad Rastegari , Ali Farhadi

Convolutional neural networks (CNNs) have rapidly risen in popularity for many machine learning applications, particularly in the field of image recognition. Much of the benefit generated from these networks comes from their ability to…

Quantum Physics · Physics 2019-04-10 Maxwell Henderson , Samriddhi Shakya , Shashindra Pradhan , Tristan Cook

Recently, three dimensional (3D) convolutional neural networks (CNNs) have emerged as dominant methods to capture spatiotemporal representations in videos, by adding to pre-existing 2D CNNs a third, temporal dimension. Such 3D CNNs,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Gurkirt Singh , Fabio Cuzzolin