English
Related papers

Related papers: A C-LSTM Neural Network for Text Classification

200 papers

Recently, several methods have been proposed to explain the predictions of recurrent neural networks (RNNs), in particular of LSTMs. The goal of these methods is to understand the network's decisions by assigning to each input variable,…

Machine Learning · Computer Science 2019-06-05 Leila Arras , Ahmed Osman , Klaus-Robert Müller , Wojciech Samek

We introduce a neural network that represents sentences by composing their words according to induced binary parse trees. We use Tree-LSTM as our composition function, applied along a tree structure found by a fully differentiable natural…

Computation and Language · Computer Science 2020-01-16 Jean Maillard , Stephen Clark , Dani Yogatama

The ability to accurately represent sentences is central to language understanding. We describe a convolutional architecture dubbed the Dynamic Convolutional Neural Network (DCNN) that we adopt for the semantic modelling of sentences. The…

Computation and Language · Computer Science 2014-04-09 Nal Kalchbrenner , Edward Grefenstette , Phil Blunsom

We introduce a novel, simple convolution neural network (CNN) architecture - multi-group norm constraint CNN (MGNC-CNN) that capitalizes on multiple sets of word embeddings for sentence classification. MGNC-CNN extracts features from input…

Computation and Language · Computer Science 2016-03-29 Ye Zhang , Stephen Roller , Byron Wallace

In this work we present a state-of-the-art approach for unconstrained natural scene text recognition. We propose a cascade approach that incorporates a convolutional neural network (CNN) architecture followed by a long short term memory…

Computer Vision and Pattern Recognition · Computer Science 2016-07-22 Ahmed Mamdouh A. Hassanien

We present a neural network architecture based on bidirectional LSTMs to compute representations of words in the sentential contexts. These context-sensitive word representations are suitable for, e.g., distinguishing different word senses…

Computation and Language · Computer Science 2015-11-23 Kazuya Kawakami , Chris Dyer

We introduce a recurrent neural network language model (RNN-LM) with long short-term memory (LSTM) units that utilizes both character-level and word-level inputs. Our model has a gate that adaptively finds the optimal mixture of the…

Computation and Language · Computer Science 2016-10-14 Yasumasa Miyamoto , Kyunghyun Cho

Text recognition in natural scene is a challenging problem due to the many factors affecting text appearance. In this paper, we presents a method that directly transcribes scene text images to text without needing of sophisticated character…

Computer Vision and Pattern Recognition · Computer Science 2016-01-07 Guo Qiang , Tu Dan , Li Guohui , Lei Jun

The classification of sentences is very challenging, since sentences contain the limited contextual information. In this paper, we proposed an Attention-Gated Convolutional Neural Network (AGCNN) for sentence classification, which generates…

Computation and Language · Computer Science 2018-12-31 Yang Liu , Lixin Ji , Ruiyang Huang , Tuosiyu Ming , Chao Gao , Jianpeng Zhang

Countless learning tasks require dealing with sequential data. Image captioning, speech synthesis, and music generation all require that a model produce outputs that are sequences. In other domains, such as time series prediction, video…

Machine Learning · Computer Science 2015-10-20 Zachary C. Lipton , John Berkowitz , Charles Elkan

Convolutional neural networks (CNNs) have recently emerged as a popular building block for natural language processing (NLP). Despite their success, most existing CNN models employed in NLP share the same learned (and static) set of filters…

Computation and Language · Computer Science 2018-08-31 Dinghan Shen , Martin Renqiang Min , Yitong Li , Lawrence Carin

Long Short-Term Memory Recurrent Neural Networks (LSTM-RNN) are one of the most powerful dynamic classifiers publicly known. The network itself and the related learning algorithms are reasonably well documented to get an idea how it works.…

Neural and Evolutionary Computing · Computer Science 2019-09-23 Ralf C. Staudemeyer , Eric Rothstein Morris

Deep neural networks have recently been shown to achieve highly competitive performance in many computer vision tasks due to their abilities of exploring in a much larger hypothesis space. However, since most deep architectures like stacked…

Computation and Language · Computer Science 2018-02-06 Zixiang Ding , Rui Xia , Jianfei Yu , Xiang Li , Jian Yang

We develop a Deep-Text Recurrent Network (DTRN) that regards scene text reading as a sequence labelling problem. We leverage recent advances of deep convolutional neural networks to generate an ordered high-level sequence from a whole word…

Computer Vision and Pattern Recognition · Computer Science 2015-12-22 Pan He , Weilin Huang , Yu Qiao , Chen Change Loy , Xiaoou Tang

In recent years, deep learning-based models have significantly improved the Natural Language Processing (NLP) tasks. Specifically, the Convolutional Neural Network (CNN), initially used for computer vision, has shown remarkable performance…

Computation and Language · Computer Science 2022-03-11 Sanskar Soni , Satyendra Singh Chouhan , Santosh Singh Rathore

Convolutional neural network (CNN) is a neural network that can make use of the internal structure of data such as the 2D structure of image data. This paper studies CNN on text categorization to exploit the 1D structure (namely, word…

Computation and Language · Computer Science 2015-03-27 Rie Johnson , Tong Zhang

Time, cost, and energy efficiency are critical considerations in Deep-Learning (DL), particularly when processing long texts. Transformers, which represent the current state of the art, exhibit quadratic computational complexity relative to…

Computation and Language · Computer Science 2025-07-11 Fardin Rastakhiz

Deep learning models for natural language processing (NLP) are inherently complex and often viewed as black box in nature. This paper develops an approach for interpreting convolutional neural networks for text classification problems by…

Computation and Language · Computer Science 2021-07-12 Wei Zhao , Rahul Singh , Tarun Joshi , Agus Sudjianto , Vijayan N. Nair

Nowadays, modern earth observation programs produce huge volumes of satellite images time series (SITS) that can be useful to monitor geographical areas through time. How to efficiently analyze such kind of information is still an open…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Dino Ienco , Raffaele Gaetano , Claire Dupaquier , Pierre Maurel

The success of Convolutional Neural Networks (CNNs) in computer vision is mainly driven by their strong inductive bias, which is strong enough to allow CNNs to solve vision-related tasks with random weights, meaning without learning.…