English
Related papers

Related papers: Learning text representation using recurrent convo…

200 papers

Sequence prediction and classification are ubiquitous and challenging problems in machine learning that can require identifying complex dependencies between temporally distant inputs. Recurrent Neural Networks (RNNs) have the ability, in…

Neural and Evolutionary Computing · Computer Science 2014-02-17 Jan Koutník , Klaus Greff , Faustino Gomez , Jürgen Schmidhuber

In this work, we introduce a hypergraph representation learning framework called Hypergraph Neural Networks (HNN) that jointly learns hyperedge embeddings along with a set of hyperedge-dependent embeddings for each node in the hypergraph.…

Machine Learning · Computer Science 2023-01-02 Ryan Aponte , Ryan A. Rossi , Shunan Guo , Jane Hoffswell , Nedim Lipka , Chang Xiao , Gromit Chan , Eunyee Koh , Nesreen Ahmed

In recent years, many deep-learning based models are proposed for text classification. This kind of models well fits the training set from the statistical point of view. However, it lacks the capacity of utilizing instance-level information…

Computation and Language · Computer Science 2017-08-29 Zhiguo Wang , Wael Hamza , Linfeng Song

Determining the traffic scenario space is a major challenge for the homologation and coverage assessment of automated driving functions. In contrast to current approaches that are mainly scenario-based and rely on expert knowledge, we…

Machine Learning · Computer Science 2020-07-16 Nick Harmening , Marin Biloš , Stephan Günnemann

Many problems in NLP require aggregating information from multiple mentions of the same entity which may be far apart in the text. Existing Recurrent Neural Network (RNN) layers are biased towards short-term dependencies and hence not…

Computation and Language · Computer Science 2018-04-18 Bhuwan Dhingra , Qiao Jin , Zhilin Yang , William W. Cohen , Ruslan Salakhutdinov

We introduce a recurrent neural network language model (RNN-LM) with long short-term memory (LSTM) units that utilizes both character-level and word-level inputs. Our model has a gate that adaptively finds the optimal mixture of the…

Computation and Language · Computer Science 2016-10-14 Yasumasa Miyamoto , Kyunghyun Cho

In this work, we propose a novel hybrid method for scene text detection namely Correlation Propagation Network (CPN). It is an end-to-end trainable framework engined by advanced Convolutional Neural Networks. Our CPN predicts text objects…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Zichuan Liu , Guosheng Lin , Wang Ling Goh , Fayao Liu , Chunhua Shen , Xiaokang Yang

Circuits of biological neurons, such as in the functional parts of the brain can be modeled as networks of coupled oscillators. Inspired by the ability of these systems to express a rich set of outputs while keeping (gradients of) state…

Machine Learning · Computer Science 2021-03-16 T. Konstantin Rusch , Siddhartha Mishra

We present a new handwritten text segmentation method by training a convolutional neural network (CNN) in an end-to-end manner. Many conventional methods addressed this problem by extracting connected components and then classifying them.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Junho Jo , Hyung Il Koo , Jae Woong Soh , Nam Ik Cho

Convolutional neural network (CNN) is a neural network that can make use of the internal structure of data such as the 2D structure of image data. This paper studies CNN on text categorization to exploit the 1D structure (namely, word…

Computation and Language · Computer Science 2015-03-27 Rie Johnson , Tong Zhang

This paper addresses the problem of sentence-level sentiment analysis. In recent years, Convolution and Recursive Neural Networks have been proven to be effective network architecture for sentence-level sentiment analysis. Nevertheless,…

Computation and Language · Computer Science 2018-01-30 Vinh D. Van , Thien Thai , Minh-Quoc Nghiem

This paper presents a new semi-supervised framework with convolutional neural networks (CNNs) for text categorization. Unlike the previous approaches that rely on word embeddings, our method learns embeddings of small text regions from…

Machine Learning · Statistics 2015-11-03 Rie Johnson , Tong Zhang

Nowadays, neural network models achieve state-of-the-art results in many areas as computer vision or speech processing. For sequential data, especially for Natural Language Processing (NLP) tasks, Recurrent Neural Networks (RNNs) and their…

Computation and Language · Computer Science 2021-02-23 Elie Azeraf , Emmanuel Monfrini , Emmanuel Vignon , Wojciech Pieczynski

Recommender systems objectives can be broadly characterized as modeling user preferences over short-or long-term time horizon. A large body of previous research studied long-term recommendation through dimensionality reduction techniques…

Information Retrieval · Computer Science 2018-07-25 Kiewan Villatel , Elena Smirnova , Jérémie Mary , Philippe Preux

In this work, we jointly address the problem of text detection and recognition in natural scene images based on convolutional recurrent neural networks. We propose a unified network that simultaneously localizes and recognizes text with a…

Computer Vision and Pattern Recognition · Computer Science 2017-07-14 Hui Li , Peng Wang , Chunhua Shen

Natural Language Processing (NLP) is widely used in fields like machine translation and sentiment analysis. However, traditional NLP models struggle with accuracy and efficiency. This paper introduces Deep Convolutional Neural Networks…

Computation and Language · Computer Science 2024-12-23 Chang Weng , Scott Rood , Mehdi Ali Ramezani , Amir Aslani , Reza Zarrab , Wang Zwuo , Sanjeev Salimans , Tim Satheesh

This study presents a novel model for invertible sentence embeddings using a residual recurrent network trained on an unsupervised encoding task. Rather than the probabilistic outputs common to neural machine translation models, our…

Computation and Language · Computer Science 2023-04-07 Jeremy Wilkerson

In this work, we propose a novel recurrent neural network (RNN) architecture. The proposed RNN, gated-feedback RNN (GF-RNN), extends the existing approach of stacking multiple recurrent layers by allowing and controlling signals flowing…

Neural and Evolutionary Computing · Computer Science 2015-06-18 Junyoung Chung , Caglar Gulcehre , Kyunghyun Cho , Yoshua Bengio

Recently, there has been interest in multiplicative recurrent neural networks for language modeling. Indeed, simple Recurrent Neural Networks (RNNs) encounter difficulties recovering from past mistakes when generating sequences due to high…

Machine Learning · Computer Science 2019-07-02 Diego Maupomé , Marie-Jean Meurs

We present a self-contained system for constructing natural language models for use in text compression. Our system improves upon previous neural network based models by utilizing recent advances in syntactic parsing -- Google's SyntaxNet…

Machine Learning · Computer Science 2016-08-30 David Cox