English
Related papers

Related papers: Long short-term memory networks in memristor cross…

200 papers

Spectrum sensing allows cognitive radio systems to detect relevant signals in despite the presence of severe interference. Most of the existing spectrum sensing techniques use a particular signal-noise model with certain assumptions and…

Information Theory · Computer Science 2021-12-07 Nupur Choudhury , Kandarpa Kumar Sarma , Chinmoy Kalita , Aradhana Misra

The integration of quantum computing into classical machine learning architectures has emerged as a promising approach to enhance model efficiency and computational capacity. In this work, we introduce the Quantum Kernel-Based Long…

Quantum Physics · Physics 2024-11-21 Yu-Chao Hsu , Tai-Yu Li , Kuan-Cheng Chen

Recurrent Neural Networks (RNNs) have the ability to retain memory and learn data sequences. Due to the recurrent nature of RNNs, it is sometimes hard to parallelize all its computations on conventional hardware. CPUs do not currently offer…

Neural and Evolutionary Computing · Computer Science 2016-03-07 Andre Xian Ming Chang , Berin Martini , Eugenio Culurciello

Recently, recurrent neural networks (RNNs) as powerful sequence models have re-emerged as a potential acoustic model for statistical parametric speech synthesis (SPSS). The long short-term memory (LSTM) architecture is particularly…

Computation and Language · Computer Science 2016-01-12 Zhizheng Wu , Simon King

In this paper, we apply the long short-term memory (LSTM), an advanced recurrent neural network based machine learning (ML) technique, to the problem of transmitter selection (TS) for secrecy in an underlay small-cell cognitive radio…

Signal Processing · Electrical Eng. & Systems 2021-02-17 Shalini Tripathi , Chinmoy Kundu , Octavia A. Dobre , Ankur Bansal , Mark F. Flanagan

Recurrent neural networks (RNNs) have many advantages over more traditional system identification techniques. They may be applied to linear and nonlinear systems, and they require fewer modeling assumptions. However, these neural network…

Systems and Control · Electrical Eng. & Systems 2022-04-08 Kaicheng Niu , Mi Zhou , Chaouki T. Abdallah , Mohammad Hayajneh

The aim of this work is to investigate the use of Incrementally Input-to-State Stable ($\delta$ISS) deep Long Short Term Memory networks (LSTMs) for the identification of nonlinear dynamical systems. We show that suitable sufficient…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Fabio Bonassi , Alessio La Bella , Giulio Panzani , Marcello Farina , Riccardo Scattolini

In this paper, we extend the deep long short-term memory (DLSTM) recurrent neural networks by introducing gated direct connections between memory cells in adjacent layers. These direct links, called highway connections, enable unimpeded…

Neural and Evolutionary Computing · Computer Science 2018-12-06 Yu Zhang , Guoguo Chen , Dong Yu , Kaisheng Yao , Sanjeev Khudanpur , James Glass

LSTM or Long Short Term Memory Networks is a specific type of Recurrent Neural Network (RNN) that is very effective in dealing with long sequence data and learning long term dependencies. In this work, we perform sentiment analysis on a GOP…

Computation and Language · Computer Science 2020-05-11 Karthik Gopalakrishnan , Fathi M. Salem

We propose a transition-based dependency parser using Recurrent Neural Networks with Long Short-Term Memory (LSTM) units. This extends the feedforward neural network parser of Chen and Manning (2014) and enables modelling of entire…

Computation and Language · Computer Science 2016-07-01 Adhiguna Kuncoro , Yuichiro Sawai , Kevin Duh , Yuji Matsumoto

As a conventional means to analyze the system mechanism based on partial differential equations (PDE) or nonlinear dynamics, iterative algorithms are computationally intensive. In this framework, the details of oscillating dynamics of…

Optics · Physics 2025-01-07 Maolin Wang , Pengxiang Wang , Gang Xu

Gated recurrent networks such as those composed of Long Short-Term Memory (LSTM) nodes have recently been used to improve state of the art in many sequential processing tasks such as speech recognition and machine translation. However, the…

Neural and Evolutionary Computing · Computer Science 2018-06-11 Aditya Rawal , Risto Miikkulainen

We present five variants of the standard Long Short-term Memory (LSTM) recurrent neural networks by uniformly reducing blocks of adaptive parameters in the gating mechanisms. For simplicity, we refer to these models as LSTM1, LSTM2, LSTM3,…

Neural and Evolutionary Computing · Computer Science 2017-07-18 Atra Akandeh , Fathi M. Salem

Production Lines and Conveying Systems are the staple of modern manufacturing processes. Manufacturing efficiency is directly related to the efficiency of the means of production and conveying. Modelling in the industrial context has always…

Machine Learning · Computer Science 2025-03-04 Iyas AlTalafha , Yaprak Yalcin , Gulcihan Ozdemir

Cortical circuits exhibit intricate recurrent architectures that are remarkably similar across different brain areas. Such stereotyped structure suggests the existence of common computational principles. However, such principles have…

Neurons and Cognition · Quantitative Biology 2018-01-04 Rui Ponte Costa , Yannis M. Assael , Brendan Shillingford , Nando de Freitas , Tim P. Vogels

The rapid evolution of artificial intelligence has driven interest in Long Short-Term Memory (LSTM) networks for their effectiveness in processing sequential data. However, traditional LSTMs are limited by issues such as the vanishing…

Quantum Physics · Physics 2024-08-27 Yifan Zhou , Chong Cheng Xu , Mingi Song , Yew Kee Wong , Kangsong Du

Long Short-Term Memory (LSTM) Recurrent Neural networks (RNNs) rely on gating signals, each driven by a function of a weighted sum of at least 3 components: (i) one of an adaptive weight matrix multiplied by the incoming external input…

Neural and Evolutionary Computing · Computer Science 2019-01-01 Fathi M. Salem

LSTMs were introduced to combat vanishing gradients in simple RNNs by augmenting them with gated additive recurrent connections. We present an alternative view to explain the success of LSTMs: the gates themselves are versatile recurrent…

Computation and Language · Computer Science 2018-05-11 Omer Levy , Kenton Lee , Nicholas FitzGerald , Luke Zettlemoyer

Recurrent Neural Networks (RNN), Long Short-Term Memory Networks (LSTM), and Memory Networks which contain memory are popularly used to learn patterns in sequential data. Sequential data has long sequences that hold relationships. RNN can…

Computation and Language · Computer Science 2019-04-22 Anupiya Nugaliyadde , Kok Wai Wong , Ferdous Sohel , Hong Xie

This paper introduces Grid Long Short-Term Memory, a network of LSTM cells arranged in a multidimensional grid that can be applied to vectors, sequences or higher dimensional data such as images. The network differs from existing deep LSTM…

Neural and Evolutionary Computing · Computer Science 2016-01-08 Nal Kalchbrenner , Ivo Danihelka , Alex Graves