English
Related papers

Related papers: A Long Short-Term Memory Recurrent Neural Network …

200 papers

We have recently shown that deep Long Short-Term Memory (LSTM) recurrent neural networks (RNNs) outperform feed forward deep neural networks (DNNs) as acoustic models for speech recognition. More recently, we have shown that the performance…

Computation and Language · Computer Science 2015-07-27 Haşim Sak , Andrew Senior , Kanishka Rao , Françoise Beaufays

Neural networks in fluid mechanics offer an efficient approach for exploring complex flows, including multiphase and free surface flows. The recurrent neural network, particularly the Long Short-Term Memory (LSTM) model, proves attractive…

Fluid Dynamics · Physics 2025-01-22 Diego A. de Aguiar , Hugo L. França , Cassio M. Oishi

Long Short-Term Memory Networks (LSTMs) have been applied to daily discharge prediction with remarkable success. Many practical scenarios, however, require predictions at more granular timescales. For instance, accurate prediction of short…

Machine Learning · Computer Science 2021-04-20 Martin Gauch , Frederik Kratzert , Daniel Klotz , Grey Nearing , Jimmy Lin , Sepp Hochreiter

Generating eye diagrams by using a circuit simulator can be very computationally intensive, especially in the presence of nonlinearities. It often involves multiple Newton-like iterations at every time step when a SPICE-like circuit…

Signal Processing · Electrical Eng. & Systems 2019-02-11 Thong Nguyen , Tianjian Lu , Ken Wu , Jose Schutt-Aine

With the rapid development of artificial intelligence, long short term memory (LSTM), one kind of recurrent neural network (RNN), has been widely applied in time series prediction. Like RNN, Transformer is designed to handle the sequential…

Trading and Market Microstructure · Quantitative Finance 2023-09-21 Paul Bilokon , Yitao Qiu

Traffic flow characteristics are one of the most critical decision-making and traffic policing factors in a region. Awareness of the predicted status of the traffic flow has prime importance in traffic management and traffic information…

Machine Learning · Computer Science 2020-02-20 Mehrdad Farahani , Marzieh Farahani , Mohammad Manthouri , Okyay Kaynak

Longlshort-term memory (LSTM) is a deep learning model that can capture long-term dependencies of wireless channel models and is highly adaptable to short-term changes in a wireless environment. This paper proposes a simple LSTM model to…

Most real-world datasets, and particularly those collected from physical systems, are full of noise, packet loss, and other imperfections. However, most specification mining, anomaly detection and other such algorithms assume, or even…

Machine Learning · Computer Science 2019-04-12 Ilia Sucholutsky , Apurva Narayan , Matthias Schonlau , Sebastian Fischmeister

Long Short-Term Memory (LSTM) is one of the most widely used recurrent structures in sequence modeling. It aims to use gates to control information flow (e.g., whether to skip some information or not) in the recurrent computations, although…

Machine Learning · Computer Science 2018-06-11 Zhuohan Li , Di He , Fei Tian , Wei Chen , Tao Qin , Liwei Wang , Tie-Yan Liu

Channel state information (CSI) rapidly becomes outdated in high mobility scenarios, degrading the performance of wireless communication systems. In these cases, time series prediction techniques can be applied to combat the effects of…

Signal Processing · Electrical Eng. & Systems 2021-03-11 Joseph Kibugi , Lucas N. Ribeiro , Martin Haardt

Recurrent Neural Networks (RNNs) are extensively used for time-series modeling and prediction. We propose an approach for automatic construction of a binary classifier based on Long Short-Term Memory RNNs (LSTM-RNNs) for detection of a…

Computer Vision and Pattern Recognition · Computer Science 2016-09-28 Evgeny Burnaev , Ivan Koptelov , German Novikov , Timur Khanipov

In this paper, we present a recurrent neural system named Long Short-term Cognitive Networks (LSTCNs) as a generalization of the Short-term Cognitive Network (STCN) model. Such a generalization is motivated by the difficulty of forecasting…

Machine Learning · Computer Science 2021-09-20 Gonzalo Nápoles , Isel Grau , Agnieszka Jastrzebska , Yamisleydi Salgueiro

We show that collaborative filtering can be viewed as a sequence prediction problem, and that given this interpretation, recurrent neural networks offer very competitive approach. In particular we study how the long short-term memory (LSTM)…

Information Retrieval · Computer Science 2017-01-04 Robin Devooght , Hugues Bersini

Accurately forecasting the future movements of surrounding vehicles is essential for safe and efficient operations of autonomous driving cars. This task is difficult because a vehicle's moving trajectory is greatly determined by its…

Machine Learning · Computer Science 2021-01-15 Jiacheng Pan , Hongyi Sun , Kecheng Xu , Yifei Jiang , Xiangquan Xiao , Jiangtao Hu , Jinghao Miao

Nowadays, modern earth observation programs produce huge volumes of satellite images time series (SITS) that can be useful to monitor geographical areas through time. How to efficiently analyze such kind of information is still an open…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Dino Ienco , Raffaele Gaetano , Claire Dupaquier , Pierre Maurel

Information systems enable many organizational processes in every industry. The efficiencies and effectiveness in the use of information technologies create an unintended byproduct: misuse by existing users or somebody impersonating them -…

Cryptography and Security · Computer Science 2020-07-24 Eduardo Lopez , Kamran Sartipi

We propose a transition-based dependency parser using Recurrent Neural Networks with Long Short-Term Memory (LSTM) units. This extends the feedforward neural network parser of Chen and Manning (2014) and enables modelling of entire…

Computation and Language · Computer Science 2016-07-01 Adhiguna Kuncoro , Yuichiro Sawai , Kevin Duh , Yuji Matsumoto

Training deep recurrent neural network (RNN) architectures is complicated due to the increased network complexity. This disrupts the learning of higher order abstracts using deep RNN. In case of feed-forward networks training deep…

Computation and Language · Computer Science 2018-08-07 Murali Karthick Baskar , Martin Karafiat , Lukas Burget , Karel Vesely , Frantisek Grezl , Jan Honza Cernocky

Spatial transformer network has been used in a layered form in conjunction with a convolutional network to enable the model to transform data spatially. In this paper, we propose a combined spatial transformer network (STN) and a Long…

Image and Video Processing · Electrical Eng. & Systems 2019-09-02 Shiyang Feng , Tianyue Chen , Hao Sun

In sequence learning tasks such as language modelling, Recurrent Neural Networks must learn relationships between input features separated by time. State of the art models such as LSTM and Transformer are trained by backpropagation of…

Machine Learning · Computer Science 2019-12-04 Jeremy Gordon , David Rawlinson , Subutai Ahmad