English
Related papers

Related papers: A comparison between Recurrent Neural Networks and…

200 papers

Recurrent neural networks (RNN) are at the core of modern automatic speech recognition (ASR) systems. In particular, long-short term memory (LSTM) recurrent neural networks have achieved state-of-the-art results in many speech recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-08 Titouan Parcollet , Mohamed Morchid , Georges Linarès , Renato De Mori

The advantage of recurrent neural networks (RNNs) in learning dependencies between time-series data has distinguished RNNs from other deep learning models. Recently, many advances are proposed in this emerging field. However, there is a…

Neural and Evolutionary Computing · Computer Science 2016-02-16 Hojjat Salehinejad

The key component in forecasting demand and consumption of resources in a supply network is an accurate prediction of real-valued time series. Indeed, both service interruptions and resource waste can be reduced with the implementation of…

Neural and Evolutionary Computing · Computer Science 2018-07-24 Filippo Maria Bianchi , Enrico Maiorino , Michael C. Kampffmeyer , Antonello Rizzi , Robert Jenssen

Recurrent Neural Networks (RNNs) produce state-of-art performance on many machine learning tasks but their demand on resources in terms of memory and computational power are often high. Therefore, there is a great interest in optimizing the…

Neural and Evolutionary Computing · Computer Science 2017-02-28 Joachim Ott , Zhouhan Lin , Ying Zhang , Shih-Chii Liu , Yoshua Bengio

Encouraged by the success of deep learning in a variety of domains, we investigate the suitability and effectiveness of Recurrent Neural Networks (RNNs) in a domain where deep learning has not yet been used; namely detecting confusion from…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Shane D. Sims , Vanessa Putnam , Cristina Conati

Recurrent Neural Networks (RNNs) have been proven to be effective in modeling sequential data and they have been applied to boost a variety of tasks such as document classification, speech recognition and machine translation. Most of…

Computation and Language · Computer Science 2018-08-21 Zhiwei Wang , Yao Ma , Dawei Yin , Jiliang Tang

Stochastic recurrent neural networks with latent random variables of complex dependency structures have shown to be more successful in modeling sequential data than deterministic deep models. However, the majority of existing methods have…

Machine Learning · Computer Science 2020-04-24 Ehsan Hajiramezanali , Arman Hasanzadeh , Nick Duffield , Krishna Narayanan , Mingyuan Zhou , Xiaoning Qian

Accelerating the data acquisition of dynamic magnetic resonance imaging (MRI) leads to a challenging ill-posed inverse problem, which has received great interest from both the signal processing and machine learning community over the last…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Chen Qin , Jo Schlemper , Jose Caballero , Anthony Price , Joseph V. Hajnal , Daniel Rueckert

Laser degradation analysis is a crucial process for the enhancement of laser reliability. Here, we propose a data-driven fault detection approach based on Long Short-Term Memory (LSTM) recurrent neural networks to detect the different laser…

Signal Processing · Electrical Eng. & Systems 2022-03-24 Khouloud Abdelli , Danish Rafique , Stephan Pachnicke

Recently, machine learning methods have provided a broad spectrum of original and efficient algorithms based on Deep Neural Networks (DNN) to automatically predict an outcome with respect to a sequence of inputs. Recurrent hidden cells…

Machine Learning · Computer Science 2017-02-15 Mohamed Bouaziz , Mohamed Morchid , Richard Dufour , Georges Linarès , Renato De Mori

There is lots of scientific work about object detection in images. For many applications like for example autonomous driving the actual data on which classification has to be done are videos. This work compares different methods, especially…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Ahmad B Qasim , Arnd Pettirsch

Recurrent Neural Networks (RNN) are widely used for learning sequences in applications such as EEG classification. Complex RNNs could be hardly deployed on wearable devices due to their computation and memory-intensive processing patterns.…

Signal Processing · Electrical Eng. & Systems 2020-04-21 Seyed Ahmad Mirsalari , Sima Sinaei , Mostafa E. Salehi , Masoud Daneshtalab

A unique feature of Recurrent Neural Networks (RNNs) is that it incrementally processes input sequences. In this research, we aim to uncover the inherent generalization properties, i.e., inductive bias, of RNNs with respect to how…

Machine Learning · Computer Science 2023-05-17 Taiga Ishii , Ryo Ueda , Yusuke Miyao

Recurrent Neural Networks (RNNs) are extensively used for time-series modeling and prediction. We propose an approach for automatic construction of a binary classifier based on Long Short-Term Memory RNNs (LSTM-RNNs) for detection of a…

Computer Vision and Pattern Recognition · Computer Science 2016-09-28 Evgeny Burnaev , Ivan Koptelov , German Novikov , Timur Khanipov

Recently recurrent neural networks (RNNs) have demonstrated the ability to improve scene labeling through capturing long-range dependencies among image units. In this paper, we propose dense RNNs for scene labeling by exploring various…

Computer Vision and Pattern Recognition · Computer Science 2018-01-23 Heng Fan , Haibin Ling

There exist several data-driven approaches that enable us model time series data including traditional regression-based modeling approaches (i.e., ARIMA). Recently, deep learning techniques have been introduced and explored in the context…

Machine Learning · Computer Science 2021-12-20 Saroj Gopali , Faranak Abri , Sima Siami-Namini , Akbar Siami Namin

Recurrent neural networks (RNNs) are temporal networks and cumulative in nature that have shown promising results in various natural language processing tasks. Despite their success, it still remains a challenge to understand their hidden…

Computation and Language · Computer Science 2018-08-07 Pankaj Gupta , Hinrich Schütze

In this study, we explore the application of an artificial recurrent neural network (RNN) called Long Short-Term Memory (LSTM) as an alternative to a turbulent Reynolds-Averaged Navier-Stokes (RANS) model. The LSTM models are utilized to…

Fluid Dynamics · Physics 2023-07-27 Hugo D. Pasinato , Nicólas F. Moguilner Reh

Recurrent Neural Networks (RNNs) are widely used for online regression due to their ability to generalize nonlinear temporal dependencies. As an RNN model, Long-Short-Term-Memory Networks (LSTMs) are commonly preferred in practice, as these…

Machine Learning · Computer Science 2021-06-01 N. Mert Vural , Fatih Ilhan , Selim F. Yilmaz , Salih Ergüt , Suleyman S. Kozat

Recurrent neural networks (RNNs) are capable of learning features and long term dependencies from sequential and time-series data. The RNNs have a stack of non-linear units where at least one connection between units forms a directed cycle.…

Neural and Evolutionary Computing · Computer Science 2018-02-26 Hojjat Salehinejad , Sharan Sankar , Joseph Barfett , Errol Colak , Shahrokh Valaee