English
Related papers

Related papers: Differential Recurrent Neural Networks for Action …

200 papers

Recurrent neural networks, and in particular long short-term memory (LSTM) networks, are a remarkably effective tool for sequence modeling that learn a dense black-box hidden representation of their sequential input. Researchers interested…

Computation and Language · Computer Science 2017-10-31 Hendrik Strobelt , Sebastian Gehrmann , Hanspeter Pfister , Alexander M. Rush

Complex numbers have long been favoured for digital signal processing, yet complex representations rarely appear in deep learning architectures. RNNs, widely used to process time series and sequence information, could greatly benefit from…

Machine Learning · Computer Science 2018-10-30 Moritz Wolter , Angela Yao

Predicting large-scale transportation network traffic has become an important and challenging topic in recent decades. Inspired by the domain knowledge of motion prediction, in which the future motion of an object can be predicted based on…

Machine Learning · Computer Science 2017-05-09 Haiyang Yu , Zhihai Wu , Shuqin Wang , Yunpeng Wang , Xiaolei Ma

Intrusion detection for computer network systems becomes one of the most critical tasks for network administrators today. It has an important role for organizations, governments and our society due to its valuable resources on computer…

Machine Learning · Computer Science 2017-03-30 Loic Bontemps , Van Loi Cao , James McDermott , Nhien-An Le-Khac

Successful applications of reinforcement learning in real-world problems often require dealing with partially observable states. It is in general very challenging to construct and infer hidden states as they often depend on the agent's…

Machine Learning · Computer Science 2015-11-20 Xiujun Li , Lihong Li , Jianfeng Gao , Xiaodong He , Jianshu Chen , Li Deng , Ji He

Speech recognition is largely taking advantage of deep learning, showing that substantial benefits can be obtained by modern Recurrent Neural Networks (RNNs). The most popular RNNs are Long Short-Term Memory (LSTMs), which typically reach…

Computation and Language · Computer Science 2017-10-03 Mirco Ravanelli , Philemon Brakel , Maurizio Omologo , Yoshua Bengio

Matching pedestrians across multiple camera views known as human re-identification (re-identification) is a challenging problem in visual surveillance. In the existing works concentrating on feature extraction, representations are formed…

Computer Vision and Pattern Recognition · Computer Science 2016-07-29 Rahul Rama Varior , Bing Shuai , Jiwen Lu , Dong Xu , Gang Wang

The behavior of recurrent neural network for the data-driven simulation of noisy dynamical systems is studied by training a set of Long Short-Term Memory Networks (LSTM) on the Mackey-Glass time series with a wide range of noise level. It…

Neural and Evolutionary Computing · Computer Science 2019-04-11 Kyongmin Yeo

Learning long-term dependencies still remains difficult for recurrent neural networks (RNNs) despite their success in sequence modeling recently. In this paper, we propose a novel gated RNN structure, which contains only one gate. Hidden…

Neural and Evolutionary Computing · Computer Science 2019-06-24 Wei Luo , Feng Yu

Recurrent neural networks (RNNs) such as long short-term memory and gated recurrent units are pivotal building blocks across a broad spectrum of sequence modeling problems. This paper proposes a recurrently controlled recurrent network…

Computation and Language · Computer Science 2018-11-27 Yi Tay , Luu Anh Tuan , Siu Cheung Hui

Established recurrent neural networks are well-suited to solve a wide variety of prediction tasks involving discrete sequences. However, they do not perform as well in the task of dynamical system identification, when dealing with…

Machine Learning · Computer Science 2019-11-22 Thomas Demeester

Recurrent Neural Networks (RNNs) with sophisticated units that implement a gating mechanism have emerged as powerful technique for modeling sequential signals such as speech or electroencephalography (EEG). The latter is the focus on this…

Signal Processing · Electrical Eng. & Systems 2018-01-09 Meysam Golmohammadi , Saeedeh Ziyabari , Vinit Shah , Eva Von Weltin , Christopher Campbell , Iyad Obeid , Joseph Picone

Training deep recurrent neural network (RNN) architectures is complicated due to the increased network complexity. This disrupts the learning of higher order abstracts using deep RNN. In case of feed-forward networks training deep…

Computation and Language · Computer Science 2018-08-07 Murali Karthick Baskar , Martin Karafiat , Lukas Burget , Karel Vesely , Frantisek Grezl , Jan Honza Cernocky

This paper introduces Grid Long Short-Term Memory, a network of LSTM cells arranged in a multidimensional grid that can be applied to vectors, sequences or higher dimensional data such as images. The network differs from existing deep LSTM…

Neural and Evolutionary Computing · Computer Science 2016-01-08 Nal Kalchbrenner , Ivo Danihelka , Alex Graves

We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in…

Computational Physics · Physics 2019-09-20 Pantelis R. Vlachas , Wonmin Byeon , Zhong Y. Wan , Themistoklis P. Sapsis , Petros Koumoutsakos

Detecting and preventing falls in humans is a critical component of assistive robotic systems. While significant progress has been made in detecting falls, the prediction of falls before they happen, and analysis of the transient state…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Younggeol Cho , Gokhan Solak , Olivia Nocentini , Marta Lorenzini , Andrea Fortuna , Arash Ajoudani

The emergence of Long Short-Term Memory (LSTM) solves the problems of vanishing gradient and exploding gradient in traditional Recurrent Neural Networks (RNN). LSTM, as a new type of RNN, has been widely used in various fields, such as text…

Machine Learning · Computer Science 2022-10-18 Sida Xing , Feihu Han , Suiyang Khoo

Wildfire modelling is an attempt to reproduce fire behaviour. Through active fire analysis, it is possible to reproduce a dynamical process, such as wildfires, with limited duration time series data. Recurrent neural networks (RNNs) can…

Machine Learning · Computer Science 2020-05-28 Rylan Perumal , Terence L van Zyl

As in many other different fields, deep learning has become the main approach in most computer vision applications, such as scene understanding, object recognition, computer-human interaction or human action recognition (HAR). Research…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Adrian Sanchez-Caballero , David Fuentes-Jimenez , Cristina Losada-Gutiérrez

We propose a neural sequence-to-sequence model for direction following, a task that is essential to realizing effective autonomous agents. Our alignment-based encoder-decoder model with long short-term memory recurrent neural networks…

Computation and Language · Computer Science 2015-12-18 Hongyuan Mei , Mohit Bansal , Matthew R. Walter