English
Related papers

Related papers: TimeSHAP: Explaining Recurrent Models through Sequ…

200 papers

Recurrent neural networks (RNNs) have been used extensively and with increasing success to model various types of sequential data. Much of this progress has been achieved through devising recurrent units and architectures with the…

Machine Learning · Statistics 2017-03-06 Yacine Jernite , Edouard Grave , Armand Joulin , Tomas Mikolov

Encouraged by the success of deep learning in a variety of domains, we investigate the suitability and effectiveness of Recurrent Neural Networks (RNNs) in a domain where deep learning has not yet been used; namely detecting confusion from…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Shane D. Sims , Vanessa Putnam , Cristina Conati

Recurrent Neural Networks (RNNs) are rich models for the processing of sequential data. Recent work on advancing the state of the art has been focused on the optimization or modelling of RNNs, mostly motivated by adressing the problems of…

Recurrent Neural Networks (RNNs) have shown great success in modeling time-dependent patterns, but there is limited research on their learned representations of latent temporal features and the emergence of these representations during…

Machine Learning · Computer Science 2023-06-13 Peter DelMastro , Rushiv Arora , Edward Rietman , Hava T. Siegelmann

Many online platforms have deployed anti-fraud systems to detect and prevent fraudulent activities. However, there is usually a gap between the time that a user commits a fraudulent action and the time that the user is suspended by the…

Machine Learning · Computer Science 2018-11-15 Panpan Zheng , Shuhan Yuan , Xintao Wu

Astronomical surveys of celestial sources produce streams of noisy time series measuring flux versus time ("light curves"). Unlike in many other physical domains, however, large (and source-specific) temporal gaps in data arise naturally…

Instrumentation and Methods for Astrophysics · Physics 2017-11-30 Brett Naul , Joshua S. Bloom , Fernando Pérez , Stéfan van der Walt

Recurrent Neural Networks (RNN) are widely used to solve a variety of problems and as the quantity of data and the amount of available compute have increased, so have model sizes. The number of parameters in recent state-of-the-art networks…

Machine Learning · Computer Science 2017-11-08 Sharan Narang , Erich Elsen , Gregory Diamos , Shubho Sengupta

Despite the recent popularity of deep generative state space models, few comparisons have been made between network architectures and the inference steps of the Bayesian filtering framework -- with most models simultaneously approximating…

Machine Learning · Statistics 2020-09-29 Bryan Lim , Stefan Zohren , Stephen Roberts

Time-series forecasting is one of the most active research topics in artificial intelligence. Applications in real-world time series should consider two factors for achieving reliable predictions: modeling dynamic dependencies among…

Machine Learning · Computer Science 2021-05-28 Gabriel Spadon , Shenda Hong , Bruno Brandoli , Stan Matwin , Jose F. Rodrigues-Jr , Jimeng Sun

Sequence prediction and classification are ubiquitous and challenging problems in machine learning that can require identifying complex dependencies between temporally distant inputs. Recurrent Neural Networks (RNNs) have the ability, in…

Neural and Evolutionary Computing · Computer Science 2014-02-17 Jan Koutník , Klaus Greff , Faustino Gomez , Jürgen Schmidhuber

An elementary Recurrent Neural Network that operates on p time lags, called an RNN(p), is the natural generalisation of a linear autoregressive model ARX(p). It is a powerful forecasting tool for variables displaying inherent seasonal…

Machine Learning · Computer Science 2025-11-10 Roberto Baviera , Pietro Manzoni

Deep Recurrent Neural Network (RNN) has gained popularity in many sequence classification tasks. Beyond predicting a correct class for each data instance, data scientists also want to understand what differentiating factors in the data have…

Machine Learning · Computer Science 2019-01-18 Chuan Wang , Takeshi Onishi , Keiichi Nemoto , Kwan-Liu Ma

Recurrent neural networks (RNNs) are commonly applied to clinical time-series data with the goal of learning patient risk stratification models. Their effectiveness is due, in part, to their use of parameter sharing over time (i.e., cells…

Machine Learning · Computer Science 2020-01-03 Jeeheh Oh , Jiaxuan Wang , Shengpu Tang , Michael Sjoding , Jenna Wiens

Temporal models based on recurrent neural networks have proven to be quite powerful in a wide variety of applications. However, training these models often relies on back-propagation through time, which entails unfolding the network over…

Neural and Evolutionary Computing · Computer Science 2019-08-13 Alexander Ororbia , Ankur Mali , C. Lee Giles , Daniel Kifer

Existing image recognition techniques based on convolutional neural networks (CNNs) basically assume that the training and test datasets are sampled from i.i.d distributions. However, this assumption is easily broken in the real world…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Kazuki Adachi , Shin'ya Yamaguchi

In both mobile and web applications, speeding up user interface response times can often lead to significant improvements in user engagement. A common technique to improve responsiveness is to precompute data ahead of time for specific…

Machine Learning · Computer Science 2020-03-04 Hanson Wang , Zehui Wang , Yuanyuan Ma

In this paper, we have used Recurrent Neural Networks to capture and model human motion data and generate motions by prediction of the next immediate data point at each time-step. Our RNN is armed with recently proposed Gated Recurrent…

Neural and Evolutionary Computing · Computer Science 2015-01-05 Mohammad Pezeshki

Graph processes exhibit a temporal structure determined by the sequence index and and a spatial structure determined by the graph support. To learn from graph processes, an information processing architecture must then be able to exploit…

Signal Processing · Electrical Eng. & Systems 2020-12-02 Luana Ruiz , Fernando Gama , Alejandro Ribeiro

Recurrent neural networks (RNNs) provide state-of-the-art performance in processing sequential data but are memory intensive to train, limiting the flexibility of RNN models which can be trained. Reversible RNNs---RNNs for which the…

Machine Learning · Computer Science 2018-10-26 Matthew MacKay , Paul Vicol , Jimmy Ba , Roger Grosse

Feedforward Neural Network (FNN)-based language models estimate the probability of the next word based on the history of the last N words, whereas Recurrent Neural Networks (RNN) perform the same task based only on the last word and some…

Computation and Language · Computer Science 2017-03-24 Youssef Oualil , Clayton Greenberg , Mittul Singh , Dietrich Klakow