English
Related papers

Related papers: NeuroView-RNN: It's About Time

200 papers

The design of recurrent neural networks (RNNs) to accurately process sequential inputs with long-time dependencies is very challenging on account of the exploding and vanishing gradient problem. To overcome this, we propose a novel RNN…

Machine Learning · Computer Science 2021-08-19 T. Konstantin Rusch , Siddhartha Mishra

Recurrent neural networks are a powerful tool for modeling sequential data, but the dependence of each timestep's computation on the previous timestep's output limits parallelism and makes RNNs unwieldy for very long sequences. We introduce…

Neural and Evolutionary Computing · Computer Science 2016-11-22 James Bradbury , Stephen Merity , Caiming Xiong , Richard Socher

During the last decade, deep neural networks (DNN) have demonstrated impressive performances solving a wide range of problems in various domains such as medicine, finance, law, etc. Despite their great performances, they have long been…

Machine Learning · Computer Science 2020-10-13 Jiechieu Kameni Florentin Flambeau , Tsopze Norbert

Recurrent Neural Networks (RNNs) represent the de facto standard machine learning tool for sequence modelling, owing to their expressive power and memory. However, when dealing with large dimensional data, the corresponding exponential…

Machine Learning · Computer Science 2021-05-12 Yao Lei Xu , Giuseppe G. Calvi , Danilo P. Mandic

Task-based modeling with recurrent neural networks (RNNs) has emerged as a popular way to infer the computational function of different brain regions. These models are quantitatively assessed by comparing the low-dimensional neural…

Neurons and Cognition · Quantitative Biology 2019-12-06 Niru Maheswaranathan , Alex H. Williams , Matthew D. Golub , Surya Ganguli , David Sussillo

Deep neural networks are revolutionizing the way complex systems are developed. However, these automatically-generated networks are opaque to humans, making it difficult to reason about them and guarantee their correctness. Here, we propose…

Artificial Intelligence · Computer Science 2020-08-11 Yuval Jacoby , Clark Barrett , Guy Katz

Convolutional neural networks (CNNs) have shown exceptional performance for a range of medical imaging tasks. However, conventional CNNs are not able to explain their reasoning process, therefore limiting their adoption in clinical…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Linde S. Hesse , Ana I. L. Namburete

Detecting structure in noisy time series is a difficult task. One intuitive feature is the notion of trend. From theoretical hints and using simulated time series, we empirically investigate the efficiency of standard recurrent neural…

Machine Learning · Computer Science 2021-10-22 Alexandre Miot , Gilles Drigout

Recurrent neural networks (RNNs) are a popular choice for modeling sequential data. Modern RNN architectures assume constant time-intervals between observations. However, in many datasets (e.g. medical records) observation times are…

Machine Learning · Computer Science 2022-07-27 Mona Schirmer , Mazin Eltayeb , Stefan Lessmann , Maja Rudolph

Deep neural networks have shown promising results for various clinical prediction tasks such as diagnosis, mortality prediction, predicting duration of stay in hospital, etc. However, training deep networks -- such as those based on…

Machine Learning · Computer Science 2018-07-06 Priyanka Gupta , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff

Neural networks (NN) can be divided into two broad categories, recurrent and non-recurrent. Both types of neural networks are popular and extensively studied, but they are often treated as distinct families of machine learning algorithms.…

Machine Learning · Computer Science 2024-04-02 Quincy Hershey , Randy Paffenroth , Harsh Pathak , Simon Tavener

Graph Neural Networks (GNNs) have emerged as the predominant approach for learning over graph-structured data. However, most GNNs operate as black-box models and require post-hoc explanations, which may not suffice in high-stakes scenarios…

Machine Learning · Computer Science 2025-10-14 Maya Bechler-Speicher , Amir Globerson , Ran Gilad-Bachrach

Encouraged by the success of deep learning in a variety of domains, we investigate the suitability and effectiveness of Recurrent Neural Networks (RNNs) in a domain where deep learning has not yet been used; namely detecting confusion from…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Shane D. Sims , Vanessa Putnam , Cristina Conati

Recurrent neural networks (RNNs) are powerful and effective for processing sequential data. However, RNNs are usually considered "black box" models whose internal structure and learned parameters are not interpretable. In this paper, we…

Machine Learning · Statistics 2016-11-23 Scott Wisdom , Thomas Powers , James Pitton , Les Atlas

We extend Neural Processes (NPs) to sequential data through Recurrent NPs or RNPs, a family of conditional state space models. RNPs model the state space with Neural Processes. Given time series observed on fast real-world time scales but…

Machine Learning · Computer Science 2019-11-07 Timon Willi , Jonathan Masci , Jürgen Schmidhuber , Christian Osendorfer

In a previous paper, we have shown that a recurrent neural network (RNN) can be used to detect cellular network radio signal degradations accurately. We unexpectedly found, though, that accuracy gains diminished as we added layers to the…

Machine Learning · Computer Science 2024-04-18 David Mulvey , Chuan Heng Foh , Muhammad Ali Imran , Rahim Tafazolli

In recent years, deep neural networks have been applied to obtain high performance of prediction, classification, and pattern recognition. However, the weights in these deep neural networks are difficult to be explained. Although a linear…

Machine Learning · Computer Science 2020-05-08 Chi-Hua Chen

Deep Neural Networks (DNNs) deliver state-of-the-art performance in many image recognition and understanding applications. However, despite their outstanding performance, these models are black-boxes and it is hard to understand how they…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Moustafa Alzantot , Amy Widdicombe , Simon Julier , Mani Srivastava

Biological visual systems exhibit abundant recurrent connectivity. State-of-the-art neural network models for visual recognition, by contrast, rely heavily or exclusively on feedforward computation. Any finite-time recurrent neural network…

Neurons and Cognition · Quantitative Biology 2020-12-09 Ruben S. van Bergen , Nikolaus Kriegeskorte

Deep neural networks are highly effective in solving complex problems but are often viewed as "black boxes," limiting their adoption in contexts where transparency and explainability are essential. This lack of visibility raises ethical and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Fabien Poirier