English
Related papers

Related papers: Recurrent Neural Filters: Learning Independent Bay…

200 papers

State-of-the-art systems for semantic image segmentation use feed-forward pipelines with fixed computational costs. Building an image segmentation system that works across a range of computational budgets is challenging and time-intensive…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Lane McIntosh , Niru Maheswaranathan , David Sussillo , Jonathon Shlens

Recurrent Neural Networks (RNNs) have been widely applied to deal with temporal problems, such as flood forecasting and financial data processing. On the one hand, traditional RNNs models amplify the gradient issue due to the strict time…

Neural and Evolutionary Computing · Computer Science 2022-11-07 Jin Wang , Yongsong Zou , Se-Jung Lim

Real-time classification of Electromyography signals is the most challenging part of controlling a prosthetic hand. Achieving a high classification accuracy of EMG signals in a short delay time is still challenging. Recurrent neural…

Signal Processing · Electrical Eng. & Systems 2021-09-14 Reza Bagherian Azhiri , Mohammad Esmaeili , Mehrdad Nourani

While deep neural networks take loose inspiration from neuroscience, it is an open question how seriously to take the analogies between artificial deep networks and biological neuronal systems. Interestingly, recent work has shown that deep…

Neurons and Cognition · Quantitative Biology 2018-05-31 William Lotter , Gabriel Kreiman , David Cox

Tremendous progress has been made in sequential processing with the recent advances in recurrent neural networks. However, recurrent architectures face the challenge of exploding/vanishing gradients during training, and require significant…

Neural and Evolutionary Computing · Computer Science 2021-10-13 Bing Han , Cheng Wang , Kaushik Roy

Neural Radiance Fields (NeRFs) increase reconstruction detail for novel view synthesis and scene reconstruction, with applications ranging from large static scenes to dynamic human motion. However, the increased resolution and model-free…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Abiramy Kuganesan , Shih-yang Su , James J. Little , Helge Rhodin

We present a novel method to provide efficient and highly detailed reconstructions. Inspired by wavelets, we learn a neural field that decompose the signal both spatially and frequency-wise. We follow the recent grid-based paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Zhijie Wu , Yuhe Jin , Kwang Moo Yi

Accurate time series forecasting is a fundamental challenge in data science. It is often affected by external covariates such as weather or human intervention, which in many applications, may be predicted with reasonable accuracy. We refer…

Machine Learning · Computer Science 2023-08-01 Jimeng Shi , Rukmangadh Myana , Vitalii Stebliankin , Azam Shirali , Giri Narasimhan

In time-varying fading channels, channel coefficients are estimated using pilot symbols that are transmitted every coherence interval. For channels with high Doppler spread, the rapid channel variations over time will require considerable…

Information Theory · Computer Science 2022-03-24 Sandesh Rao Mattu , Lakshmi Narasimhan T , A. Chockalingam

Recurrent Neural Networks (RNNs) are a key technology for applications such as automatic speech recognition or machine translation. Unlike conventional feed-forward DNNs, RNNs remember past information to improve the accuracy of future…

Neural and Evolutionary Computing · Computer Science 2022-02-16 Franyell Silfa , Jose-Maria Arnau , Antonio González

Inspired by the philosophy employed by human beings to determine whether a presented face example is genuine or not, i.e., to glance at the example globally first and then carefully observe the local regions to gain more discriminative…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Rizhao Cai , Haoliang Li , Shiqi Wang , Changsheng Chen , Alex Chichung Kot

Many efforts have been devoted to training generative latent variable models with autoregressive decoders, such as recurrent neural networks (RNN). Stochastic recurrent models have been successful in capturing the variability observed in…

Machine Learning · Statistics 2017-11-17 Anirudh Goyal , Alessandro Sordoni , Marc-Alexandre Côté , Nan Rosemary Ke , Yoshua Bengio

We introduce Active Tuning, a novel paradigm for optimizing the internal dynamics of recurrent neural networks (RNNs) on the fly. In contrast to the conventional sequence-to-sequence mapping scheme, Active Tuning decouples the RNN's…

Machine Learning · Computer Science 2020-11-26 Sebastian Otte , Matthias Karlbauer , Martin V. Butz

Fourier methods have a long and proven track record as an excellent tool in data processing. As memory and computational constraints gain importance in embedded and mobile applications, we propose to combine Fourier methods and recurrent…

Machine Learning · Computer Science 2020-08-17 Moritz Wolter , Juergen Gall , Angela Yao

Deep Recurrent Neural Network (RNN) has gained popularity in many sequence classification tasks. Beyond predicting a correct class for each data instance, data scientists also want to understand what differentiating factors in the data have…

Machine Learning · Computer Science 2019-01-18 Chuan Wang , Takeshi Onishi , Keiichi Nemoto , Kwan-Liu Ma

Graph processes exhibit a temporal structure determined by the sequence index and and a spatial structure determined by the graph support. To learn from graph processes, an information processing architecture must then be able to exploit…

Signal Processing · Electrical Eng. & Systems 2020-12-02 Luana Ruiz , Fernando Gama , Alejandro Ribeiro

In a previous paper, we have shown that a recurrent neural network (RNN) can be used to detect cellular network radio signal degradations accurately. We unexpectedly found, though, that accuracy gains diminished as we added layers to the…

Machine Learning · Computer Science 2024-04-18 David Mulvey , Chuan Heng Foh , Muhammad Ali Imran , Rahim Tafazolli

During the last couple of years, Recurrent Neural Networks (RNN) have reached state-of-the-art performances on most of the sequence modelling problems. In particular, the "sequence to sequence" model and the neural CRF have proved to be…

Computation and Language · Computer Science 2019-04-17 Marco Dinarelli , Loïc Grobol

In this paper, we explore the application of Recurrent Neural Network (RNN) for still images. Typically, Convolutional Neural Networks (CNNs) are the prevalent method applied for this type of data, and more recently, transformers have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Dmitri , Lvov , Yair Smadar , Ran Bezen

Multiple-point geostatistics plays an important role in characterizing complex subsurface aquifer systems such as channelized structures. However, only a few studies have paid attention to how to choose an applicable training image. In this…

Geophysics · Physics 2021-01-19 Zhendan Cao , Jiawei Shen , Mathieu Gravey