English
Related papers

Related papers: At the Intersection of Deep Sequential Model Frame…

200 papers

Reservoir computing (RC), is a class of computational methods such as Echo State Networks (ESN) and Liquid State Machines (LSM) describe a generic method to perform pattern recognition and temporal analysis with any non-linear system. This…

Machine Learning · Computer Science 2024-11-19 Anmol Biswas , Sharvari Ashok Medhe , Raghav Singhal , Udayan Ganguly

Reservoir Computing is a class of simple yet efficient Recurrent Neural Networks where internal weights are fixed at random and only a linear output layer is trained. In the large size limit, such random neural networks have a deep…

Machine Learning · Statistics 2021-02-18 Jonathan Dong , Ruben Ohana , Mushegh Rafayelyan , Florent Krzakala

This paper is concerned with the online estimation of a nonlinear dynamic system from a series of noisy measurements. The focus is on cases wherein outliers are present in-between normal noises. We assume that the outliers follow an unknown…

Computation · Statistics 2019-05-14 Bin Liu

Currently, legal requirements demand that insurance companies increase their emphasis on monitoring the risks linked to the underwriting and asset management activities. Regarding underwriting risks, the main uncertainties that insurers…

Risk Management · Quantitative Finance 2020-08-19 Eduardo Ramos-Pérez , Pablo J. Alonso-González , José Javier Núñez-Velázquez

State space models are emerging as a dominant model class for sequence problems with many relying on the HiPPO framework to initialize their dynamics. However, HiPPO fundamentally assumes data to be noise-free; an assumption often violated…

Machine Learning · Computer Science 2025-06-06 Marten Lienen , Abdullah Saydemir , Stephan Günnemann

We propose a new reservoir computing method for forecasting high-resolution spatiotemporal datasets. By combining multi-resolution inputs from coarser to finer layers, our architecture better captures both local and global dynamics. Applied…

Machine Learning · Computer Science 2025-10-14 Nicola Alboré , Gabriele Di Antonio , Fabrizio Coccetti , Andrea Gabrielli

There is a wave of interest in using unsupervised neural networks for solving differential equations. The existing methods are based on feed-forward networks, {while} recurrent neural network differential equation solvers have not yet been…

Machine Learning · Computer Science 2021-09-07 Marios Mattheakis , Hayden Joy , Pavlos Protopapas

The prediction of complex nonlinear dynamical systems with the help of machine learning techniques has become increasingly popular. In particular, reservoir computing turned out to be a very promising approach especially for the…

Data Analysis, Statistics and Probability · Physics 2020-01-08 Alexander Haluszczynski , Christoph Räth

Reservoir computing(RC) is a brain-inspired computing framework that employs a transient dynamical system whose reaction to an input signal is transformed to a target output. One of the central problems in RC is to find a reliable reservoir…

Chaotic Dynamics · Physics 2020-08-26 Jaesung Choi , Pilwon Kim

We consider the problem of forecasting complex, nonlinear space-time processes when observations provide only partial information of on the system's state. We propose a natural data-driven framework, where the system's dynamics are modelled…

Systems and Control · Computer Science 2019-03-01 Ibrahim Ayed , Emmanuel de Bézenac , Arthur Pajot , Julien Brajard , Patrick Gallinari

This paper addresses the synthesis of interval observers for partially unknown nonlinear systems subject to bounded noise, aiming to simultaneously estimate system states and learn a model of the unknown dynamics. Our approach leverages…

Systems and Control · Electrical Eng. & Systems 2025-04-15 Mohammad Khajenejad , Zeyuan Jin

Filtering and smoothing algorithms for linear discrete-time state-space models with skewed and heavy-tailed measurement noise are presented. The algorithms use a variational Bayes approximation of the posterior distribution of models that…

Systems and Control · Computer Science 2015-06-30 Henri Nurminen , Tohid Ardeshiri , Robert Piché , Fredrik Gustafsson

Noise is usually regarded as adversarial to extract the effective dynamics from time series, such that the conventional data-driven approaches usually aim at learning the dynamics by mitigating the noisy effect. However, noise can have a…

Adaptation and Self-Organizing Systems · Physics 2023-09-12 Zequn Lin , Zhaofan Lu , Zengru Di , Ying Tang

Modern time series data often display complex nonlinear dependencies along with irregular regime-switching behaviors. These features present technical challenges in modeling, inference, and in offering insightful understanding into the…

Machine Learning · Computer Science 2025-01-13 Xiuqin Xu , Hanqiu Peng , Ying Chen

Forecasting chaotic time series requires models that can capture the intrinsic geometry of the underlying attractor while remaining computationally efficient. We introduce a novel reservoir computing (RC) framework that integrates…

Neural and Evolutionary Computing · Computer Science 2025-11-06 S. K. Laha

We propose Linear Oscillatory State-Space models (LinOSS) for efficiently learning on long sequences. Inspired by cortical dynamics of biological neural networks, we base our proposed LinOSS model on a system of forced harmonic oscillators.…

Machine Learning · Computer Science 2025-06-19 T. Konstantin Rusch , Daniela Rus

Accurate modeling is crucial in many engineering and scientific applications, yet obtaining a reliable process model for complex systems is often challenging. To address this challenge, we propose a novel framework, reservoir computing with…

Machine Learning · Computer Science 2025-08-08 Kumar Anurag , Kasra Azizi , Francesco Sorrentino , Wenbin Wan

In real-world applications, we often require reliable decision making under dynamics uncertainties using noisy high-dimensional sensory data. Recently, we have seen an increasing number of learning-based control algorithms developed to…

Systems and Control · Electrical Eng. & Systems 2022-12-20 Lukas Brunke , Siqi Zhou , Angela P. Schoellig

The data-driven recovery of the unknown governing equations of dynamical systems has recently received an increasing interest. However, the identification of governing equations remains challenging when dealing with noisy and partial…

Machine Learning · Computer Science 2021-02-17 Duong Nguyen , Said Ouala , Lucas Drumetz , Ronan Fablet

AI systems deployed in the real world must contend with distractions and out-of-distribution (OOD) noise that can destabilize their policies and lead to unsafe behavior. While robust training can reduce sensitivity to some forms of noise,…

Machine Learning · Computer Science 2025-12-02 Geigh Zollicoffer , Tanush Chopra , Mingkuan Yan , Xiaoxu Ma , Kenneth Eaton , Mark Riedl