English
Related papers

Related papers: Nonlinear System Identification: Learning while re…

200 papers

The vast majority of systems of practical interest are characterised by nonlinear dynamics. This renders the control and optimization of such systems a complex task due to their nonlinear behaviour. Additionally, standard methods such as…

Systems and Control · Electrical Eng. & Systems 2022-04-05 Akhil Ahmed , Ehecatl Antonio del Rio-Chanona , Mehmet Mercangoz

Computers are nonlinear dynamical systems that exhibit complex and sometimes even chaotic behavior. The models used in the computer systems community, however, are linear. This paper is an exploration of that disconnect: when linear models…

Chaotic Dynamics · Physics 2014-05-06 Joshua Garland , Elizabeth Bradley

State space models (SSM) have been widely applied for the analysis and visualization of large sequential datasets. Sequential Monte Carlo (SMC) is a very popular particle-based method to sample latent states from intractable posteriors.…

Machine Learning · Computer Science 2019-01-07 Duo Xu

We consider the problem of deriving from experimental data an approximation of an unknown function, whose derivatives also approximate the unknown function derivatives. Solving this problem is useful, for instance, in the context of…

Systems and Control · Electrical Eng. & Systems 2019-11-11 Carlo Novara , Angelo Nicolì , Giuseppe C. Calafiore

If a stochastic system during some periods of its evolution can be divided into non-interacting parts, the kinetics of each part can be simulated independently. We show that this can be used in the development of efficient Monte Carlo…

Materials Science · Physics 2009-11-13 V. I. Tokar , H. Dreyssé

In recent years dynamical systems (of deterministic and stochastic nature), describing many models in mathematics, physics, engineering and finances, become more and more complex. Numerical analysis narrowed only to deterministic algorithms…

Numerical Analysis · Mathematics 2024-02-13 Paweł Przybyłowicz

Deep learning methods for communications over unknown nonlinear channels have attracted considerable interest recently. In this paper, we consider semi-supervised learning methods, which are based on variational inference, for decoding…

Signal Processing · Electrical Eng. & Systems 2023-09-22 David Burshtein , Eli Bery

Sequential Monte Carlo (SMC) methods comprise one of the most successful approaches to approximate Bayesian filtering. However, SMC without good proposal distributions struggle in high dimensions. We propose nested sequential Monte Carlo…

Computation · Statistics 2016-12-30 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

The system identification problem is to estimate dynamical parameters from the output data, obtained by performing measurements on the output fields. We investigate system identification for quantum linear systems. Our main objectives are…

Quantum Physics · Physics 2017-12-25 Matthew Levitt , Mădălin Guţă , Theodore Kypraios

In the last decade, sequential Monte-Carlo methods (SMC) emerged as a key tool in computational statistics. These algorithms approximate a sequence of distributions by a sequence of weighted empirical measures associated to a weighted…

Statistics Theory · Mathematics 2007-06-13 R. Douc , France E. Moulines

We consider the discrete-time filtering problem in scenarios where the observation noise is degenerate or low. More precisely, one is given access to a discrete time observation sequence which at any time $k$ depends only on the state of an…

Computation · Statistics 2025-11-17 Abylay Zhumekenov , Alexandros Beskos , Dan Crisan , Ajay Jasra , Nikolas Kantas

Advanced algorithms are necessary to obtain faster-than-real-time dynamic simulations in a number of different physical problems that are characterized by widely disparate time scales. Recent advanced dynamic Monte Carlo algorithms that…

Materials Science · Physics 2016-11-23 M. A. Novotny

We propose two new Bayesian smoothing methods for general state-space models with unknown parameters. The first approach is based on the particle learning and smoothing algorithm, but with an adjustment in the backward resampling weights.…

Computation · Statistics 2016-04-20 Biao Yang , Jonathan R. Stroud , Gabriel Huerta

State-space models are commonly used to describe different forms of ecological data. We consider the case of count data with observation errors. For such data the system process is typically multi-dimensional consisting of coupled Markov…

Methodology · Statistics 2017-08-15 Axel Finke , Ruth King , Alexandros Beskos , Petros Dellaportas

Function approximation from input and output data pairs constitutes a fundamental problem in supervised learning. Deep neural networks are currently the most popular method for learning to mimic the input-output relationship of a general…

Machine Learning · Computer Science 2019-12-09 Nikos Kargas , Nicholas D. Sidiropoulos

Multi-dimensional classification (MDC) is the supervised learning problem where an instance is associated with multiple classes, rather than with a single class, as in traditional classification problems. Since these classes are often…

Machine Learning · Computer Science 2014-05-20 Jesse Read , Luca Martino , David Luengo

System identification is a fundamental problem in reinforcement learning, control theory and signal processing, and the non-asymptotic analysis of the corresponding sample complexity is challenging and elusive, even for linear time-varying…

Machine Learning · Computer Science 2020-11-30 Sen Lin , Hang Wang , Junshan Zhang

Probabilistic prediction of sequences from images and other high-dimensional data is a key challenge, particularly in risk-sensitive applications. In these settings, it is often desirable to quantify the uncertainty associated with the…

Machine Learning · Computer Science 2024-10-31 Qidong Yang , Weicheng Zhu , Joseph Keslin , Laure Zanna , Tim G. J. Rudner , Carlos Fernandez-Granda

Sequential Monte Carlo (SMC) algorithms represent a suite of robust computational methodologies utilized for state estimation and parameter inference within dynamical systems, particularly in real-time or online environments where data…

This paper introduces a Bayesian framework that combines Markov chain Monte Carlo (MCMC) sampling, dimensionality reduction, and neural density estimation to efficiently handle inverse problems that (i) must be solved multiple times, and…

Computational Engineering, Finance, and Science · Computer Science 2026-02-24 Giacomo Bottacini , Matteo Torzoni , Andrea Manzoni