English
Related papers

Related papers: Stability of Optimal Filter Higher-Order Derivativ…

200 papers

The problem of the optimal allocation (in the expected mean square error sense) of a measurement budget for particle filtering is addressed. We propose three different optimal intermittent filters, whose optimality criteria depend on the…

Systems and Control · Electrical Eng. & Systems 2022-06-29 Antoine Aspeel , Amaury Gouverneur , Raphaël M. Jungers , Benoit Macq

We study an optimal transportation approach for recovering parameters in dynamical systems with a single smoothly varying attractor. We assume that the data is not sufficient for estimating time derivatives of state variables but enough to…

Dynamical Systems · Mathematics 2022-04-12 Yunan Yang , Levon Nurbekyan , Elisa Negrini , Robert Martin , Mirjeta Pasha

Hierarchies are of fundamental interest in both stochastic optimal control and biological control due to their facilitation of a range of desirable computational traits in a control algorithm and the possibility that they may form a core…

Systems and Control · Computer Science 2018-01-09 Daniel McNamee

We present a variational method for online state estimation and parameter learning in state-space models (SSMs), a ubiquitous class of latent variable models for sequential data. As per standard batch variational techniques, we use…

Machine Learning · Statistics 2022-06-16 Andrew Campbell , Yuyang Shi , Tom Rainforth , Arnaud Doucet

Gaussian Mixture Models (GMMs) are one of the most potent parametric density models used extensively in many applications. Flexibly-tied factorization of the covariance matrices in GMMs is a powerful approach for coping with the challenges…

Machine Learning · Computer Science 2023-11-14 Mohammad Pasande , Reshad Hosseini , Babak Nadjar Araabi

Under multiplicative drift and other regularity conditions, it is established that the asymptotic variance associated with a particle filter approximation of the prediction filter is bounded uniformly in time, and the nonasymptotic,…

Computation · Statistics 2013-12-06 Nick Whiteley

This paper deals with stability of a certain class of fractional order linear and nonlinear systems. The stability is investigated in the time domain and the frequency domain. The general stability conditions and several illustrative…

Dynamical Systems · Mathematics 2011-04-08 Ivo Petras

In this paper, we present an optimal filter for linear time-varying continuous-time stochastic systems that simultaneously estimates the states and unknown inputs in an unbiased minimum-variance sense. We first show that the unknown inputs…

Optimization and Control · Mathematics 2016-11-17 Sze Zheng Yong , Minghui Zhu , Emilio Frazzoli

Optimization algorithms have a rich and fundamental relationship with ordinary differential equations given by its continuous-time limit. When the cost function varies with time -- typically in response to a dynamically changing environment…

Optimization and Control · Mathematics 2024-03-29 Matteo Marchi , Jonathan Bunton , João Pedro Silvestre , Paulo Tabuada

We resolve the fundamental problem of online decoding with general $n^{th}$ order ergodic Markov chain models. Specifically, we provide deterministic and randomized algorithms whose performance is close to that of the optimal offline…

Machine Learning · Computer Science 2019-05-31 Vikas K. Garg , Tamar Pichkhadze

Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. Here, we explore the use of Neural Ordinary Differential Equations, a recently introduced family of…

Machine Learning · Computer Science 2021-04-30 Sourav Dutta , Peter Rivera-Casillas , Matthew W. Farthing

Model order reduction provides low-complexity high-fidelity surrogate models that allow rapid and accurate solutions of parametric differential equations. The development of reduced order models for parametric \emph{nonlinear} Hamiltonian…

Numerical Analysis · Mathematics 2024-09-30 Cecilia Pagliantini , Federico Vismara

We develop a toolbox for exact analysis of iterative algorithms on a class of high-dimensional nonconvex optimization problems with random data. While prior work has shown that low-dimensional statistics of (generalized) first-order methods…

Statistics Theory · Mathematics 2025-07-29 Michael Celentano , Chen Cheng , Ashwin Pananjady , Kabir Aladin Verchand

Recent research shows that supervised learning can be an effective tool for designing near-optimal feedback controllers for high-dimensional nonlinear dynamic systems. But the behavior of neural network controllers is still not well…

Optimization and Control · Mathematics 2022-10-10 Tenavi Nakamura-Zimmerer , Qi Gong , Wei Kang

We study online estimation in latent-variable models by recasting the problem as tracking a moving empirical equilibrium. Standard online EM and stochastic approximation analyses primarily study convergence toward the population parameter…

Machine Learning · Computer Science 2026-05-12 ZhiMing Li , Yue Song

The 3DVAR filter is prototypical of methods used to combine observed data with a dynamical system, online, in order to improve estimation of the state of the system. Such methods are used for high dimensional data assimilation problems,…

Probability · Mathematics 2015-06-11 D. Bloemker , K. J. H. Law , A. M. Stuart , K. C. Zygalakis

Much is known about when a locally optimal solution depends in a single-valued Lipschitz continuous way on the problem's parameters, including tilt perturbations. Much less is known, however, about when that solution and a uniquely…

Optimization and Control · Mathematics 2024-01-02 Matus Benko , R. Tyrrell Rockafellar

When the nonconvex problem is complicated by stochasticity, the sample complexity of stochastic first-order methods may depend linearly on the problem dimension, which is undesirable for large-scale problems. To alleviate this linear…

Optimization and Control · Mathematics 2025-09-30 Yue Xie , Jiawen Bi , Hongcheng Liu

The nonlinear filter associated with the discrete time signal-observation model $(X_k,Y_k)$ is known to forget its initial condition as $k\to\infty$ regardless of the observation structure when the signal possesses sufficiently strong…

Probability · Mathematics 2008-11-15 Ramon van Handel

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama