English
Related papers

Related papers: Fast Robust Methods for Singular State-Space Model…

200 papers

The Kalman filter and Rauch-Tung-Striebel (RTS) smoother are optimal for state estimation in linear dynamic systems. With nonlinear systems, the challenge consists in how to propagate uncertainty through the state transitions and output…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Simon Kuang , Xinfan Lin

Stochastic inverse problems considered in this article consist of estimating the probability distributions of intrinsically random inputs of computer models. These estimations are based on observable outputs affected by model noise, and…

Statistics Theory · Mathematics 2025-03-17 Nicolas Bousquet , Mélanie Blazère , Thomas Cerbelaud

State space models (SSMs) are now ubiquitous in many fields and increasingly complicated with observed and unobserved variables often interacting in non-linear fashions. The crucial task of validating model assumptions thus becomes…

We exploit analogies between first-order algorithms for constrained optimization and non-smooth dynamical systems to design a new class of accelerated first-order algorithms for constrained optimization. Unlike Frank-Wolfe or projected…

Optimization and Control · Mathematics 2025-05-02 Michael Muehlebach , Michael I. Jordan

Computational imaging has been revolutionized by compressed sensing algorithms, which offer guaranteed uniqueness, convergence, and stability properties. Model-based deep learning methods that combine imaging physics with learned…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Aniket Pramanik , M. Bridget Zimmerman , Mathews Jacob

Slow feature analysis (SFA), as a method for learning slowly varying features in classification and signal analysis, has attracted increasing attention in recent years. Recent probabilistic extensions to SFA learn effective representations…

Machine Learning · Computer Science 2025-09-10 Vishal Rishi

Modern autonomous systems are purposed for many challenging scenarios, where agents will face unexpected events and complicated tasks. The presence of disturbance noise with control command and unknown inputs can negatively impact robot…

Robotics · Computer Science 2023-09-22 Zida Wu , Zhaoliang Zheng , Ankur Mehta

Gaussian processes (GPs) are important probabilistic tools for inference and learning in spatio-temporal modelling problems such as those in climate science and epidemiology. However, existing GP approximations do not simultaneously support…

Machine Learning · Computer Science 2021-06-21 Will Tebbutt , Arno Solin , Richard E. Turner

We formulate approximate Bayesian inference in non-conjugate temporal and spatio-temporal Gaussian process models as a simple parameter update rule applied during Kalman smoothing. This viewpoint encompasses most inference schemes,…

Machine Learning · Statistics 2020-07-14 William J. Wilkinson , Paul E. Chang , Michael Riis Andersen , Arno Solin

Recurrent State-space models (RSSMs) are highly expressive models for learning patterns in time series data and system identification. However, these models assume that the dynamics are fixed and unchanging, which is rarely the case in…

Machine Learning · Computer Science 2023-10-16 Vaisakh Shaj , Dieter Buchler , Rohit Sonker , Philipp Becker , Gerhard Neumann

Practical implementations of Gaussian smoothing algorithms have received a great deal of attention in the last 60 years. However, almost all work focuses on estimating complete time series (''fixed-interval smoothing'', $\mathcal{O}(K)$…

Numerical Analysis · Mathematics 2025-01-24 Nicholas Krämer

Randomized smoothing (RS) is an effective and scalable technique for constructing neural network classifiers that are certifiably robust to adversarial perturbations. Most RS works focus on training a good base model that boosts the…

Machine Learning · Computer Science 2021-09-20 Chen Chen , Kezhi Kong , Peihong Yu , Juan Luque , Tom Goldstein , Furong Huang

This paper deals with state estimation of nonlinear stochastic dynamic models. In particular, the stochastic integration rule, which provides asymptotically unbiased estimates of the moments of nonlinearly transformed Gaussian random…

Signal Processing · Electrical Eng. & Systems 2025-01-15 Jindrich Dunik , Jakub Matousek , Ondrej Straka , Erik Blasch , John Hiles , Ruixin Niu

State estimation in the presence of uncertain or data-driven noise distributions remains a critical challenge in control and robotics. Although the Kalman filter is the most popular choice, its performance degrades significantly when…

Systems and Control · Electrical Eng. & Systems 2025-04-01 Minhyuk Jang , Astghik Hakobyan , Insoon Yang

When analyzing parametric statistical models, a useful approach consists in modeling geometrically the parameter space. However, even for very simple and commonly used hierarchical models like statistical mixtures or stochastic deep neural…

Machine Learning · Computer Science 2021-12-08 Pascal Mattia Esser , Frank Nielsen

In this paper, we use the optimization formulation of nonlinear Kalman filtering and smoothing problems to develop second-order variants of iterated Kalman smoother (IKS) methods. We show that Newton's method corresponds to a recursion over…

Signal Processing · Electrical Eng. & Systems 2023-06-16 Fatemeh Yaghoobi , Hany Abdulsamad , Simo Särkkä

State estimation that combines observational data with mathematical models is central to many applications and is commonly addressed through filtering methods, such as ensemble Kalman filters. In this article, we examine the signal-tracking…

Numerical Analysis · Mathematics 2025-09-08 Nazanin Abedini , Jana de Wiljes , Svetlana Dubinkina

A computationally efficient method for online joint state inference and dynamical model learning is presented. The dynamical model combines an a priori known, physically derived, state-space model with a radial basis function expansion…

Systems and Control · Electrical Eng. & Systems 2021-07-12 Anton Kullberg , Isaac Skog , Gustaf Hendeby

Standard maximum likelihood or Bayesian approaches to parameter estimation for stochastic differential equations are not robust to perturbations in the continuous-in-time data. In this paper, we give a rather elementary explanation of this…

Numerical Analysis · Mathematics 2023-12-20 Sebastian Reich

We derive a novel, provably robust, and closed-form Bayesian update rule for online filtering in state-space models in the presence of outliers and misspecified measurement models. Our method combines generalised Bayesian inference with…