English
Related papers

Related papers: Numerically Robust Fixed-Point Smoothing Without S…

200 papers

State-space smoothing has found many applications in science and engineering. Under linear and Gaussian assumptions, smoothed estimates can be obtained using efficient recursions, for example Rauch-Tung-Striebel and Mayne-Fraser algorithms.…

Optimization and Control · Mathematics 2016-09-27 A. Y. Aravkin , J. V. Burke , L. Ljung , A. Lozano , G. Pillonetto

We propose a principled algorithm for robust Bayesian filtering and smoothing in nonlinear stochastic dynamic systems when both the transition function and the measurement function are described by non-parametric Gaussian process (GP)…

Systems and Control · Computer Science 2012-08-13 Marc Peter Deisenroth , Ryan Turner , Marco F. Huber , Uwe D. Hanebeck , Carl Edward Rasmussen

Smoothing algorithms for state-space models, i.e., fixed-interval smoothing, fixed-lag smoothing, and two-filter formula for smoothing, are examined using real examples. For linear and Gaussian state-space models, it is observed that…

Computation · Statistics 2023-07-10 G. Kitagawa

This work aims to solve a stochastic nonconvex nonsmooth composite optimization problem. Previous works on composite optimization problem requires the major part to satisfy Lipschitz smoothness or some relaxed smoothness conditions, which…

Optimization and Control · Mathematics 2025-10-07 Ziyi Chen , Peiran Yu , Heng Huang

This paper presents a method for calculating the smoothed state distribution for Jump Markov Linear Systems. More specifically, the paper details a novel two-filter smoother that provides closed-form expressions for the smoothed hybrid…

Methodology · Statistics 2020-04-21 Mark P. Balenzuela , Adrian G. Wills , Christopher Renton , Brett Ninness

Deploying machine learning systems in the real world requires both high accuracy on clean data and robustness to naturally occurring corruptions. While architectural advances have led to improved accuracy, building robust models remains…

Machine Learning · Computer Science 2019-06-07 Raphael Gontijo Lopes , Dong Yin , Ben Poole , Justin Gilmer , Ekin D. Cubuk

State-space models are used in a wide range of time series analysis formulations. Kalman filtering and smoothing are work-horse algorithms in these settings. While classic algorithms assume Gaussian errors to simplify estimation, recent…

Optimization and Control · Mathematics 2018-07-02 Jonathan Jonker , Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto , Sarah Webster

The growing prevalence of nonsmooth optimization problems in machine learning has spurred significant interest in generalized smoothness assumptions. Among these, the (L0, L1)-smoothness assumption has emerged as one of the most prominent.…

Optimization and Control · Mathematics 2026-02-24 Zhirayr Tovmasyan , Grigory Malinovsky , Laurent Condat , Peter Richtárik

This paper presents a comprehensive analysis of a broad range of variations of the stochastic proximal point method (SPPM). Proximal point methods have attracted considerable interest owing to their numerical stability and robustness…

Optimization and Control · Mathematics 2024-05-28 Peter Richtárik , Abdurakhmon Sadiev , Yury Demidovich

We propose a new algorithm that finds an $\varepsilon$-approximate fixed point of a smooth function from the $n$-dimensional $\ell_2$ unit ball to itself. We use the general framework of finding approximate solutions to a variational…

Computer Science and Game Theory · Computer Science 2025-01-22 Idan Attias , Yuval Dagan , Constantinos Daskalakis , Rui Yao , Manolis Zampetakis

This paper addresses stochastic optimization of Lipschitz-continuous, nonsmooth and nonconvex objectives over compact convex sets, where only noisy function evaluations are available. While gradient-free methods have been developed for…

Optimization and Control · Mathematics 2025-08-26 Anik Kumar Paul , Shalabh Bhatnagar

This paper considers approximate smoothing for discretely observed non-linear stochastic differential equations. The problem is tackled by developing methods for linearising stochastic differential equations with respect to an arbitrary…

Methodology · Statistics 2019-01-21 Filip Tronarp , Simo Särkkä

This article proposes numerically robust algorithms for Gaussian state estimation with singular observation noise. Our approach combines a series of basis changes with Bayes' rule, transforming the singular estimation problem into a…

Methodology · Statistics 2025-03-14 Nicholas Krämer , Filip Tronarp

Randomized smoothing is a widely adopted technique for optimizing nonsmooth objective functions. However, its efficiency analysis typically relies on global Lipschitz continuity, a condition rarely met in practical applications. To address…

Optimization and Control · Mathematics 2025-09-10 Jingfan Xia , Zhenwei Lin , Qi Deng

Probabilistic smoothing is a standard tool for global optimization, but existing methods rely on Gaussian kernels and specific transforms, often resulting in strong hyperparameter sensitivity and limited robustness. We propose a general…

Machine Learning · Computer Science 2026-05-27 Kukyoung Jang , Taehyun Cho , Junrui Zhang , Ping Xu , Kyungjae Lee

Quantum state smoothing is a technique for assigning a valid quantum state to a partially observed dynamical system, using measurement records both prior and posterior to an estimation time. We show that the technique is greatly simplified…

Quantum Physics · Physics 2025-09-09 Kiarn T. Laverick , Areeya Chantasri , Howard M. Wiseman

This work introduces the Gaussian integration to address a smoothing problem of a nonlinear stochastic state space model. The probability densities of states at each time instant are assumed to be Gaussian, and their means and covariances…

Signal Processing · Electrical Eng. & Systems 2025-01-14 Rohit Kumar Singh , Kundan Kumar , Shovan Bhaumik

A linear Gaussian state-space smoothing algorithm is presented for estimation of derivatives from a sequence of noisy measurements. The algorithm uses numerically stable square-root formulas, can handle simultaneous independent measurements…

Methodology · Statistics 2016-10-17 Robert Piche

We use a rank one Gaussian perturbation to derive a smooth stochastic approximation of the maximum eigenvalue function. We then combine this smoothing result with an optimal smooth stochastic optimization algorithm to produce an efficient…

Optimization and Control · Mathematics 2014-03-05 Alexandre d'Aspremont , Noureddine El Karoui

In this paper, we consider the estimation of a change-point for possibly high-dimensional data in a Gaussian model, using a k-means method. We prove that, up to a logarithmic term, this change-point estimator has a minimax rate of…

Statistics Theory · Mathematics 2018-02-22 Aurélie Fischer , Dominique Picard
‹ Prev 1 2 3 10 Next ›