English
Related papers

Related papers: Optimally (Distributional-)Robust Kalman Filtering

200 papers

This work introduces an algorithm for state estimation on manifolds within the framework of the Kalman filter. Its primary objective is to provide a methodology enabling the evaluation of the precision of existing Kalman filter variants…

Systems and Control · Electrical Eng. & Systems 2025-09-24 Svyatoslav Covanov , Cedric Pradalier

Learning in the presence of outliers is a fundamental problem in statistics. Until recently, all known efficient unsupervised learning algorithms were very sensitive to outliers in high dimensions. In particular, even for the task of robust…

Data Structures and Algorithms · Computer Science 2019-11-15 Ilias Diakonikolas , Daniel M. Kane

A robust estimator for a wide family of mixtures of linear regression is presented. Robustness is based on the joint adoption of the Cluster Weighted Model and of an estimator based on trimming and restrictions. The selected model provides…

Methodology · Statistics 2015-02-05 L. A. Garcia-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar

We introduce a trimmed version of the Hill estimator for the index of a heavy-tailed distribution, which is robust to perturbations in the extreme order statistics. In the ideal Pareto setting, the estimator is essentially finite-sample…

Methodology · Statistics 2018-08-24 Shrijita Bhattacharya , Michael Kallitsis , Stilian Stoev

Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training…

Machine Learning · Computer Science 2021-03-03 Yasaman Esfandiari , Aditya Balu , Keivan Ebrahimi , Umesh Vaidya , Nicola Elia , Soumik Sarkar

State-space models are used in a wide range of time series analysis formulations. Kalman filtering and smoothing are work-horse algorithms in these settings. While classic algorithms assume Gaussian errors to simplify estimation, recent…

Optimization and Control · Mathematics 2018-07-02 Jonathan Jonker , Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto , Sarah Webster

We employ the variational formulation and the Euler-Lagrange equations to study the steady-state error in linear non-causal estimators (smoothers). We give a complete description of the steady-state error for inputs that are polynomial in…

Optimization and Control · Mathematics 2008-02-04 D. Ezri , B. Z. Bobrovsky , Z. Schuss

We adapt a manifold sampling algorithm for the nonsmooth, nonconvex formulations of learning that arise when imposing robustness to outliers present in the training data. We demonstrate the approach on objectives based on trimmed loss.…

Optimization and Control · Mathematics 2018-07-10 Matt Menickelly , Stefan M. Wild

We consider the problem of robustly fitting a model to data that includes outliers by formulating a percentile optimization problem. This problem is non-smooth and non-convex, hence hard to solve. We derive properties that the minimizers of…

Signal Processing · Electrical Eng. & Systems 2024-05-16 João Domingos , João Xavier

Many modern datasets are collected automatically and are thus easily contaminated by outliers. This led to a regain of interest in robust estimation, including new notions of robustness such as robustness to adversarial contamination of the…

Statistics Theory · Mathematics 2023-05-05 Pierre Alquier , Mathieu Gerber

We consider a family of divergence-based minimax approaches to perform robust filtering. The mismodeling budget, or tolerance, is specified at each time increment of the model. More precisely, all possible model increments belong to a ball…

Optimization and Control · Mathematics 2016-10-11 Mattia Zorzi

The $k$-means is a popular clustering objective, although it is inherently non-robust and sensitive to outliers. Its popular seeding or initialization called $k$-means++ uses $D^{2}$ sampling and comes with a provable $O(\log k)$…

Machine Learning · Computer Science 2023-09-07 Amit Deshpande , Rameshwar Pratap

Regularization is a central tool for addressing ill-posedness in inverse problems and statistical estimation, with the choice of a suitable penalty often determining the reliability and interpretability of downstream solutions. While recent…

Optimization and Control · Mathematics 2025-10-07 Oscar Leong , Eliza O'Reilly , Yong Sheng Soh

Disturbance observers have been attracting continuing research efforts and are widely used in many applications. Among them, the Kalman filter-based disturbance observer is an attractive one since it estimates both the state and the…

Systems and Control · Electrical Eng. & Systems 2023-10-31 Shilei Li , Dawei Shi , Yunjiang Lou , Wulin Zou , Ling Shi

Contemporary data assimilation often involves millions of prediction variables. The classical Kalman filter is no longer computationally feasible in such a high dimensional context. This problem can often be resolved by exploiting the…

Statistics Theory · Mathematics 2016-06-30 Andrew J. Majda , Xin T. Tong

Optimal transport (OT) measures distances between distributions in a way that depends on the geometry of the sample space. In light of recent advances in computational OT, OT distances are widely used as loss functions in machine learning.…

Methodology · Statistics 2021-06-22 Debarghya Mukherjee , Aritra Guha , Justin Solomon , Yuekai Sun , Mikhail Yurochkin

In this paper, we investigate the design of statistically robust detectors for multi-input multi-output (MIMO) systems subject to imperfect channel state information (CSI). A robust maximum likelihood (ML) detection problem is formulated by…

Signal Processing · Electrical Eng. & Systems 2023-07-25 Yi Sun , Hong Shen , Wei Xu , Nan Hu , Chunming Zhao

Real-world network applications must cope with failing nodes, malicious attacks, or nodes facing corrupted data - data classified as outliers. Our work addresses these concerns in the scope of the sensor network localization problem where,…

Optimization and Control · Mathematics 2021-10-05 Claudia Soares , João Gomes

We consider the problem of distributed Kalman filtering for sensor networks in the case there is a limit in data transmission and there is model uncertainty. More precisely, we propose a distributed filtering strategy with event-triggered…

Optimization and Control · Mathematics 2022-05-18 Davide Ghion , Mattia Zorzi

Kalman filters constitute a scalable and robust methodology for approximate Bayesian inference, matching first and second order moments of the target posterior. To improve the accuracy in nonlinear and non-Gaussian settings, we extend this…

Statistics Theory · Mathematics 2024-09-04 L. Wang , N. Nüsken