English
Related papers

Related papers: Outlier-Robust Linear System Identification Under …

200 papers

This paper studies the distributed optimization problem under the influence of heavy-tailed gradient noises. Here, a heavy-tailed noise means that the noise does not necessarily satisfy the bounded variance assumption. Instead, it satisfies…

Optimization and Control · Mathematics 2025-05-12 Chao Sun , Huiming Zhang , Bo Chen , Li Yu

The identification of a linear system model from data has wide applications in control theory. The existing work that provides finite sample guarantees for linear system identification typically uses data from a single long system…

Machine Learning · Statistics 2025-05-09 Lei Xin , Baike She , Qi Dou , George Chiu , Shreyas Sundaram

Gaussian process regression in its most simplified form assumes normal homoscedastic noise and utilizes analytically tractable mean and covariance functions of predictive posterior distribution using Gaussian conditioning. Its…

Applications · Statistics 2023-01-20 Pooja Algikar , Lamine Mili

Real-world datasets usually are class-imbalanced and corrupted by label noise. To solve the joint issue of long-tailed distribution and label noise, most previous works usually aim to design a noise detector to distinguish the noisy and…

Machine Learning · Computer Science 2024-04-11 Zhuo Li , He Zhao , Zhen Li , Tongliang Liu , Dandan Guo , Xiang Wan

State estimation or filtering serves as a fundamental task to enable intelligent decision-making in applications such as autonomous vehicles, robotics, healthcare monitoring, smart grids, intelligent transportation, and predictive…

Machine Learning · Computer Science 2025-06-16 Aamir Hussain Chughtai

It has been shown that some macroeconomic time series, especially those where outliers could be present, can be well modelled using heavy tailed distributions for the noise components. Methods for deciding when and where heavy-tailed models…

Statistics Theory · Mathematics 2007-06-13 J. A. D. Aston

We present an algorithm for distributed estimation of an unknown vector parameter $\boldsymbol{\theta}^\ast \in {\mathbb R}^M$ in the presence of heavy-tailed observation and communication noises. Heavy-tailed noises frequently appear,…

Information Theory · Computer Science 2026-03-24 Dragana Bajovic , Dusan Jakovetic , Soummya Kar , Manojlo Vukovic

We consider the modeling, stability analysis and controller design problems for discrete-time LTI systems with state feedback, when the actuation signal is subject to switching propagation delays, due to e.g. the routing in a multi-hop…

Optimization and Control · Mathematics 2014-01-09 R. M. Jungers , A. D'Innocenzo , M. D. Di Benedetto

This paper considers a single-trajectory system identification problem for linear systems under general nonlinear and/or time-varying policies with i.i.d. random excitation noises. The problem is motivated by safe learning-based control for…

Optimization and Control · Mathematics 2023-06-21 Yingying Li , Tianpeng Zhang , Subhro Das , Jeff Shamma , Na Li

We investigate high-dimensional sparse regression when both the noise and the design matrix exhibit heavy-tailed behavior. Standard algorithms typically fail in this regime, as heavy-tailed covariates distort the empirical risk geometry. We…

Methodology · Statistics 2026-01-12 Kaiyuan Zhou , Xiaoyu Zhang , Wenyang Zhang , Di Wang

Most existing works on optimal filtering of linear time-invariant (LTI) stochastic systems with arbitrary unknown inputs assume perfect knowledge of the covariances of the noises in the filter design. This is impractical and raises the…

Optimization and Control · Mathematics 2022-09-16 He Kong , Salah Sukkarieh , Travis J. Arnold , Tianshi Chen , Biqiang Mu , Wei Xing Zheng

We propose statistically robust and computationally efficient linear learning methods in the high-dimensional batch setting, where the number of features $d$ may exceed the sample size $n$. We employ, in a generic learning setting, two…

Machine Learning · Statistics 2023-05-30 Ibrahim Merad , Stéphane Gaïffas

In this paper, we consider robust system identification under sparse outliers and random noises. In this problem, system parameters are observed through a Toeplitz matrix. All observations are subject to random noises and a few are…

Information Theory · Computer Science 2013-05-28 Weiyu Xu , Erwei Bai , Myung Cho

We study the problem of system identification for stochastic continuous-time dynamics, based on a single finite-length state trajectory. We present a method for estimating the possibly unstable open-loop matrix by employing properly…

Machine Learning · Statistics 2025-09-30 Reza Sadeghi Hafshejani , Mohamad Kazem Shirani Fradonbeh

High-dimensional linear regression is a fundamental tool in modern statistics, particularly when the number of predictors exceeds the sample size. The classical Lasso, which relies on the squared loss, performs well under Gaussian noise…

Methodology · Statistics 2025-06-10 The Tien Mai

We propose a novel numerical method for solving inverse problems subject to impulsive noises which possibly contain a large number of outliers. The approach is of Bayesian type, and it exploits a heavy-tailed t distribution for data noise…

Numerical Analysis · Mathematics 2015-05-30 Bangti Jin

Dynamical systems can confront one of two extreme types of disturbances: persistent zero-mean independent noise, and sparse nonzero-mean adversarial attacks, depending on the specific scenario being modeled. While mean-based estimators like…

Optimization and Control · Mathematics 2026-03-31 Jihun Kim , Javad Lavaei

We study the problem of outlier robust high-dimensional mean estimation under a finite covariance assumption, and more broadly under finite low-degree moment assumptions. We consider a standard stability condition from the recent robust…

Statistics Theory · Mathematics 2021-03-17 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia

We study stochastic dynamical systems in settings where only partial statistical information about the noise is available, e.g., in the form of a limited number of noise realizations. Such systems are particularly challenging to analyze and…

Optimization and Control · Mathematics 2023-04-06 Liviu Aolaritei , Nicolas Lanzetti , Florian Dörfler

In existing distributed stochastic optimization studies, it is usually assumed that the gradient noise has a bounded variance. However, recent research shows that the heavy-tailed noise, which allows an unbounded variance, is closer to…

Optimization and Control · Mathematics 2025-05-15 Jun Hu , Chao Sun , Bo Chen , Jianzheng Wang , Zheming Wang