English
Related papers

Related papers: On State Estimation with Bad Data Detection

200 papers

This paper presents two schemes to jointly estimate parameters and states of discrete-time nonlinear systems in the presence of bounded disturbances and noise and where the parameters belong to a known compact set. The schemes are based on…

Optimization and Control · Mathematics 2022-03-23 T. J. Meijer , V. S. Dolk , M. S. Chong , R. Postoyan , B. de Jager , D. Nešić , W. P. M. H. Heemels

In this article, we consider the problem of outlier-robust state estimation where the measurement noise can be correlated. Outliers in data arise due to many reasons like sensor malfunctioning, environmental behaviors, communication…

Signal Processing · Electrical Eng. & Systems 2024-08-21 Aamir Hussain Chughtai , Muhammad Tahir , Momin Uppal

This note addresses the question of optimally estimating a linear functional of an object acquired through linear observations corrupted by random noise, where optimality pertains to a worst-case setting tied to a symmetric, convex, and…

Statistics Theory · Mathematics 2023-08-01 Simon Foucart , Grigoris Paouris

Line spectral estimation theory aims to estimate the off-the-grid spectral components of a time signal with optimal precision. Recent results have shown that it is possible to recover signals having sparse line spectra from few temporal…

Information Theory · Computer Science 2017-01-31 Maxime Ferreira Da Costa , Wei Dai

In order to leverage the full power of quantum noise squeezing with unavoidable decoherence, a complete understanding of the degradation in the purity of squeezed light is demanded. By implementing machine learning architecture with a…

Data attacks on state estimation modify part of system measurements such that the tempered measurements cause incorrect system state estimates. Attack techniques proposed in the literature often require detailed knowledge of system…

Cryptography and Security · Computer Science 2015-06-19 Jinsub Kim , Lang Tong , Robert J. Thomas

Literatures in state space models focus on parametric inference and prediction, which fail if the state space model is not fully specified and the maximum likelihood estimation does not work. In this paper, we assume the state transition…

Statistics Theory · Mathematics 2020-12-15 Yunyi Zhang , Tingting Wang , Dimitris N. Politis

Estimating conditional dependence graphs and precision matrices are some of the most common problems in modern statistics and machine learning. When data are fully observed, penalized maximum likelihood-type estimators have become standard…

Machine Learning · Statistics 2019-04-09 Roger Fan , Byoungwook Jang , Yuekai Sun , Shuheng Zhou

State estimation that combines observational data with mathematical models is central to many applications and is commonly addressed through filtering methods, such as ensemble Kalman filters. In this article, we examine the signal-tracking…

Numerical Analysis · Mathematics 2025-09-08 Nazanin Abedini , Jana de Wiljes , Svetlana Dubinkina

This technical note considers the identification of nonlinear discrete-time systems with additive process noise but without measurement noise. In particular, we propose a method and its associated algorithm to identify the system nonlinear…

Optimization and Control · Mathematics 2015-04-27 Wei Pan , Ye Yuan , Jorge Gonçalves , Guy-Bart Stan

Fault analysis and bad data are often processed in separate manners. In this paper it is proved that fault as well as bad current measurement data can be modeled as control failure for the power transmission network and any fault on the…

Signal Processing · Electrical Eng. & Systems 2018-10-26 Zhenyu Tan , Yu Liu , Hongbo Sun , Bai Cui

Compressed Sensing suggests that the required number of samples for reconstructing a signal can be greatly reduced if it is sparse in a known discrete basis, yet many real-world signals are sparse in a continuous dictionary. One example is…

Information Theory · Computer Science 2015-07-24 Yuanxin Li , Yuejie Chi

We consider the problem of the recovery of a k-sparse vector from compressed linear measurements when data are corrupted by a quantization noise. When the number of measurements is not sufficiently large, different $k$-sparse solutions may…

Optimization and Control · Mathematics 2019-09-10 Vito Cerone , Sophie M. Fosson , Diego Regruto

Four-dimensional weak-constraint variational data assimilation estimates a state given partial noisy observations and dynamical model by minimizing a cost function that takes into account both discrepancy between the state and observations…

Dynamical Systems · Mathematics 2023-04-13 Nazanin Abedini , Svetlana Dubinkina

Although the standard formulations of prediction problems involve fully-observed and noiseless data drawn in an i.i.d. manner, many applications involve noisy and/or missing data, possibly involving dependence, as well. We study these…

Statistics Theory · Mathematics 2015-03-19 Po-Ling Loh , Martin J. Wainwright

Errors in the representation of clouds in convection-permitting numerical weather prediction models can be introduced by different sources. These can be the forcing and boundary conditions, the representation of orography, the accuracy of…

Atmospheric and Oceanic Physics · Physics 2022-03-14 Stefanie Legler , Tijana Janjic

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

Statistics Theory · Mathematics 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

Additive regression provides an extension of linear regression by modeling the signal of a response as a sum of functions of covariates of relatively low complexity. We study penalized estimation in high-dimensional nonparametric additive…

Statistics Theory · Mathematics 2017-04-25 Zhiqiang Tan , Cun-Hui Zhang

We consider computationally-efficient estimation of population parameters when observations are subject to missing data. In particular, we consider estimation under the realizable contamination model of missing data in which an $\epsilon$…

Statistics Theory · Mathematics 2026-03-18 Kabir Aladin Verchand , Ankit Pensia , Saminul Haque , Rohith Kuditipudi

Most practical data science problems encounter missing data. A wide variety of solutions exist, each with strengths and weaknesses that depend upon the missingness-generating process. Here we develop a theoretical framework for training and…

Machine Learning · Computer Science 2022-11-15 Jahan C. Penny-Dimri , Christoph Bergmeir , Julian Smith