English
Related papers

Related papers: Optimal Robust Exact Differentiation via Linear Ad…

200 papers

Despite decades of research and recent progress in adaptive control and reinforcement learning, there remains a fundamental lack of understanding in designing controllers that provide robustness to inherent non-asymptotic uncertainties…

Machine Learning · Computer Science 2021-08-13 Benjamin Gravell , Tyler Summers

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

Machine Learning · Computer Science 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

Learning with label dependent label noise has been extensively explored in both theory and practice; however, dealing with instance (i.e., feature) and label dependent label noise continues to be a challenging task. The difficulty arises…

Machine Learning · Statistics 2023-06-07 Hyungki Im , Paul Grigas

It is well known that exact notions of model abstraction and reduction for dynamical systems may not be robust enough in practice because they are highly sensitive to the specific choice of parameters. In this paper we consider this problem…

Systems and Control · Computer Science 2018-07-19 Luca Cardelli , Mirco Tribastone , Max Tschaikowski , Andrea Vandin

For linear systems, many data-driven control methods rely on the behavioral framework, using historical data of the system to predict the future trajectories. However, measurement noise introduces errors in predictions. When the noise is…

Optimization and Control · Mathematics 2023-08-29 Baiwei Guo , Yuning Jiang , Colin N. Jones , Giancarlo Ferrari-Trecate

This paper presents an adaptive causal discrete-time filter for derivative estimation, exemplified by its use in estimating relative velocity in a mechatronic application. The filter is based on a constrained least squares estimator with…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Alexey Pavlov , Michael Ruderman

Linear Least Squares is a very well known technique for parameter estimation, which is used even when sub-optimal, because of its very low computational requirements and the fact that exact knowledge of the noise statistics is not required.…

Statistics Theory · Mathematics 2018-10-16 Michael Krikheli , Amir Leshem

We obtain robust and computationally efficient estimators for learning several linear models that achieve statistically optimal convergence rate under minimal distributional assumptions. Concretely, we assume our data is drawn from a…

Machine Learning · Statistics 2020-12-07 Ainesh Bakshi , Adarsh Prasad

In practice, the data distribution at test time often differs, to a smaller or larger extent, from that of the original training data. Consequentially, the so-called source classifier, trained on the available labelled data, deteriorates on…

Machine Learning · Statistics 2021-06-18 Wouter M. Kouw , Marco Loog

In this article we consider the nonparametric robust estimation problem for regression models in continuous time with semi-Markov noises observed in discrete time moments. An adaptive model selection procedure is proposed. A sharp…

Statistics Theory · Mathematics 2020-05-15 Vlad Stefan Barbu , Slim Beltaief , Serguei Pergamenshchikov

Prediction via deterministic continuous-time models will always be subject to model error, for example due to unexplainable phenomena, uncertainties in any data driving the model, or discretisation/resolution issues. In this paper, we build…

Dynamical Systems · Mathematics 2025-06-30 Liam Blake , John Maclean , Sanjeeva Balasuriya

The doubly robust (DR) estimator, which consists of two nuisance parameters, the conditional mean outcome and the logging policy (the probability of choosing an action), is crucial in causal inference. This paper proposes a DR estimator for…

Machine Learning · Computer Science 2021-06-22 Masahiro Kato , Shota Yasui , Kenichiro McAlinn

We study the problem of high-dimensional robust linear regression where a learner is given access to $n$ samples from the generative model $Y = \langle X,w^* \rangle + \epsilon$ (with $X \in \mathbb{R}^d$ and $\epsilon$ independent), in…

This paper proposes a resilient state estimator for LTI discrete-time systems. The dynamic equation of the system is assumed to be affected by a bounded process noise. As to the available measurements, they are potentially corrupted by a…

Systems and Control · Electrical Eng. & Systems 2024-09-23 Alexandre Kircher , Laurent Bako , Eric Blanco , Mohamed Benallouch

We analyze the performance of a data-assimilation algorithm based on a linear feedback control when used with observational data that contains measurement errors. Our model problem consists of dynamics governed by the two-dimension…

Analysis of PDEs · Mathematics 2015-06-19 Hakima Bessaih , Eric Olson , E. S. Titi

We consider the problem of mean estimation assuming only finite variance. We study a new class of mean estimators constructed by integrating over random noise applied to a soft-truncated empirical mean estimator. For appropriate choices of…

Statistics Theory · Mathematics 2019-06-26 Matthew J. Holland

This paper deals with the design of discrete-time algorithms for the robust filtering differentiator. Two discrete-time realizations of the filtering differentiator are introduced. The first one, which is based on an exact discretization of…

Systems and Control · Electrical Eng. & Systems 2019-11-22 J. E. Carvajal-Rubio , J. D. Sánchez-Torres , M. Defoort , A. G. Loukianov

End-to-end engineering design pipelines, in which designs are evaluated using concurrently defined optimal controllers, are becoming increasingly common in practice. To discover designs that perform well even under the misspecification of…

Systems and Control · Electrical Eng. & Systems 2025-10-10 Yash Patel , Sahana Rayan , Ambuj Tewari

Linear Least Squares is a very well known technique for parameter estimation, which is used even when sub-optimal, because of its very low computational requirements and the fact that exact knowledge of the noise statistics is not required.…

Signal Processing · Electrical Eng. & Systems 2017-11-01 Michael Krikheli , Amir Leshem

There exist several methods developed for the canonical change point problem of detecting multiple mean shifts, which search for changes over sections of the data at multiple scales. In such methods, estimation of the noise level is often…

Methodology · Statistics 2022-11-07 Euan T. McGonigle , Haeran Cho