English
Related papers

Related papers: Unbiased Parameter Estimation via DREM with Annihi…

200 papers

Estimating conditional dependence graphs and precision matrices are some of the most common problems in modern statistics and machine learning. When data are fully observed, penalized maximum likelihood-type estimators have become standard…

Machine Learning · Statistics 2019-04-09 Roger Fan , Byoungwook Jang , Yuekai Sun , Shuheng Zhou

The scope of this research is a problem of the direct model reference adaptive control of linear time-invariant multi-input multi-output (MIMO) plants without any a priori knowledge about system matrices. To handle it, a new method is…

Systems and Control · Electrical Eng. & Systems 2023-03-29 Anton Glushchenko , Konstantin Lastochkin

We study a class of iterated empirical risk minimization (ERM) procedures in which two successive ERMs are performed on the same dataset, and the predictions of the first estimator enter as an argument in the loss function of the second.…

Machine Learning · Statistics 2026-02-02 Hugo Cui , Yue M. Lu

In this paper we consider trajectory tracking problem for robotic systems affected by unknown external perturbations. Considering possible solutions, we restrict our attention to composite adaptation, which, particularly, ensures parametric…

Systems and Control · Electrical Eng. & Systems 2024-07-01 Anton Glushchenko , Konstantin Lastochkin

Unbiased estimators are introduced for averaged Bregman divergences which generalize Stein's Unbiased (Predictive) Risk Estimator, and the minimization of these estimators is proposed as a regularization parameter selection method for…

Numerical Analysis · Mathematics 2021-11-22 Elias S. Helou , Sandra A. Santos , Lucas E. A. Simões

The paper extends a recently proposed indirect, certainty-equivalence, event-triggered adaptive control scheme to the case of non-observable parameters. The extension is achieved by using a novel Batch Least-Squares Identifier (BaLSI),…

Optimization and Control · Mathematics 2018-11-28 Iasson Karafyllis , Maria Kontorinaki , Miroslav Krstic

A procedure for asymptotic bias reduction of maximum likelihood estimates of generic estimands is developed. The estimator is realized as a plug-in estimator, where the parameter maximizes the penalized likelihood with a penalty function…

Statistics Theory · Mathematics 2024-03-26 Masayo Y. Hirose , Shuhei Mano

This paper suggests parametrically transformed nested error regression models (TNERM), which transform the data flexibly to follow the normal linear mixed regression. We provide a procedure for estimating consistently the parameters of the…

Methodology · Statistics 2018-03-14 Shonosuke Sugasawa , Tatsuya Kubokawa

We consider discrete linear Chebyshev approximation problems in which the unknown parameters of linear function are fitted by minimizing the maximum absolute deviation of errors. Such problems find application in the solution of…

Optimization and Control · Mathematics 2020-12-22 Nikolai Krivulin

The density ratio model (DRM) provides a flexible and useful platform for combining information from multiple sources. In this paper, we consider statistical inference under two-sample DRMs with additional parameters defined through and/or…

Statistics Theory · Mathematics 2021-03-01 Meng Yuan , Pengfei Li , Changbao Wu

This paper describes recursive algorithms for state estimation of linear dynamical systems when measurements are noisy with unknown bias and/or outliers. For situations with noisy and biased measurements, algorithms are proposed that…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Krishan Mohan Nagpal

Unsupervised anomaly detection (AD) is a challenging task in realistic applications. Recently, there is an increasing trend to detect anomalies with deep neural networks (DNN). However, most popular deep AD detectors cannot protect the…

Machine Learning · Computer Science 2022-05-31 Shaoshen Wang , Yanbin Liu , Ling Chen , Chengqi Zhang

We develop a novel and general framework for reduced-bias $M$-estimation from asymptotically unbiased estimating functions. The framework relies on an empirical approximation of the bias by a function of derivatives of estimating function…

Methodology · Statistics 2023-08-11 Ioannis Kosmidis , Nicola Lunardon

This article discusses a generalization of the 1-dimensional multi-reference alignment problem. The goal is to recover a hidden signal from many noisy observations, where each noisy observation includes a random translation and random…

Signal Processing · Electrical Eng. & Systems 2021-07-06 Matthew Hirn , Anna Little

Control systems are inevitably affected by external disturbances, and a major objective of the control design is to attenuate or eliminate their adverse effects on the system performance. This paper presents a disturbance rejection approach…

Systems and Control · Electrical Eng. & Systems 2020-07-30 Zhitao Li , Amin Vahidi-Moghaddam , Hamidreza Modares , Jinsheng Sun

This paper deals with the trajectory tracking control problem for a class of bilinear systems with unmeasurable states and unknown parameters. Firstly, a full-information controller is suggested that guarantees global tracking under a…

Systems and Control · Electrical Eng. & Systems 2023-09-06 Amir Reza Zare , Mahdi Aliyari shoorehdeli , Mehdi Tavan , Kamran Sabahi

The dynamic regressor extension and mixing procedure is employed to redesign a conventional adaptive observer algorithm for affine systems. A reduced-order observer is designed without the construction of the state transition matrix. The…

Systems and Control · Electrical Eng. & Systems 2025-02-05 Mehdi Tavan

In this work we consider the unbiased estimation of expectations w.r.t.~probability measures that have non-negative Lebesgue density, and which are known point-wise up-to a normalizing constant. We focus upon developing an unbiased method…

Computation · Statistics 2023-08-17 Hamza Ruzayqat , Neil K. Chada , Ajay Jasra

This paper studies the properties of debiased machine learning (DML) estimators under a novel asymptotic framework, offering insights for improving the performance of these estimators in applications. DML is an estimation method suited to…

Econometrics · Economics 2024-11-05 Amilcar Velez

Most identification laws of unknown parameters of linear regression equations (LRE) ensure only boundedness of a parametric error in the presence of additive perturbations, which is almost always unacceptable for practical scenarios. In…

Systems and Control · Electrical Eng. & Systems 2024-02-05 Anton Glushchenko , Konstantin Lastochkin