English
Related papers

Related papers: $L_1$-Based Adaptive Identification with Saturated…

200 papers

We consider both $\ell _{0}$-penalized and $\ell _{0}$-constrained quantile regression estimators. For the $\ell _{0}$-penalized estimator, we derive an exponential inequality on the tail probability of excess quantile prediction risk and…

Methodology · Statistics 2023-03-30 Le-Yu Chen , Sokbae Lee

This paper studies the estimation of network weights for a class of systems with binary-valued observations. In these systems only quantized observations are available for the network estimation. Furthermore, system states are coupled with…

Systems and Control · Computer Science 2019-03-19 Yu Xing , Xingkang He , Haitao Fang , Karl Henrik Johansson

We propose a post-hoc adaptive conformal anomaly detection method for monitoring time series that leverages predictions from pre-trained foundation models without requiring additional fine-tuning. Our method yields an interpretable anomaly…

Machine Learning · Computer Science 2026-04-23 Natalia Martinez Gil , Fearghal O'Donncha , Wesley M. Gifford , Nianjun Zhou , Dhaval C. Patel , Roman Vaculin

Targeted maximum likelihood estimation is a general methodology combining flexible ensemble learning and semiparametric efficiency theory in a two-step procedure for estimation of causal parameters. Proposed targeted maximum likelihood…

Methodology · Statistics 2021-06-22 Helene Charlotte Wiese Rytgaard , Frank Eriksson , Mark van der Laan

The tuning parameter selection strategy for penalized estimation is crucial to identify a model that is both interpretable and predictive. However, popular strategies (e.g., minimizing average squared prediction error via cross-validation)…

Methodology · Statistics 2022-11-10 Julia Holter , Jonathan Stallrich

Exponentially stable extended adaptive observer is proposed for a class of linear time-invariant systems with unknown parameters and overparameterization. It allows one to reconstruct unmeasured states and bounded external disturbance…

Systems and Control · Electrical Eng. & Systems 2023-01-19 Anton Glushchenko , Konstantin Lastochkin

Linear regression is arguably the most prominent among statistical inference methods, popular both for its simplicity as well as its broad applicability. On par with data-intensive applications, the sheer size of linear regression problems…

Applications · Statistics 2016-06-29 Dimitris Berberidis , Vassilis Kekatos , Georgios B. Giannakis

In this paper, we propose sparsity-aware data-selective adaptive filtering algorithms with adjustable penalties. Prior work incorporates a penalty function into the cost function used in the optimization that originates the algorithms to…

Data Structures and Algorithms · Computer Science 2017-08-08 André Flores , Rodrigo C. de Lamare

Imitation learning has gained immense popularity because of its high sample-efficiency. However, in real-world scenarios, where the trajectory distribution of most of the tasks dynamically shifts, model fitting on continuously aggregated…

Machine Learning · Computer Science 2023-07-04 Kiran Lekkala , Sami Abu-El-Haija , Laurent Itti

The accelerated failure time model has garnered attention due to its intuitive linear regression interpretation and has been successfully applied in fields such as biostatistics, clinical medicine, economics, and social sciences. This paper…

Methodology · Statistics 2025-02-19 Peili Li , Ruoying Hu , Yanyun Ding , Yunhai Xiao

This paper introduces an assumption-lean method that constructs valid and efficient lower predictive bounds (LPBs) for survival times with censored data. We build on recent work by Cand\`es et al. (2021), whose approach first subsets the…

Methodology · Statistics 2023-11-08 Yu Gui , Rohan Hore , Zhimei Ren , Rina Foygel Barber

Recently, high dimensional vector auto-regressive models (VAR), have attracted a lot of interest, due to novel applications in the health, engineering and social sciences. The presence of temporal dependence poses additional challenges to…

Statistics Theory · Mathematics 2022-09-20 Sagnik Halder , George Michailidis

Many recent developments in the high-dimensional statistical time series literature have centered around time-dependent applications that can be adapted to regularized least squares. Of particular interest is the lasso, which both serves to…

Methodology · Statistics 2020-10-16 William B. Nicholson , Xiaohan Yan

We derive asymptotic properties of penalized estimators for singular models for which identifiability may break and the true parameter values can lie on the boundary of the parameter space. Selection consistency of the estimators is also…

Statistics Theory · Mathematics 2023-01-24 Junichiro Yoshida , Nakahiro Yoshida

We consider adaptive decision-making problems where an agent optimizes a cumulative performance objective by repeatedly choosing among a finite set of options. Compared to the classical prediction-with-expert-advice set-up, we consider…

Machine Learning · Computer Science 2023-04-10 Michael Muehlebach

Conformal inference is a statistical method used to construct prediction sets for point predictors, providing reliable uncertainty quantification with probability guarantees. This method utilizes historical labeled data to estimate the…

Machine Learning · Computer Science 2024-11-05 Xiaoyi Su , Zhixin Zhou , Rui Luo

In this paper we study the compressed sensing problem of recovering a sparse signal from a system of underdetermined linear equations when we have prior information about the probability of each entry of the unknown signal being nonzero. In…

Information Theory · Computer Science 2009-01-20 M. Amin Khajehnejad , Weiyu Xu , Salman Avestimehr , Babak Hassibi

Problem of adaptive state observer synthesis for linear time-varying (LTV) system with unknown time-varying parameter and delayed output measurements is considered. State observation problem has attracted the attention of many researchers…

Dynamical Systems · Mathematics 2022-07-26 Alexey Bobtsov , Nikolay Nikolaev , Olga Slita , Olga Kozachek

In this paper we revisit random linear under-determined systems with sparse solutions. We consider $\ell_1$ optimization heuristic known to work very well when used to solve these systems. A collection of fundamental results that relate to…

Optimization and Control · Mathematics 2016-12-20 Mihailo Stojnic

Making calibrated online predictions is a central challenge in modern AI systems. Much of the existing literature focuses on fully adversarial environments where outcomes may be arbitrary, leading to conservative algorithms that can perform…

Machine Learning · Computer Science 2026-05-25 Junyan Liu , Haipeng Luo , Lillian J. Ratliff