English
Related papers

Related papers: A Unified Framework for Estimation of High-dimensi…

200 papers

The ability to generalize to unseen domains is crucial for machine learning systems deployed in the real world, especially when we only have data from limited training domains. In this paper, we propose a simple and effective regularization…

Machine Learning · Computer Science 2023-12-06 Zhenmei Shi , Yifei Ming , Ying Fan , Frederic Sala , Yingyu Liang

In this paper we present a unified framework for solving a general class of problems arising in the context of set-membership estimation/identification theory. More precisely, the paper aims at providing an original approach for the…

Systems and Control · Computer Science 2016-11-18 Vito Cerone , Jean-Bernard Lasserre , Dario Piga , Diego Regruto

In this paper, we present a unified framework for decision making under uncertainty. Our framework is based on the composite of two risk measures, where the inner risk measure accounts for the risk of decision given the exact distribution…

Optimization and Control · Mathematics 2015-01-07 Pengyu Qian , Zizhuo Wang , Zaiwen Wen

Parameter estimation in structural dynamics generally involves inferring the values of physical, geometric, or even customized parameters based on first principles or expert knowledge, which is challenging for complex structural systems. In…

Computational Engineering, Finance, and Science · Computer Science 2025-04-08 Mingyuan Zhou , Haoze Song , Wenjing Ye , Wei Wang , Zhilu Lai

In this paper, we consider the problem of estimating parameters of a linear regression model. Using a hybrid systems framework, a hybrid algorithm is proposed allowing the estimate to converge to the exact value of the unknown parameters in…

Systems and Control · Electrical Eng. & Systems 2026-03-04 Adnane Saoud , Ryan S. Johnson , Ricardo G. Sanfelice

This paper introduces a novel nonparametric method for estimating high-dimensional dynamic covariance matrices with multiple conditioning covariates, leveraging random forests and supported by robust theoretical guarantees. Unlike…

Machine Learning · Statistics 2025-05-20 Shuguang Yu , Fan Zhou , Yingjie Zhang , Ziqi Chen , Hongtu Zhu

Rating procedure is crucial in many applied fields (e.g., educational, clinical, emergency). It implies that a rater (e.g., teacher, doctor) rates a subject (e.g., student, doctor) on a rating scale. Given raters variability, several…

Methodology · Statistics 2026-01-14 Giuseppe Mignemi , Ioanna Manolopoulou

Selecting hyperparameters for unsupervised learning problems is challenging in general due to the lack of ground truth for validation. Despite the prevalence of this issue in statistics and machine learning, especially in clustering…

Machine Learning · Statistics 2020-02-04 Xinjie Fan , Yuguang Yue , Purnamrita Sarkar , Y. X. Rachel Wang

In the framework of solid mechanics, the task of deriving material parameters from experimental data has recently re-emerged with the progress in full-field measurement capabilities and the renewed advances of machine learning. In this…

Computational Engineering, Finance, and Science · Computer Science 2026-01-27 Ulrich Römer , Stefan Hartmann , Jendrik-Alexander Tröger , David Anton , Henning Wessels , Moritz Flaschel , Laura De Lorenzis

We introduce the notion of heterogeneous calibration that applies a post-hoc model-agnostic transformation to model outputs for improving AUC performance on binary classification tasks. We consider overconfident models, whose performance is…

Machine Learning · Statistics 2022-02-11 David Durfee , Aman Gupta , Kinjal Basu

We study the high-dimensional linear regression problem with categorical predictors that have many levels. We propose a new estimation approach, which performs model compression via two mechanisms by simultaneously encouraging (a)…

Methodology · Statistics 2026-03-30 Kayhan Behdin , Riade Benbaki , Peter Radchenko , Rahul Mazumder

Prior knowledge on properties of a target model often come as discrete or combinatorial descriptions. This work provides a unified computational framework for defining norms that promote such structures. More specifically, we develop…

Machine Learning · Statistics 2019-04-11 Amin Jalali , Adel Javanmard , Maryam Fazel

Network structure is growing popular for capturing the intrinsic relationship between large-scale variables. In the paper we propose to improve the estimation accuracy for large-dimensional factor model when a network structure between…

Methodology · Statistics 2020-01-30 Long Yu , Yong He , Xinsheng Zhang , Ji Zhu

Conformal Prediction offers a powerful framework for quantifying uncertainty in machine learning models, enabling the construction of prediction sets with finite-sample validity guarantees. While easily adaptable to non-probabilistic…

Machine Learning · Statistics 2024-11-27 Eshant English , Christoph Lippert

We introduce a unified framework for random forest prediction error estimation based on a novel estimator of the conditional prediction error distribution function. Our framework enables simple plug-in estimation of key prediction…

Machine Learning · Statistics 2021-03-04 Benjamin Lu , Johanna Hardin

We propose a general framework for reduced-rank modeling of matrix-valued data. By applying a generalized nuclear norm penalty we can directly model low-dimensional latent variables associated with rows and columns. Our framework flexibly…

Machine Learning · Statistics 2017-08-23 William Fithian , Rahul Mazumder

Latent factor models that integrate data from multiple sources/studies or modalities have garnered considerable attention across various disciplines. However, existing methods predominantly focus either on multi-study integration or…

Methodology · Statistics 2025-07-15 Wei Liu , Qingzhi Zhong

To address the challenges of reliable statistical inference in high-dimensional models, we introduce the Synthetic-data Regularized Estimator (SRE). Unlike traditional regularization methods, the SRE regularizes the complex target model via…

Statistics Theory · Mathematics 2025-03-18 Weihao Li , Dongming Huang

This paper provides the relevant literature with a complete toolkit for conducting robust estimation and inference about the parameters of interest involved in a high-dimensional panel data framework. Specifically, (1) we allow for…

Econometrics · Economics 2025-02-13 Jiti Gao , Fei Liu , Bin Peng , Yayi Yan

In many applications, data can be heterogeneous in the sense of spanning latent groups with different underlying distributions. When predictive models are applied to such data the heterogeneity can affect both predictive performance and…

Machine Learning · Statistics 2022-05-04 Thomas Lartigue , Sach Mukherjee