English
Related papers

Related papers: The Spectral Condition Number Plot for Regularizat…

200 papers

Traditional Statistical Process Control (SPC) is essential for quality management but is limited by its reliance on often violated statistical assumptions, leading to unreliable monitoring in modern, complex manufacturing environments. This…

Machine Learning · Computer Science 2025-12-30 Christopher Burger

Conformal Prediction methods have finite-sample distribution-free marginal coverage guarantees. However, they generally do not offer conditional coverage guarantees, which can be important for high-stakes decisions. In this paper, we…

Machine Learning · Statistics 2024-09-27 Ruijiang Gao , Mingzhang Yin , James McInerney , Nathan Kallus

A typical desideratum for quantifying the uncertainty from a classification model as a prediction set is class-conditional singleton set calibration. That is, such sets should map to the output of well-calibrated selective classifiers,…

Machine Learning · Computer Science 2022-12-02 Allen Schmaltz , Danielle Rasooly

We study the problem of approximation of 2D set of points. Such type of problems always occur in physical experiments, econometrics, data analysis and other areas. The often problems of outliers or spikes usually make researchers to apply…

Optimization and Control · Mathematics 2025-02-13 Majid E. Abbasov , Anna I. Belenok

We propose a one-step procedure to estimate the latent positions in random dot product graphs efficiently. Unlike the classical spectral-based methods such as the adjacency and Laplacian spectral embedding, the proposed one-step procedure…

Statistics Theory · Mathematics 2020-11-16 Fangzheng Xie , Yanxun Xu

The describing function method is a useful tool for the qualitative analysis of limit cycles in the stability analysis of nonlinear systems. This method is inherently approximate; therefore, it should be used for a fast qualitative analysis…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Davide Tebaldi , Roberto Zanasi

Ordinal scores occur commonly in medical imaging studies and in black-box forensic studies \citep{Phillips:2018}. To assess the accuracy of raters in the studies, one needs to estimate the receiver operating characteristic (ROC) curve while…

Applications · Statistics 2023-07-19 Ngoc-Ty Nguyen , P. Jonathon Phillips , Larry Tang

We present an analytic method for calculating spectral densities of empirical covariance matrices for correlated data. In this approach the data is represented as a rectangular random matrix whose columns correspond to sampled states of the…

Data Analysis, Statistics and Probability · Physics 2010-01-15 Zdzislaw Burda , Andrzej Goerlich , Bartlomiej Waclaw

High-dimensional predictive models, those with more measurements than observations, require regularization to be well defined, perform well empirically, and possess theoretical guarantees. The amount of regularization, often determined by…

Methodology · Statistics 2019-07-16 Darren Homrighausen , Daniel J. McDonald

In this paper we propose and discuss variance reduction techniques for the estimation of quantiles of the output of a complex model with random input parameters. These techniques are based on the use of a reduced model, such as a metamodel…

Methodology · Statistics 2009-01-27 Claire Cannamela , Josselin Garnier , Bertrand Iooss

Identifying the relevant variables for a classification model with correct confidence levels is a central but difficult task in high-dimension. Despite the core role of sparse logistic regression in statistics and machine learning, it still…

Machine Learning · Statistics 2022-05-31 Binh T. Nguyen , Bertrand Thirion , Sylvain Arlot

Quadratic discriminant analysis (QDA) is a widely used method for classification problems, particularly preferable over Linear Discriminant Analysis (LDA) for heterogeneous data. However, QDA loses its effectiveness in high-dimensional…

Machine Learning · Computer Science 2025-03-19 Wenya Luo , Hua Li , Zhidong Bai , Zhijun Liu

Consumer cameras, particularly onboard smartphones and UAVs, are now commonly used as scientific instruments. However, their data processing pipelines are not optimized for quantitative radiometry and their calibration is more complex than…

Instrumentation and Detectors · Physics 2019-06-25 Olivier Burggraaff , Norbert Schmidt , Jaime Zamorano , Klaas Pauly , Sergio Pascual , Carlos Tapia , Evangelos Spyrakos , Frans Snik

Probabilistic regression models trained with maximum likelihood estimation (MLE), can sometimes overestimate variance to an unacceptable degree. This is mostly problematic in the multivariate domain. While univariate models often optimize…

Artificial Intelligence · Computer Science 2024-09-24 Daan Roordink , Sibylle Hess

Heterogeneous treatment effect estimation in high-stakes applications demands models that simultaneously optimize precision, interpretability, and calibration. Many existing tree-based causal inference techniques, however, exhibit high…

Machine Learning · Computer Science 2025-04-21 Yichen Liu

We investigate joint spectral characteristics of a family of matrices $\mathcal F $, associated with products in the semigroup generated by $\mathcal F$. In the literature, extremal measures such as the well-known joint spectral radius and…

Dynamical Systems · Mathematics 2026-04-27 Francesco Paolo Maiale , Anastasiia Trofimova , Nicola Guglielmi

Estimation of covariance matrices or their inverses plays a central role in many statistical methods. For these methods to work reliably, estimated matrices must not only be invertible but also well-conditioned. In this paper we present an…

Methodology · Statistics 2014-08-06 Eric C. Chi , Kenneth Lange

Regularized regression has become very popular nowadays, particularly on high-dimensional problems where the addition of a penalty term to the log-likelihood allows inference where traditional methods fail. A number of penalties have been…

Methodology · Statistics 2021-02-15 Hamed Haselimashhadi , Veronica Vinciotti

In conditional copula models, the copula parameter is deterministically linked to a covariate via the calibration function. The latter is of central interest for inference and is usually estimated nonparametrically. However, when a…

Methodology · Statistics 2014-03-19 Elif F. Acar , Radu V. Craiu , Fang Yao

Power spectrum estimation is an important tool in many applications, such as the whitening of noise. The popular multitaper method enjoys significant success, but fails for short signals with few samples. We propose a statistical model…

Statistics Theory · Mathematics 2018-12-10 Joakim Andén , Amit Singer