English
Related papers

Related papers: Model selection in High-Dimensions: A Quadratic-ri…

200 papers

Conformal risk control is an extension of conformal prediction for controlling risk functions beyond miscoverage. The original algorithm controls the expected value of a loss that is monotonic in a one-dimensional parameter. Here, we…

Methodology · Statistics 2026-02-24 Anastasios N. Angelopoulos

As machine learning-based prediction systems are increasingly used in high-stakes situations, it is important to understand how such predictive models will perform upon deployment. Distribution-free uncertainty quantification techniques…

Machine Learning · Computer Science 2025-06-12 Jake C. Snell , Thomas L. Griffiths

The linear hazard regression model developed by Aalen is becoming an increasingly popular alternative to the Cox multiplicative hazard regression model. There are no methods in the literature for selecting among different candidate models…

Methodology · Statistics 2026-05-07 Nils Lid Hjort

The Akaike information criterion (AIC) is a model selection criterion widely used in practical applications. The AIC is an estimator of the log-likelihood expected value, and measures the discrepancy between the true model and the estimated…

Computation · Statistics 2017-02-03 Fábio M. Bayer , Francisco Cribari-Neto

This paper introduces an estimator of the relative directed distance between an estimated model and the true model, based on the Kulback-Leibler divergence and is motivated by the generalized information criterion proposed by Konishi and…

Methodology · Statistics 2014-03-06 Antonino Abbruzzo , Ivan Vujačić , Ernst Wit , Angelo M. Mineo

A general framework is that the estimators of a distribution are obtained by minimizing a function (the estimating function) and they are assessed through another function (the assessment function). The estimating and assessment functions…

Statistics Theory · Mathematics 2022-01-14 Daniel Commenges , Cécile Proust-Lima , Cécilia Samieri , Benoit Liquet

In segmented regression, when the regression function is continuous at the change-points that are the boundaries of the segments, it is also called joinpoint regression, and the analysis package developed by \cite{KimFFM00} has become a…

Methodology · Statistics 2025-06-11 Kazuki Nakajima , Yoshiyuki Ninomiya

Data-driven risk analysis involves the inference of probability distributions from measured or simulated data. In the case of a highly reliable system, such as the electricity grid, the amount of relevant data is often exceedingly limited,…

Methodology · Statistics 2017-07-11 Simon H. Tindemans , Goran Strbac

The fractal dimension curves of urban form and growth fall into two categories: One can be described by common logistic function, and the other can be described with quadratic logistic function. The approach to estimating the parameter of…

Physics and Society · Physics 2025-08-28 Yanguang Chen

Many evaluation metrics can be used to assess the performance of models in binary classification tasks. However, most of them are derived from a confusion matrix in a non-differentiable form, making it very difficult to generate a…

Machine Learning · Computer Science 2024-05-24 Doheon Han , Nuno Moniz , Nitesh V Chawla

In this paper, we present a unified framework for decision making under uncertainty. Our framework is based on the composite of two risk measures, where the inner risk measure accounts for the risk of decision given the exact distribution…

Optimization and Control · Mathematics 2015-01-07 Pengyu Qian , Zizhuo Wang , Zaiwen Wen

Regression models fitted to data can be assessed on their goodness of fit, though models with many parameters should be disfavored to prevent over-fitting. Statisticians' tools for this are little known to physical scientists. These include…

Methodology · Statistics 2013-05-28 Robert S. Maier

We introduce a nonparametric way to estimate the global probability density function for a random persistence diagram. Precisely, a kernel density function centered at a given persistence diagram and a given bandwidth is constructed. Our…

Statistics Theory · Mathematics 2018-03-14 Joshua Lee Mike , Vasileios Maroulas

While the Bayesian Information Criterion (BIC) and Akaike Information Criterion (AIC) are powerful tools for model selection in linear regression, they are built on different prior assumptions and thereby apply to different data generation…

Methodology · Statistics 2017-12-15 MB de Kock , HC Eggers

Intelligent diagnosis method based on data-driven and deep learning is an attractive and meaningful field in recent years. However, in practical application scenarios, the imbalance of time-series fault is an urgent problem to be solved.…

Machine Learning · Computer Science 2021-07-15 Xingtai Gui , Jiyang Zhang

Model-based component-wise gradient boosting is a popular tool for data-driven variable selection. In order to improve its prediction and selection qualities even further, several modifications of the original algorithm have been developed,…

Methodology · Statistics 2023-02-28 Sophie Potts , Elisabeth Bergherr , Constantin Reinke , Colin Griesbach

In this paper we propose a novel Bayesian methodology for Value-at-Risk computation based on parametric Product Partition Models. Value-at-Risk is a standard tool to measure and control the market risk of an asset or a portfolio, and it is…

Risk Management · Quantitative Finance 2009-05-15 Giacomo Bormetti , Maria Elena De Giuli , Danilo Delpini , Claudia Tarantola

Statistical modeling of experimental physical laws is based on the probability density function of measured variables. It is expressed by experimental data via a kernel estimator. The kernel is determined objectively by the scattering of…

Data Analysis, Statistics and Probability · Physics 2007-05-23 I. Grabec

In a previous article, a least square regression estimation procedure was proposed: first, we condiser a family of functions and study the properties of an estimator in every unidimensionnal model defined by one of these functions; we then…

Statistics Theory · Mathematics 2007-06-13 Pierre Alquier

We consider a general model for high-dimensional empirical risk minimization whereby the data $\mathbf{x}_i$ are $d$-dimensional Gaussian vectors, the model is parametrized by $\mathbf{\Theta}\in\mathbb{R}^{d\times k}$, and the loss depends…

Machine Learning · Statistics 2026-01-26 Kiana Asgari , Andrea Montanari , Basil Saeed