English
Related papers

Related papers: Optimal Ridge Detection using Coverage Risk

200 papers

We propose a new approach for the problem of relative depth estimation from a single image. Instead of directly regressing over depth scores, we formulate the problem as estimation of a probability distribution over depth and aim to learn…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Alican Mertan , Yusuf Huseyin Sahin , Damien Jade Duff , Gozde Unal

The ever-growing size of the datasets renders well-studied learning techniques, such as Kernel Ridge Regression, inapplicable, posing a serious computational challenge. Divide-and-conquer is a common remedy, suggesting to split the dataset…

Machine Learning · Statistics 2021-05-25 Valeriy Avanesov

The density ratio is an important metric for evaluating the relative likelihood of two probability distributions, with extensive applications in statistics and machine learning. However, existing estimation theories for density ratios often…

Machine Learning · Statistics 2025-04-03 Shuntuo Xu , Zhou Yu , Jian Huang

In recent years, there has been a significant growth in research focusing on minimum $\ell_2$ norm (ridgeless) interpolation least squares estimators. However, the majority of these analyses have been limited to an unrealistic regression…

Statistics Theory · Mathematics 2024-06-14 Sungyoon Lee , Sokbae Lee

In reliability and life testing studies, the topic of estimating hazard rate has received great attention in recent years since an estimate of hazard rate is a quite useful tool for making decisions. Some works have included nonparametric…

Statistics Theory · Mathematics 2012-05-24 Baris Surucu

In this article we propose a general class of risk measures which can be used for data based evaluation of parametric models. The loss function is defined as generalized quadratic distance between the true density and the proposed model.…

Statistics Theory · Mathematics 2007-10-02 Surajit Ray , Bruce G. Lindsay

Failure detection (FD) in AI systems is a crucial safeguard for the deployment for safety-critical tasks. The common evaluation method of FD performance is the Risk-coverage (RC) curve, which reveals the trade-off between the data coverage…

Artificial Intelligence · Computer Science 2023-08-08 Shuang Ao , Stefan Rueger , Advaith Siddharthan

Ridge regression is a popular method for dense least squares regularization. In this work, ridge regression is studied in the context of VAR model estimation and inference. The implications of anisotropic penalization are discussed and a…

Methodology · Statistics 2024-06-21 Giovanni Ballarin

Multiple raters are often needed to be used interchangeably in practice for measurement or evaluation. Assessing agreement among these multiple raters via agreement indices are necessary before their participation. While the intuitively…

Methodology · Statistics 2020-06-09 Tongrong Wang , Huiman X. Barnhart

Unlike the ordinary least-squares (OLS) estimator for the linear model, a ridge regression linear model provides coefficient estimates via shrinkage, usually with improved mean-square and prediction error. This is true especially when the…

Methodology · Statistics 2015-06-25 George Karabatsos

Kernel ridge regression is used to approximate the kinetic energy of non-interacting fermions in a one-dimensional box as a functional of their density. The properties of different kernels and methods of cross-validation are explored, and…

In this work, we propose a mean-squared error-based risk that enables the comparison and optimization of estimators of squared calibration errors in practical settings. Improving the calibration of classifiers is crucial for enhancing the…

Machine Learning · Computer Science 2025-02-24 Sebastian G. Gruber , Francis Bach

Bandwidth selection is crucial in the kernel estimation of density level sets. A risk based on the symmetric difference between the estimated and true level sets is usually used to measure their proximity. In this paper we provide an…

Statistics Theory · Mathematics 2020-01-01 Wanli Qiao

We establish a profound connection between coherent risk measures, a prominent object in quantitative finance, and uniform integrability, a fundamental concept in probability theory. Instead of working with absolute values of random…

Risk Management · Quantitative Finance 2025-04-08 Muqiao Huang , Ruodu Wang

In this work, we propose new objective functions to train deep neural network based density ratio estimators and apply it to a change point detection problem. Existing methods use linear combinations of kernels to approximate the density…

Machine Learning · Computer Science 2019-05-27 Haidar Khan , Lara Marcuse , Bülent Yener

Managing insurance and financial risk when data is limited is a key task in the insurance industry. In this paper, we focus on cases where the risk distribution is modeled as a mixture with some components estimable to high precision or…

Optimization and Control · Mathematics 2026-03-03 N. D. Shyamalkumar , Tianrun Wang

Non-linear aggregation strategies have recently been proposed in response to the problem of how to combine, in a non-linear way, estimators of the regression function (see for instance \cite{biau:16}), classification rules (see…

Statistics Theory · Mathematics 2018-12-24 Alejandro Cholaquidis , Ricardo Fraiman , Badih Ghattas , Juan Kalemkerian

We establish optimal convergence rates for a decomposition-based scalable approach to kernel ridge regression. The method is simple to describe: it randomly partitions a dataset of size N into m subsets of equal size, computes an…

Statistics Theory · Mathematics 2014-05-01 Yuchen Zhang , John C. Duchi , Martin J. Wainwright

A Two-Stage approach enables researchers to make optimal non-linear predictions via Generalized Ridge Regression using models that contain two or more x-predictor variables and make only realistic minimal assumptions. The optimal regression…

Methodology · Statistics 2023-07-11 Robert L. Obenchain

We propose a risk measurement approach for a risk-averse stochastic problem. We provide results that guarantee that our problem has a solution. We characterize and explore the properties of the argmin as a risk measure and the minimum as a…

Risk Management · Quantitative Finance 2023-05-09 Marcelo Brutti Righi , Fernanda Maria Müller , Marlon Ruoso Moresco