English
Related papers

Related papers: Exact and empirical estimation of misclassificatio…

200 papers

Some statistical models are specified via a data generating process for which the likelihood function cannot be computed in closed form. Standard likelihood-based inference is then not feasible but the model parameters can be inferred by…

Computation · Statistics 2015-02-20 Michael U. Gutmann , Jukka Corander , Ritabrata Dutta , Samuel Kaski

This work studies the statistical properties of the maximum penalized likelihood approach in a semi-parametric framework. We recall the penalized likelihood approach for estimating a function and review some asymptotic results. We…

Statistics Theory · Mathematics 2014-01-31 Daniel Commenges , Jérémie Bureau , Hein Putter

We investigate the problem of multiclass classification with rejection, where a classifier can choose not to make a prediction to avoid critical misclassification. First, we consider an approach based on simultaneous training of a…

Machine Learning · Statistics 2019-10-31 Chenri Ni , Nontawat Charoenphakdee , Junya Honda , Masashi Sugiyama

The optimality and sensitivity of the empirical risk minimization problem with relative entropy regularization (ERM-RER) are investigated for the case in which the reference is a sigma-finite measure instead of a probability measure. This…

Machine Learning · Computer Science 2022-11-15 Samir M. Perlaza , Gaetan Bisson , Iñaki Esnaola , Alain Jean-Marie , Stefano Rini

Being cautious is crucial for enhancing the trustworthiness of machine learning systems integrated into decision-making pipelines. Although calibrated probabilities help in optimal decision-making, perfect calibration remains unattainable,…

Machine Learning · Computer Science 2024-08-12 Mari-Liis Allikivi , Joonas Järve , Meelis Kull

The maximum likelihood approach is adapted to the problem of estimation of drift and diffusion functions of stochastic processes from measured time series. We reconcile a previously devised iterative procedure [Kleinhans et al., Physics…

Data Analysis, Statistics and Probability · Physics 2009-11-13 D. Kleinhans , R. Friedrich

In this paper, we investigate the label shift quantification problem. We propose robust estimators of the label distribution which turn out to coincide with the Maximum Likelihood Estimator. We analyze the theoretical aspects and derive…

Statistics Theory · Mathematics 2026-02-12 Alexandre Lecestre

We study the generation of prediction intervals in regression for uncertainty quantification. This task can be formalized as an empirical constrained optimization problem that minimizes the average interval width while maintaining the…

Machine Learning · Statistics 2021-03-01 Haoxian Chen , Ziyi Huang , Henry Lam , Huajie Qian , Haofeng Zhang

When considering d possibly dependent random variables, one is often interested in extreme risk regions, with very small probability p. We consider risk regions of the form ${\mathbf{z}\in\mathbb{R}^d:f(\mathbf{z})\leq\beta}$, where f is…

Statistics Theory · Mathematics 2012-11-26 Juan-Juan Cai , John H. J. Einmahl , Laurens de Haan

In reliability and life testing studies, the topic of estimating hazard rate has received great attention in recent years since an estimate of hazard rate is a quite useful tool for making decisions. Some works have included nonparametric…

Statistics Theory · Mathematics 2012-05-24 Baris Surucu

The objective of this work is to quantify the uncertainty in probability of failure estimates resulting from incomplete knowledge of the probability distributions for the input random variables. We propose a framework that couples the…

Methodology · Statistics 2021-10-26 Dimitris G. Giovanis , Michael Shields

For an unknown continuous distribution on a real line, we consider the approximate estimation by the discretization. There are two methods for the discretization. First method is to divide the real line into several intervals before taking…

Statistics Theory · Mathematics 2017-10-12 Yo Sheena

We consider estimation of conditional hazard functions and densities over the class of multivariate c\`adl\`ag functions with uniformly bounded sectional variation norm when data are either fully observed or subject to right-censoring. We…

Statistics Theory · Mathematics 2024-04-18 Anders Munch , Thomas A. Gerds , Mark J. van der Laan , Helene C. W. Rytgaard

Maximum likelihood estimation is a fundamental optimization problem in statistics. We study this problem on manifolds of matrices with bounded rank. These represent mixtures of distributions of two independent discrete random variables. We…

Algebraic Geometry · Mathematics 2013-03-19 Jonathan Hauenstein , Jose Rodriguez , Bernd Sturmfels

Point estimation of class prevalences in the presence of data set shift has been a popular research topic for more than two decades. Less attention has been paid to the construction of confidence and prediction intervals for estimates of…

Machine Learning · Statistics 2019-07-23 Dirk Tasche

In the same spirit as Tsybakov (2003), we define the optimality of an aggregation procedure in the problem of classification. Using an aggregate with exponential weights, we obtain an optimal rate of convex aggregation for the hinge risk…

Statistics Theory · Mathematics 2007-12-04 Guillaume Lecué

For personalized ranking models, the well-calibrated probability of an item being preferred by a user has great practical value. While existing work shows promising results in image classification, probability calibration has not been much…

Information Retrieval · Computer Science 2022-04-27 Wonbin Kweon , SeongKu Kang , Hwanjo Yu

Many classification applications require accurate probability estimates in addition to good class separation but often classifiers are designed focusing only on the latter. Calibration is the process of improving probability estimates by…

Machine Learning · Computer Science 2020-01-31 Tuomo Alasalmi , Jaakko Suutala , Heli Koskimäki , Juha Röning

Standard maximum-likelihood estimators for binary-star and exoplanet eccentricities are biased high, in the sense that the estimated eccentricity tends to be larger than the true eccentricity. As with most non-trivial observables, a simple…

Solar and Stellar Astrophysics · Physics 2011-01-19 David W. Hogg , Adam D. Myers , Jo Bovy

Calibration methods have been widely studied in survey sampling over the last decades. Viewing calibration as an inverse problem, we extend the calibration technique by using a maximum entropy method. Finding the optimal weights is achieved…

Methodology · Statistics 2009-09-23 Fabrice Gamboa , Jean-Michel Loubes , Paul Rochet