中文
相关论文

相关论文: An Analysis of Loss Functions for Binary Classific…

200 篇论文

In few-shot learning, typically, the loss function which is applied at test time is the one we are ultimately interested in minimising, such as the mean-squared-error loss for a regression problem. However, given that we have few samples at…

机器学习 · 计算机科学 2019-12-02 Leo Feng , Luisa Zintgraf , Bei Peng , Shimon Whiteson

Many problems in robotics, such as estimating the state from noisy sensor data or aligning two point clouds, can be posed and solved as least-squares problems. Unfortunately, vanilla nonminimal solvers for least-squares problems are…

机器人学 · 计算机科学 2024-07-31 Kyungmin Jung , Thomas Hitchcox , James Richard Forbes

While machine learning (ML) architectures have evolved rapidly to account for complex data, loss functions like cross-entropy remain mostly structure-agnostic in many real-world applications. However, the `class-symmetric' nature of these…

机器学习 · 计算机科学 2026-05-28 Yasser Taha , Grégoire Montavon , Nils Körber

The functional linear model is an important extension of the classical regression model allowing for scalar responses to be modeled as functions of stochastic processes. Yet, despite the usefulness and popularity of the functional linear…

统计方法学 · 统计学 2025-11-27 Ioannis Kalogridis , Stanislav Nagy

The logistic regression model is one of the most powerful statistical methods for the analysis of binary data. The logistic regression allows to use a set of covariates to explain the binary responses. The mixture of logistic regression…

统计方法学 · 统计学 2023-09-08 Elsayed Ghanem , Armin Hatefi , Hamid Usefi

Complex distributions of the healthcare expenditure pose challenges to statistical modeling via a single model. Super learning, an ensemble method that combines a range of candidate models, is a promising alternative for cost estimation and…

机器学习 · 统计学 2022-05-17 Ziyue Wu , David Benkeser

Cross-entropy is a widely used loss function in applications. It coincides with the logistic loss applied to the outputs of a neural network, when the softmax is used. But, what guarantees can we rely on when using cross-entropy as a…

机器学习 · 计算机科学 2023-06-21 Anqi Mao , Mehryar Mohri , Yutao Zhong

Logistic regression is a classical model for describing the probabilistic dependence of binary responses to multivariate covariates. We consider the predictive performance of the maximum likelihood estimator (MLE) for logistic regression,…

统计理论 · 数学 2026-02-20 Hugo Chardon , Matthieu Lerasle , Jaouad Mourtada

We present a series of new and more favorable margin-based learning guarantees that depend on the empirical margin loss of a predictor. We give two types of learning bounds, both distribution-dependent and valid for general families, in…

机器学习 · 计算机科学 2020-10-30 Corinna Cortes , Mehryar Mohri , Ananda Theertha Suresh

Van Rooyen et al. introduced a notion of convex loss functions being robust to random classification noise, and established that the "unhinged" loss function is robust in this sense. In this note we study the accuracy of binary classifiers…

机器学习 · 计算机科学 2022-03-07 Philip M. Long , Rocco A. Servedio

In this paper we suggest two statistical hypothesis tests for the regression function of binary classification based on conditional kernel mean embeddings. The regression function is a fundamental object in classification as it determines…

机器学习 · 统计学 2022-06-22 Ambrus Tamás , Balázs Csanád Csáji

Robust regression has attracted a great amount of attention in the literature recently, particularly for taking asymmetricity into account simultaneously and for high-dimensional analysis. However, the majority of research on the topics…

统计方法学 · 统计学 2023-07-25 Sanna Soomro , Keming Yu , Yan Yu

Function-on-function linear regression is important for understanding the relationship between the response and the predictor that are both functions. In this article, we propose a reproducing kernel Hilbert space approach to…

统计理论 · 数学 2021-09-29 Holger Dette , Jiajun Tang

The assessment of binary classifier performance traditionally centers on discriminative ability using metrics, such as accuracy. However, these metrics often disregard the model's inherent uncertainty, especially when dealing with sensitive…

机器学习 · 计算机科学 2024-02-13 Agathe Fernandes Machado , Arthur Charpentier , Emmanuel Flachaire , Ewen Gallic , François Hu

This manuscript studies statistical properties of linear classifiers obtained through minimization of an unregularized convex risk over a finite sample. Although the results are explicitly finite-dimensional, inputs may be passed through…

机器学习 · 计算机科学 2012-06-15 Matus Telgarsky

Multi-label classification is the task of assigning a subset of labels to a given query instance. For evaluating such predictions, the set of predicted labels needs to be compared to the ground-truth label set associated with that instance,…

机器学习 · 计算机科学 2020-11-03 Eyke Hüllermeier , Marcel Wever , Eneldo Loza Mencia , Johannes Fürnkranz , Michael Rapp

Elicitable functionals and (strictly) consistent scoring functions are of interest due to their utility of determining (uniquely) optimal forecasts, and thus the ability to effectively backtest predictions. However, in practice, assuming…

统计方法学 · 统计学 2026-03-18 Kathleen E. Miao , Silvana M. Pesenti

Asymptotic equivalence theory developed in the literature so far are only for bounded loss functions. This limits the potential applications of the theory because many commonly used loss functions in statistical inference are unbounded. In…

统计理论 · 数学 2009-09-03 T. Tony Cai , Harrison H. Zhou

One-class classification (OCC) aims to train a classifier only with the target class data and attracts great attention for its strong applicability in real-world application. Despite a lot of advances have been made in OCC, it still lacks…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Ziyang Jiang , Peng Lin , Tianlei Wang

For a set of binary response variables, conditional mean models characterize the expected value of a response variable given the others and are popularly applied in longitudinal and network data analyses. The quadratic exponential binary…

统计方法学 · 统计学 2025-10-02 Ong Wei Yong , Lee Shao-Man , Hsueh Chia-Ming , Chang Sheng-Mao