English
Related papers

Related papers: Fundamental Laws of Binary Classification

200 papers

We develop a new approach to solving classification problems, which is bases on the theory of coherent measures of risk and risk sharing ideas. The proposed approach aims at designing a risk-averse classifier. The new approach allows for…

Machine Learning · Statistics 2018-07-24 Constantine Vitt , Darinka Dentcheva , Hui Xiong

In this work, we study a new approach to optimizing the margin distribution realized by binary classifiers. The classical approach to this problem is simply maximization of the expected margin, while more recent proposals consider…

Machine Learning · Statistics 2018-10-12 Matthew J. Holland

Algorithmic fairness has become a central concern in modern machine learning and AI applications. However, two pressing challenges remain: (1) The fairness guarantees of existing methods often rely on specific data distributional…

Methodology · Statistics 2026-05-14 Xiaotian Hou , Linjun Zhang

Multiple binary responses arise in many modern data-analytic problems. Although fitting separate logistic regressions for each response is computationally attractive, it ignores shared structure and can be statistically inefficient,…

Machine Learning · Statistics 2026-01-14 The Tien Mai

Two proteins are homologous if they have a common evolutionary origin, and the binary classification problem is to identify proteins in a candidate set that are homologous to a particular native protein. The feature (explanatory) variables…

Machine Learning · Statistics 2019-09-11 Jabed H Tomal , William J Welch , Ruben H Zamar

The regression function is one of the key objects of binary classification, since it not only determines a Bayes optimal classifier, hence, defines an optimal decision boundary, but also encodes the conditional distribution of the output…

Machine Learning · Statistics 2025-06-03 Ambrus Tamás , Balázs Csanád Csáji

The goal of binary classification is to estimate a discriminant function $\gamma$ from observations of covariate vectors and corresponding binary labels. We consider an elaboration of this problem in which the covariates are not available…

Statistics Theory · Mathematics 2009-09-29 XuanLong Nguyen , Martin J. Wainwright , Michael I. Jordan

A particularly important substructure in modeling joint linear chance-constrained programs with random right-hand sides and finite sample space is the intersection of mixing sets with common binary variables (and possibly a knapsack…

Optimization and Control · Mathematics 2021-06-30 Fatma Kılınç-Karzan , Simge Küçükyavuz , Dabeen Lee

Binary classification is a task that involves the classification of data into one of two distinct classes. It is widely utilized in various fields. However, conventional classifiers tend to make overconfident predictions for data that…

Machine Learning · Computer Science 2025-03-13 Shoma Yokura , Akihisa Ichiki

The concept of a minimax classifier is well-established in statistical decision theory, but its implementation via neural networks remains challenging, particularly in scenarios with imbalanced training data having a limited number of…

Machine Learning · Computer Science 2026-01-07 Hansung Choi , Daewon Seo

The study of a machine learning problem is in many ways is difficult to separate from the study of the loss function being used. One avenue of inquiry has been to look at these loss functions in terms of their properties as scoring rules…

Machine Learning · Computer Science 2022-09-02 Zac Cranko , Robert C. Williamson , Richard Nock

In this paper we suggest two statistical hypothesis tests for the regression function of binary classification based on conditional kernel mean embeddings. The regression function is a fundamental object in classification as it determines…

Machine Learning · Statistics 2022-06-22 Ambrus Tamás , Balázs Csanád Csáji

Logistic regression is a commonly used building block in ecological modeling, but its additive structure among environmental predictors often assumes compensatory relationships between predictors, which can lead to problematic results. In…

Quantitative Methods · Quantitative Biology 2023-02-21 Hongliang Bu , Yunyi Shen

We study losses for binary classification and class probability estimation and extend the understanding of them from margin losses to general composite losses which are the composition of a proper loss with a link function. We characterise…

Machine Learning · Statistics 2009-12-18 Mark D. Reid , Robert C. Williamson

Minimizing divergence measures under a constraint is an important problem. We derive a sufficient condition that binary divergence measures provide lower bounds for symmetric divergence measures under a given triangular discrimination or…

Information Theory · Computer Science 2022-11-11 Tomohiro Nishiyama

Binary neural networks leverage $\mathrm{Sign}$ function to binarize weights and activations, which require gradient estimators to overcome its non-differentiability and will inevitably bring gradient errors during backpropagation. Although…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Yefei He , Luoming Zhang , Weijia Wu , Hong Zhou

Binary classification based on predicted probabilities (scores) is a fundamental task in supervised machine learning. While thresholding scores is Bayes-optimal in the unconstrained setting, using a single threshold generally violates…

Machine Learning · Computer Science 2026-02-10 Etam Benger , Katrina Ligett

A central problem in business concerns the optimal allocation of limited resources to a set of available tasks, where the payoff of these tasks is inherently uncertain. In credit card fraud detection, for instance, a bank can only assign a…

Machine Learning · Computer Science 2022-02-10 Toon Vanderschueren , Bart Baesens , Tim Verdonck , Wouter Verbeke

A bifurcation is a qualitative change in a family of solutions to an equation produced by varying parameters. In contrast to the local bifurcations of dynamical systems that are often related to a change in the number or stability of…

Symplectic Geometry · Mathematics 2018-05-11 Robert I McLachlan , Christian Offen

The structure of data organization is widely recognized as having a substantial influence on the efficacy of machine learning algorithms, particularly in binary classification tasks. Our research provides a theoretical framework suggesting…

Machine Learning · Computer Science 2024-07-15 Fei Jing , Zi-Ke Zhang , Yi-Cheng Zhang , Qingpeng Zhang