English
Related papers

Related papers: Lasso type classifiers with a reject option

200 papers

We study sequential testing for a binary disease outcome when risk follows an unknown logistic model. At each round, the decision maker may either pay for a test revealing the true label or predict the outcome based on patient features and…

Machine Learning · Computer Science 2026-05-05 Tavor Z. Baharav , Spyros Dragazis , Aldo Pacchiano

This paper is devoted to model selection in logistic regression. We extend the model selection principle introduced by Birg\'e and Massart (2001) to logistic regression model. This selection is done by using penalized maximum likelihood…

Statistics Theory · Mathematics 2015-09-01 Marius Kwemou , Marie-Luce Taupin , Anne-Sophie Tocquet

Ordinal data are quite common in applied statistics. Although some model selection and regularization techniques for categorical predictors and ordinal response models have been developed over the past few years, less work has been done…

Methodology · Statistics 2024-07-26 Aisouda Hoshiyar , Laura H. Gertheiss , Jan Gertheiss

We study the behavior of linear discriminant functions for binary classification in the infinite-imbalance limit, where the sample size of one class grows without bound while the sample size of the other remains fixed. The coefficients of…

Machine Learning · Statistics 2023-05-15 Paul Glasserman , Mike Li

We consider the problem of $n$-class classification ($n\geq 2$), where the classifier can choose to abstain from making predictions at a given cost, say, a factor $\alpha$ of the cost of misclassification. Designing consistent algorithms…

Machine Learning · Computer Science 2015-05-18 Harish G. Ramaswamy , Ambuj Tewari , Shivani Agarwal

We analyze general model selection procedures using penalized empirical loss minimization under computational constraints. While classical model selection approaches do not consider computational aspects of performing model selection, we…

Machine Learning · Statistics 2012-08-02 Alekh Agarwal , Peter L. Bartlett , John C. Duchi

Noisy pairwise comparison feedback has been incorporated to improve the overall query complexity of interactively learning binary classifiers. The \textit{positivity comparison oracle} is used to provide feedback on which is more likely to…

Machine Learning · Computer Science 2020-10-29 Zhenghang Cui , Issei Sato

Probabilistic classifiers are central for making informed decisions under uncertainty. Based on the maximum expected utility principle, optimal decision rules can be derived using the posterior class probabilities and misclassification…

Machine Learning · Computer Science 2025-03-25 Alexandre Perez-Lebel , Gael Varoquaux , Sanmi Koyejo , Matthieu Doutreligne , Marine Le Morvan

We have compiled a catalogue of eclipsing variable stars, the largest catalogue, containing classified eclipsing binaries. A procedure for the classification of eclipsing binaries, based on the catalogued data, is also developed. It was…

Solar and Stellar Astrophysics · Physics 2013-06-20 Oleg Malkov , Ekaterina Avvakumova

Most classification methods provide either a prediction of class membership or an assessment of class membership probability. In the case of two-group classification the predicted probability can be described as "risk" of belonging to a…

Machine Learning · Statistics 2011-10-28 Yizhar Toren

This article investigates unsupervised classification techniques for categorical multivariate data. The study employs multivariate multinomial mixture modeling, which is a type of model particularly applicable to multilocus genotypic data.…

Statistics Theory · Mathematics 2014-03-11 Dominique Bontemps , Wilson Toussile

Selection of important covariates and to drop the unimportant ones from a high-dimensional regression model is a long standing problem and hence have received lots of attention in the last two decades. After selecting the correct model, it…

Statistics Theory · Mathematics 2019-09-17 Debraj Das , Arindam Chatterjee , S. N. Lahiri

We propose a new approach, along with refinements, based on $L_1$ penalties and aimed at jointly estimating several related regression models. Its main interest is that it can be rewritten as a weighted lasso on a simple transformation of…

Methodology · Statistics 2014-11-07 Edouard Ollier , Vivian Viallon

We propose a penalized likelihood method to fit the linear discriminant analysis model when the predictor is matrix valued. We simultaneously estimate the means and the precision matrix, which we assume has a Kronecker product…

Machine Learning · Statistics 2016-10-31 Aaron J. Molstad , Adam J. Rothman

We present a new approach for mitigating unfairness in learned classifiers. In particular, we focus on binary classification tasks over individuals from two populations, where, as our criterion for fairness, we wish to achieve similar false…

Machine Learning · Computer Science 2018-03-09 Yahav Bechavod , Katrina Ligett

Binary classification is one of the most common problem in machine learning. It consists in predicting whether a given element belongs to a particular class. In this paper, a new algorithm for binary classification is proposed using a…

Machine Learning · Computer Science 2019-03-12 Alexandre Quemy

The number of possible methods of generalizing binary classification to multi-class classification increases exponentially with the number of class labels. Often, the best method of doing so will be highly problem dependent. Here we present…

Machine Learning · Statistics 2014-05-20 Peter Mills

In this work, we introduce a modified (rescaled) likelihood for imbalanced logistic regression. This new approach makes easier the use of exponential priors and the computation of lasso regularization path. Precisely, we study a limiting…

Methodology · Statistics 2018-04-19 Vincent Runge

Counterfactual learning from observational data involves learning a classifier on an entire population based on data that is observed conditioned on a selection policy. This work considers this problem in an active setting, where the…

Machine Learning · Statistics 2019-10-29 Songbai Yan , Kamalika Chaudhuri , Tara Javidi

Emerging applications of sensor networks for detection sometimes suggest that classical problems ought be revisited under new assumptions. This is the case of binary hypothesis testing with independent - but not necessarily identically…

Information Theory · Computer Science 2019-03-27 Stefano Marano , Peter Willett