English
Related papers

Related papers: Double Ramp Loss Based Reject Option Classifier

200 papers

In many supervised learning applications, the response consists of both continuous and binary outcomes. Studies have shown that jointly modeling such mixed-type responses can substantially improve predictive performance compared to separate…

Methodology · Statistics 2026-03-13 Yu Wang , Ran Jin , Lulu Kang

A fundamental challenge in machine learning is the choice of a loss as it characterizes our learning task, is minimized in the training phase, and serves as an evaluation criterion for estimators. Proper losses are commonly chosen, ensuring…

Machine Learning · Statistics 2026-03-04 Han Bao , Asuka Takatsu

Deep Learning has become interestingly popular in computer vision, mostly attaining near or above human-level performance in various vision tasks. But recent work has also demonstrated that these deep neural networks are very vulnerable to…

Machine Learning · Computer Science 2020-12-09 Shashi Kant Gupta

Regression via classification (RvC) is a common method used for regression problems in deep learning, where the target variable belongs to a set of continuous values. By discretizing the target into a set of non-overlapping classes, it has…

Machine Learning · Computer Science 2022-04-11 Axel Berg , Magnus Oskarsson , Mark O'Connor

This paper introduces a general multi-class approach to weakly supervised classification. Inferring the labels and learning the parameters of the model is usually done jointly through a block-coordinate descent algorithm such as…

Machine Learning · Computer Science 2012-07-03 Armand Joulin , Francis Bach

This paper considers various models of support vector machines with ramp loss, these being an efficient and robust tool in supervised classification for the detection of outliers. The exact solution approaches for the resulting optimization…

Optimization and Control · Mathematics 2024-03-13 Marta Baldomero-Naranjo , Luisa I. Martínez-Merino , Antonio M. Rodríguez-Chía

Conventional techniques for supervised classification constrain the classification rules considered and use surrogate losses for classification 0-1 loss. Favored families of classification rules are those that enjoy parametric…

Machine Learning · Statistics 2019-06-03 Santiago Mazuelas , Andrea Zanoni , Aritz Perez

In medical image processing, accurate diagnosis is of paramount importance. Leveraging machine learning techniques, particularly top-rank learning, shows significant promise by focusing on the most crucial instances. However, challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiaotong Ji , Ryoma Bise , Seiichi Uchida

We analyze continual learning on a sequence of separable linear classification tasks with binary labels. We show theoretically that learning with weak regularization reduces to solving a sequential max-margin problem, corresponding to a…

Machine Learning · Computer Science 2023-06-07 Itay Evron , Edward Moroshko , Gon Buzaglo , Maroun Khriesh , Badea Marjieh , Nathan Srebro , Daniel Soudry

Regularized empirical risk minimization with constrained labels (in contrast to fixed labels) is a remarkably general abstraction of learning. For common loss and regularization functions, this optimization problem assumes the form of a…

Machine Learning · Computer Science 2016-02-23 Iaroslav Shcherbatyi , Bjoern Andres

Bilevel programs are optimization problems where some variables are solutions to optimization problems themselves, and they arise in a variety of control applications, including: control of vehicle traffic networks, inverse reinforcement…

Optimization and Control · Mathematics 2017-09-27 Aurélien Ouattara , Anil Aswani

Modern machine learning algorithms perform poorly on adversarially manipulated data. Adversarial risk quantifies the error of classifiers in adversarial settings; adversarial classifiers minimize adversarial risk. In this paper, we analyze…

Machine Learning · Computer Science 2020-12-24 Muni Sreenivas Pydi , Varun Jog

Most of object detection algorithms can be categorized into two classes: two-stage detectors and one-stage detectors. Recently, many efforts have been devoted to one-stage detectors for the simple yet effective architecture. Different from…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Qi Qian , Lei Chen , Hao Li , Rong Jin

We study the low rank regression problem $\my = M\mx + \epsilon$, where $\mx$ and $\my$ are $d_1$ and $d_2$ dimensional vectors respectively. We consider the extreme high-dimensional setting where the number of observations $n$ is less than…

Data Structures and Algorithms · Computer Science 2020-10-27 Qiong Wu , Felix Ming Fai Wong , Zhenming Liu , Yanhua Li , Varun Kanade

We consider supervised learning problems in which set predictions provide explicit uncertainty estimates. Using Choquet integrals (a.k.a. Lov{\'a}sz extensions), we propose a convex loss function for nondecreasing subset-valued functions…

Machine Learning · Computer Science 2025-12-23 Francis Bach

Despite the enormous success of machine learning models in various applications, most of these models lack resilience to (even small) perturbations in their input data. Hence, new methods to robustify machine learning models seem very…

Machine Learning · Computer Science 2020-10-30 Fariborz Salehi , Babak Hassibi

Multi-label ranking maps instances to a ranked set of predicted labels from multiple possible classes. The ranking approach for multi-label learning problems received attention for its success in multi-label classification, with one of the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Emine Dari , V. Bugra Yesilkaynak , Alican Mertan , Gozde Unal

The problem of multiple endpoint testing for k endpoints is treated as a 2^k finite action problem. The loss function chosen is a vector loss function consisting of two components. The two components lead to a vector risk. One component of…

Statistics Theory · Mathematics 2007-06-13 Arthur Cohen , Harold B. Sackrowitz

It has been reported that deep learning models are extremely vulnerable to small but intentionally chosen perturbations of its input. In particular, a deep network, despite its near-optimal accuracy on the clean images, often mis-classifies…

Machine Learning · Computer Science 2022-03-16 A. Tuan Nguyen , Ser Nam Lim , Philip Torr

The real-world data is often susceptible to label noise, which might constrict the effectiveness of the existing state of the art algorithms for ordinal regression. Existing works on ordinal regression do not take label noise into account.…

Machine Learning · Computer Science 2020-01-28 Bhanu Garg , Naresh Manwani