English
Related papers

Related papers: Minimax Lower Bounds for Cost Sensitive Classifica…

200 papers

Understanding the fundamental limits of robust supervised learning has emerged as a problem of immense interest, from both practical and theoretical standpoints. In particular, it is critical to determine classifier-agnostic bounds on the…

Machine Learning · Computer Science 2021-06-08 Arjun Nitin Bhagoji , Daniel Cullina , Vikash Sehwag , Prateek Mittal

The goal of strategic classification is to learn decision rules which are robust to strategic input manipulation. Earlier works assume that these responses are known; while some recent works handle unknown responses, they exclusively study…

Machine Learning · Computer Science 2024-06-24 Elan Rosenfeld , Nir Rosenfeld

While progress has been made in understanding the robustness of machine learning classifiers to test-time adversaries (evasion attacks), fundamental questions remain unresolved. In this paper, we use optimal transport to characterize the…

Machine Learning · Computer Science 2019-11-01 Arjun Nitin Bhagoji , Daniel Cullina , Prateek Mittal

This paper deals with the binary classification task when the target class has the lower probability of occurrence. In such situation, it is not possible to build a powerful classifier by using standard methods such as logistic regression,…

Machine Learning · Statistics 2015-02-26 Cheikh Ndour , Aliou Diop , Simplice Dossou-Gbété

The softmax representation of probabilities for categorical variables plays a prominent role in modern machine learning with numerous applications in areas such as large scale classification, neural language modeling and recommendation…

Machine Learning · Statistics 2016-11-01 Michalis K. Titsias

Many real-world combinatorial problems involve uncertain parameters, which can be predicted given contextual features and historical data. These `predict-then-optimize' or `contextual optimization' problems have gained significant…

Machine Learning · Computer Science 2026-05-19 Noah Schutte , Senne Berden , Tias Guns , Krzysztof Postek , Neil Yorke-Smith

In supervised event detection, most of the mislabeling occurs between a small number of confusing type pairs, including trigger-NIL pairs and sibling sub-types of the same coarse type. To address this label confusion problem, this paper…

Computation and Language · Computer Science 2019-06-17 Hongyu Lin , Yaojie Lu , Xianpei Han , Le Sun

Intrusion Detection is an invaluable part of computer networks defense. An important consideration is the fact that raising false alarms carries a significantly lower cost than not detecting at- tacks. For this reason, we examine how…

Cryptography and Security · Computer Science 2008-07-15 Aikaterini Mitrokotsa , Christos Dimitrakakis , Christos Douligeris

Cost-sensitive learning relies on the availability of a known and fixed cost matrix. However, in some scenarios, the cost matrix is uncertain during training, and re-train a classifier after the cost matrix is specified would not be an…

Machine Learning · Computer Science 2012-09-11 Rui Wang , Ke Tang

This work focuses on a specific classification problem, where the information about a sample is not readily available, but has to be acquired for a cost, and there is a per-sample budget. Inspired by real-world use-cases, we analyze average…

Machine Learning · Computer Science 2020-03-05 Jaromír Janisch , Tomáš Pevný , Viliam Lisý

In this paper we study a class of risk-sensitive Markovian control problems in discrete time subject to model uncertainty. We consider a risk-sensitive discounted cost criterion with finite time horizon. The used methodology is the one of…

Optimization and Control · Mathematics 2021-04-15 Tomasz R. Bielecki , Tao Chen , Igor Cialenco

We introduce a minorization-maximization approach to optimizing common measures of discovery significance in high energy physics. The approach alternates between solving a weighted binary classification problem and updating class weights in…

Machine Learning · Statistics 2015-09-11 Lester Mackey , Jordan Bryan , Man Yue Mo

Minimal cost feature selection is devoted to obtain a trade-off between test costs and misclassification costs. This issue has been addressed recently on nominal data. In this paper, we consider numerical data with measurement errors and…

Artificial Intelligence · Computer Science 2013-06-04 Hong Zhao , Fan Min , William Zhu

Here we propose a general theoretical method for analyzing the risk bound in the presence of adversaries. Specifically, we try to fit the adversarial learning problem into the minimax framework. We first show that the original adversarial…

Machine Learning · Statistics 2019-01-25 Zhuozhuo Tu , Jingwei Zhang , Dacheng Tao

We consider a standard binary classification problem. The performance of any binary classifier based on the training data is characterized by the excess risk. We study Bahadur's type exponential bounds on the minimax accuracy confidence…

Machine Learning · Statistics 2011-11-29 N. I. Pentacaput

Classification is a well-studied machine learning task which concerns the assignment of instances to a set of outcomes. Classification models support the optimization of managerial decision-making across a variety of operational business…

Machine Learning · Computer Science 2025-05-19 Wouter Verbeke , Diego Olaya , Jeroen Berrevoets , Sam Verboven , Sebastián Maldonado

We address the problem of algorithmic fairness: ensuring that sensitive variables do not unfairly influence the outcome of a classifier. We present an approach based on empirical risk minimization, which incorporates a fairness constraint…

Machine Learning · Statistics 2020-02-03 Michele Donini , Luca Oneto , Shai Ben-David , John Shawe-Taylor , Massimiliano Pontil

We present a bound for value-prediction error with respect to model misspecification that is tight, including constant factors. This is a direct improvement of the "simulation lemma," a foundational result in reinforcement learning. We…

Machine Learning · Computer Science 2024-10-28 Sam Lobel , Ronald Parr

We consider a problem of risk estimation for large-margin multi-class classifiers. We propose a novel risk bound for the multi-class classification problem. The bound involves the marginal distribution of the classifier and the Rademacher…

Machine Learning · Statistics 2021-09-15 Yury Maximov , Daria Reshetova

Random cost simulations were introduced as a method to investigate optimization problems in systems with conflicting constraints. Here I study the approach in connection with the training of a feed-forward multilayer perceptron, as used in…

High Energy Physics - Phenomenology · Physics 2009-10-28 Bernd A. Berg