English
Related papers

Related papers: Tradeoffs in Streaming Binary Classification under…

200 papers

The problem of class imbalance is extensive for focusing on numerous applications in the real world. In such a situation, nearly all of the examples are labeled as one class called majority class, while far fewer examples are labeled as the…

A rising topic in computational journalism is how to enhance the diversity in news served to subscribers to foster exploration behavior in news reading. Despite the success of preference learning in personalized news recommendation, their…

Machine Learning · Statistics 2017-07-03 Rikiya Takahashi , Shunan Zhang

Supervised learning from training data with imbalanced class sizes, a commonly encountered scenario in real applications such as anomaly/fraud detection, has long been considered a significant challenge in machine learning. Motivated by…

Machine Learning · Computer Science 2019-05-27 Yunru Liu , Tingran Gao , Haizhao Yang

In many application domains such as medicine, information retrieval, cybersecurity, social media, etc., datasets used for inducing classification models often have an unequal distribution of the instances of each class. This situation,…

Machine Learning · Computer Science 2022-01-21 Mohamed S. Kraiem , Fernando Sánchez-Hernández , María N. Moreno-García

Several studies point out different causes of performance degradation in supervised machine learning. Problems such as class imbalance, overlapping, small-disjuncts, noisy labels, and sparseness limit accuracy in classification algorithms.…

Machine Learning · Computer Science 2020-04-17 Gustavo A. Valencia-Zapata , Carolina Gonzalez-Canas , Michael G. Zentner , Okan Ersoy , Gerhard Klimeck

Rare events can potentially occur in many applications. When manifested as opportunities to be exploited, risks to be ameliorated, or certain features to be extracted, such events become of paramount significance. Due to their sporadic…

Information Theory · Computer Science 2012-10-10 Ali Tajer , H. Vincent Poor

Our study revisits the problem of accuracy-fairness tradeoff in binary classification. We argue that comparison of non-discriminatory classifiers needs to account for different rates of positive predictions, otherwise conclusions about…

Machine Learning · Computer Science 2015-05-22 Indre Zliobaite

Estimating the unknown number of classes in a population has numerous important applications. In a Poisson mixture model, the problem is reduced to estimating the odds that a class is undetected in a sample. The discontinuity of the odds…

Statistics Theory · Mathematics 2007-08-22 Chang Xuan Mao , Bruce G. Lindsay

This paper considers the problem of offering a scarce object with a common unobserved quality to strategic agents in a priority queue. Each agent has a private signal over the quality of the object and observes the decisions made by other…

Computer Science and Game Theory · Computer Science 2024-05-01 Itai Ashlagi , Jamie Kang , Moran Koren , Faidra Monachou

We present a novel subset scan method to detect if a probabilistic binary classifier has statistically significant bias -- over or under predicting the risk -- for some subgroup, and identify the characteristics of this subgroup. This form…

Machine Learning · Statistics 2017-07-05 Zhe Zhang , Daniel B. Neill

Anomaly detection is a method for discovering unusual and suspicious behavior. In many real-world scenarios, the examined events can be directly linked to the actions of an adversary, such as attacks on computer networks or frauds in…

Machine Learning · Computer Science 2020-04-23 Olga Petrova , Karel Durkota , Galina Alperovich , Karel Horak , Michal Najman , Branislav Bosansky , Viliam Lisy

In this paper, we propose a movie genre recommendation system based on imbalanced survey data and unequal classification costs for small and medium-sized enterprises (SMEs) who need a data-based and analytical approach to stock favored…

Information Retrieval · Computer Science 2018-12-07 Haifeng Wang

Binary classification with an imbalanced dataset is challenging. Models tend to consider all samples as belonging to the majority class. Although existing solutions such as sampling methods, cost-sensitive methods, and ensemble learning…

Machine Learning · Computer Science 2022-07-08 Hsin-Han Tsai , Ta-Wei Yang , Wai-Man Wong , Cheng-Fu Chou

Evaluation often aims to reduce the correctness or error characteristics of a system down to a single number, but that always involves trade-offs. Another way of dealing with this is to quote two numbers, such as Recall and Precision, or…

Machine Learning · Computer Science 2020-09-03 David M. W. Powers

Small operators who take part in secondary wireless spectrum markets typically have strict budget limits. In this paper, we study the bidding problem of a budget constrained operator in repeated secondary spectrum auctions. In existing…

Networking and Internet Architecture · Computer Science 2016-08-29 Mehrdad Khaledi , Alhussein Abouzeid

Classification of datasets into two or more distinct classes is an important machine learning task. Many methods are able to classify binary classification tasks with a very high accuracy on test data, but cannot provide any easily…

Machine Learning · Computer Science 2020-08-26 Yashesh Dhebar , Sparsh Gupta , Kalyanmoy Deb

Detecting semantic backdoors in classification models--where some classes can be activated by certain natural, but out-of-distribution inputs--is an important problem that has received relatively little attention. Semantic backdoors are…

Machine Learning · Computer Science 2026-01-08 Arpad Berta , Gabor Danner , Istvan Hegedus , Mark Jelasity

Being cautious is crucial for enhancing the trustworthiness of machine learning systems integrated into decision-making pipelines. Although calibrated probabilities help in optimal decision-making, perfect calibration remains unattainable,…

Machine Learning · Computer Science 2024-08-12 Mari-Liis Allikivi , Joonas Järve , Meelis Kull

Dynamic learning systems subject to selective labeling exhibit censoring, i.e. persistent negative predictions assigned to one or more subgroups of points. In applications like consumer finance, this results in groups of applicants that are…

Machine Learning · Computer Science 2023-06-30 Jennifer Chien , Margaret Roberts , Berk Ustun

We consider the problem of inference for parameters selected to report only after some algorithm, the canonical example being inference for model parameters after a model selection procedure. The conditional correction for selection…

Methodology · Statistics 2019-01-30 Jelena Markovic , Jonathan Taylor , Jeremy Taylor