English
Related papers

Related papers: Needle in a Haystack: Label-Efficient Evaluation u…

200 papers

With the abundance of industrial datasets, imbalanced classification has become a common problem in several application domains. Oversampling is an effective method to solve imbalanced classification. One of the main challenges of the…

Machine Learning · Computer Science 2022-07-18 Min Qian , Yan-Fu Li

Real-world data usually suffers from severe class imbalance and long-tailed distributions, where minority classes are significantly underrepresented compared to the majority ones. Recent research prefers to utilize multi-expert…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Zhengzhuo Xu , Zenghao Chai , Chengyin Xu , Chun Yuan , Haiqin Yang

To address the challenges of imbalanced multi-class datasets typically used for rare event detection in critical cyber-physical systems, we propose an optimal, efficient, and adaptable mixed integer programming (MIP) ensemble weighting…

Machine Learning · Computer Science 2025-04-16 Georgios Tertytchny , Georgios L. Stavrinides , Maria K. Michael

Text classification is the task of automatically assigning text documents correct labels from a predefined set of categories. In real-life (text) classification tasks, observations and misclassification costs are often unevenly distributed…

Machine Learning · Computer Science 2025-09-03 Aleksi Avela , Pauliina Ilmonen

Monitoring the performance of classification models in production is critical yet challenging due to strict labeling budgets, one-shot batch acquisition of labels and extremely low error rates. We propose a general framework based on…

Machine Learning · Computer Science 2026-02-02 Lupo Marsigli , Angel Lopez de Haro

Extreme multi-label classification (XMC) is the problem of finding the relevant labels for an input, from a very large universe of possible labels. We consider XMC in the setting where labels are available only for groups of samples - but…

Machine Learning · Computer Science 2020-04-02 Yanyao Shen , Hsiang-fu Yu , Sujay Sanghavi , Inderjit Dhillon

Active regression considers a linear regression problem where the learner receives a large number of data points but can only observe a small number of labels. Since online algorithms can deal with incremental training data and take…

Machine Learning · Computer Science 2022-08-31 Cheng Chen , Yi Li , Yiming Sun

In this paper, a novel extreme learning machine based online multi-label classifier for real-time data streams is proposed. Multi-label classification is one of the actively researched machine learning paradigm that has gained much…

Machine Learning · Computer Science 2016-09-16 Rajasekar Venkatesan , Meng Joo Er , Shiqian Wu , Mahardhika Pratama

In multi-label classification, an instance may be associated with a set of labels simultaneously. Recently, the research on multi-label classification has largely shifted its focus to the other end of the spectrum where the number of labels…

Machine Learning · Computer Science 2016-04-06 Li Li , Houfeng Wang

Choosing a decision threshold is one of the challenging job in any classification tasks. How much the model is accurate, if the deciding boundary is not picked up carefully, its entire performance would go in vain. On the other hand, for…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Bharat Bohara

Online Active Learning (OAL) aims to manage unlabeled datastream by selectively querying the label of data. OAL is applicable to many real-world problems, such as anomaly detection in health-care and finance. In these problems, there are…

Machine Learning · Computer Science 2019-11-19 Yifan Zhang , Peilin Zhao , Shuaicheng Niu , Qingyao Wu , Jiezhang Cao , Junzhou Huang , Mingkui Tan

This paper focuses on supervised and unsupervised online label shift, where the class marginals $Q(y)$ varies but the class-conditionals $Q(x|y)$ remain invariant. In the unsupervised setting, our goal is to adapt a learner, trained on some…

Class imbalance, which is also called long-tailed distribution, is a common problem in classification tasks based on machine learning. If it happens, the minority data will be overwhelmed by the majority, which presents quite a challenge…

Machine Learning · Computer Science 2023-03-29 Jia-Chen Zhao

We consider the problem of Learning from Label Proportions (LLP), a weakly supervised classification setup where instances are grouped into "bags", and only the frequency of class labels at each bag is available. Albeit, the objective of…

Machine Learning · Computer Science 2023-02-15 Robert Istvan Busa-Fekete , Heejin Choi , Travis Dick , Claudio Gentile , Andres Munoz medina

Class imbalance in data presents significant challenges for classification tasks. It is fairly common and requires careful handling to obtain desirable performance. Traditional classification algorithms become biased toward the majority…

Machine Learning · Computer Science 2024-10-28 Asif Newaz , Asif Ur Rahman Adib , Taskeed Jabid

Most of the existing learning models, particularly deep neural networks, are reliant on large datasets whose hand-labeling is expensive and time demanding. A current trend is to make the learning of these models frugal and less dependent on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Sebastien Deschamps , Hichem Sahbi

In the classification of a class imbalance dataset, the performance measure used for the model selection and comparison to competing methods is a major issue. In order to overcome this problem several performance measures are defined and…

Machine Learning · Computer Science 2020-06-25 Robert Burduk

The current dominant paradigm when building a machine learning model is to iterate over a dataset over and over until convergence. Such an approach is non-incremental, as it assumes access to all images of all categories at once. However,…

Machine Learning · Computer Science 2023-02-14 Mert Kilickaya , Joost van de Weijer , Yuki M. Asano

Available works addressing multi-label classification in a data stream environment focus on proposing accurate models; however, these models often exhibit inefficiency and cannot balance effectiveness and efficiency. In this work, we…

Machine Learning · Computer Science 2023-10-03 Sepehr Bakhshi , Fazli Can

Class imbalance is a pervasive issue among classification models including deep learning, whose capacity to extract task-specific features is affected in imbalanced settings. However, the challenges of handling imbalance among a large…

Machine Learning · Computer Science 2018-10-31 Shin Ando