English
Related papers

Related papers: Needle in a Haystack: Label-Efficient Evaluation u…

200 papers

Despite the availability of large datasets for tasks like image classification and image-text alignment, labeled data for more complex recognition tasks, such as detection and segmentation, is less abundant. In particular, for instance…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 François Porcher , Camille Couprie , Marc Szafraniec , Jakob Verbeek

This paper presents a novel solution, LEVER, designed to address the challenges posed by underperforming infrequent categories in Extreme Classification (XC) tasks. Infrequent categories, often characterized by sparse samples, suffer from…

Machine Learning · Computer Science 2025-11-13 Ashutosh Agarwal

Data-driven fault diagnostics and prognostics suffers from class-imbalance problem in industrial systems and it raises challenges to common machine learning algorithms as it becomes difficult to learn the features of the minority class…

Machine Learning · Computer Science 2018-11-20 Wenfang Lin , Zhenyu Wu , Yang Ji

As the volume of data continues to expand, it becomes increasingly common for data to be aggregated from multiple sources. Leveraging multiple sources for model training typically achieves better predictive performance on test datasets.…

Methodology · Statistics 2025-03-05 Congbin Xu , Chengde Qian , Zhaojun Wang , Changliang Zou

Class-level evaluation can conceal substantial performance disparities across subconcepts within the same class, causing models that perform well on average to fail on specific subpopulations. Prior work has shown that common evaluation…

Machine Learning · Computer Science 2026-04-30 Taylor Maxson , Roberto Corizzo , Yaning Wu , Nathalie Japkowicz , Colin Bellinger

Learning from Label Proportions (LLP) is a weakly supervised learning method that aims to perform instance classification from training data consisting of pairs of bags containing multiple instances and the class label proportions within…

Machine Learning · Computer Science 2023-02-22 Ryoma Kobayashi , Yusuke Mukuta , Tatsuya Harada

In a given classification task, the accuracy of the learner is often hampered by finiteness of the training set, high-dimensionality of the feature space and severe overlap between classes. In the context of interpretable learners, with…

Machine Learning · Computer Science 2025-04-03 Marco Canducci , Lida Abdi , Alessandro Prete , Roland J. Veen , Michael Biehl , Wiebke Arlt , Peter Tino

In the era of Model-as-a-Service, organizations increasingly rely on third-party AI models for rapid deployment. However, the dynamic nature of emerging AI applications, the continual introduction of new datasets, and the growing number of…

Machine Learning · Computer Science 2026-02-10 Zihan Zhu , Yanqiu Wu , Qiongkai Xu

We present novel active learning strategies dedicated to providing a solution to the cold start stage, i.e. initializing the classification of a large set of data with no attached labels. Moreover, proposed strategies are designed to handle…

Machine Learning · Computer Science 2022-01-26 Etienne Brangbour , Pierrick Bruneau , Thomas Tamisier , Stéphane Marchand-Maillet

Distance-based unsupervised text classification is a method within text classification that leverages the semantic similarity between a label and a text to determine label relevance. This method provides numerous benefits, including fast…

Computation and Language · Computer Science 2025-10-14 Jens Van Nooten , Andriy Kosar , Guy De Pauw , Walter Daelemans

For high-resource languages like English, text classification is a well-studied task. The performance of modern NLP models easily achieves an accuracy of more than 90% in many standard datasets for text classification in English (Xie et…

Computation and Language · Computer Science 2022-06-06 Dawei Zhu , Michael A. Hedderich , Fangzhou Zhai , David Ifeoluwa Adelani , Dietrich Klakow

As a big data application, extreme multilabel classification has emerged as an important research topic with applications in ranking and recommendation of products and items. A scalable hybrid distributed and shared memory implementation of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-21 Pawan Kumar

The acquisition of labels for supervised learning can be expensive. To improve the sample efficiency of neural network regression, we study active learning methods that adaptively select batches of unlabeled data for labeling. We present a…

Machine Learning · Statistics 2023-08-02 David Holzmüller , Viktor Zaverkin , Johannes Kästner , Ingo Steinwart

Recently, a variety of regularization techniques have been widely applied in deep neural networks, such as dropout, batch normalization, data augmentation, and so on. These methods mainly focus on the regularization of weight parameters to…

Machine Learning · Computer Science 2019-08-16 Qianggang Ding , Sifan Wu , Hao Sun , Jiadong Guo , Shu-Tao Xia

The objective in extreme multi-label learning is to train a classifier that can automatically tag a novel data point with the most relevant subset of labels from an extremely large label set. Embedding based approaches make training and…

Machine Learning · Computer Science 2015-07-13 Kush Bhatia , Himanshu Jain , Purushottam Kar , Prateek Jain , Manik Varma

Learning classifiers from imbalanced and concept drifting data streams is still a challenge. Most of the current proposals focus on taking into account changes in the global imbalance ratio only and ignore the local difficulty factors, such…

Machine Learning · Computer Science 2024-10-07 Bartosz Przybyl , Jerzy Stefanowski

Extreme multi-label classification (XMLC) refers to the task of tagging instances with small subsets of relevant labels coming from an extremely large set of all possible labels. Recently, XMLC has been widely applied to diverse web…

Machine Learning · Computer Science 2021-10-22 Marek Wydmuch , Kalina Jasinska-Kobus , Rohit Babbar , Krzysztof Dembczyński

Extreme multi-label learning (XML) or classification has been a practical and important problem since the boom of big data. The main challenge lies in the exponential label space which involves $2^L$ possible label sets especially when the…

Machine Learning · Computer Science 2018-06-11 Wenjie Zhang , Junchi Yan , Xiangfeng Wang , Hongyuan Zha

A growing line of work shows how learned predictions can be used to break through worst-case barriers to improve the running time of an algorithm. However, incorporating predictions into data structures with strong theoretical guarantees…

Data Structures and Algorithms · Computer Science 2023-06-21 Samuel McCauley , Benjamin Moseley , Aidin Niaparast , Shikha Singh

An unsupervised online streaming model is considered where samples arrive in an online fashion over $T$ slots. There are $M$ classifiers, whose confusion matrices are unknown a priori. In each slot, at most one sample can be labeled by any…

Machine Learning · Computer Science 2021-12-06 R. Vaze , Santanu Rathod