English
Related papers

Related papers: An Unbiased Risk Estimator for Learning with Augme…

200 papers

Class imbalance poses a significant challenge in classification tasks, where traditional approaches often lead to biased models and unreliable predictions. Undersampling and oversampling techniques have been commonly employed to address…

Machine Learning · Computer Science 2025-10-22 Matt Clifford , Jonathan Erskine , Alexander Hepburn , Raúl Santos-Rodríguez , Dario Garcia-Garcia

Unsupervised Data Augmentation (UDA) is a semi-supervised technique that applies a consistency loss to penalize differences between a model's predictions on (a) observed (unlabeled) examples; and (b) corresponding 'noised' examples produced…

Computation and Language · Computer Science 2020-10-26 David Lowell , Brian E. Howard , Zachary C. Lipton , Byron C. Wallace

Class-Incremental Learning is a challenging problem in machine learning that aims to extend previously trained neural networks with new classes. This is especially useful if the system is able to classify new objects despite the original…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Karl Holmquist , Lena Klasén , Michael Felsberg

Motivated by applications in protein function prediction, we consider a challenging supervised classification setting in which positive labels are scarce and there are no explicit negative labels. The learning algorithm must thus select…

Machine Learning · Computer Science 2019-01-28 Marco Frasca , Nicolò Cesa-Bianchi

Uncertainty estimation (UE) of generative large language models (LLMs) is crucial for evaluating the reliability of generated sequences. A significant subset of UE methods utilize token probabilities to assess uncertainty, aggregating…

Maximizing the area under the receiver operating characteristic curve (AUC) is a standard approach to imbalanced classification. So far, various supervised AUC optimization methods have been developed and they are also extended to…

Machine Learning · Statistics 2022-04-12 Tomoya Sakai , Gang Niu , Masashi Sugiyama

How to improve discriminative feature learning is central in classification. Existing works address this problem by explicitly increasing inter-class separability and intra-class similarity, whether by constructing positive and negative…

Machine Learning · Computer Science 2024-08-21 Qingsong Zhao , Yi Wang , Shuguang Dou , Chen Gong , Yin Wang , Cairong Zhao

There has been increased interest in devising learning techniques that combine unlabeled data with labeled data ? i.e. semi-supervised learning. However, to the best of our knowledge, no study has been performed across various techniques…

Machine Learning · Computer Science 2011-09-12 N. V. Chawla , Grigoris Karakoulas

Linear discriminant analysis is a widely used method for classification. However, the high dimensionality of predictors combined with small sample sizes often results in large classification errors. To address this challenge, it is crucial…

Machine Learning · Statistics 2025-01-09 Hongzhe Zhang , Arnab Auddy , Hongzhe Lee

Traditional supervised learning aims to train a classifier in the closed-set world, where training and test samples share the same label space. In this paper, we target a more challenging and realistic setting: open-set learning (OSL),…

Machine Learning · Computer Science 2021-07-01 Zhen Fang , Jie Lu , Anjin Liu , Feng Liu , Guangquan Zhang

This work studies the problem of learning unbiased algorithms from biased feedback for recommendation. We address this problem from a novel distribution shift perspective. Recent works in unbiased recommendation have advanced the…

Information Retrieval · Computer Science 2023-10-05 Teng Xiao , Zhengyu Chen , Suhang Wang

We study a variant of Collaborative PAC Learning, in which we aim to learn an accurate classifier for each of the $n$ data distributions, while minimizing the number of samples drawn from them in total. Unlike in the usual collaborative…

Machine Learning · Computer Science 2024-05-24 Yuyang Deng , Mingda Qiao

Learning-augmented algorithms -- in which, traditional algorithms are augmented with machine-learned predictions -- have emerged as a framework to go beyond worst-case analysis. The overarching goal is to design algorithms that perform…

Data Structures and Algorithms · Computer Science 2022-02-10 Sungjin Im , Ravi Kumar , Aditya Petety , Manish Purohit

Learning under one-sided feedback (i.e., where we only observe the labels for examples we predicted positively on) is a fundamental problem in machine learning -- applications include lending and recommendation systems. Despite this, there…

Machine Learning · Computer Science 2020-10-14 Heinrich Jiang , Qijia Jiang , Aldo Pacchiano

In learning-to-learn the goal is to infer a learning algorithm that works well on a class of tasks sampled from an unknown meta distribution. In contrast to previous work on batch learning-to-learn, we consider a scenario where tasks are…

Machine Learning · Statistics 2018-03-23 Giulia Denevi , Carlo Ciliberto , Dimitris Stamos , Massimiliano Pontil

A common approach in positive-unlabeled learning is to train a classification model between labeled and unlabeled data. This strategy is in fact known to give an optimal classifier under mild conditions; however, it results in biased…

Machine Learning · Statistics 2017-02-03 Shantanu Jain , Martha White , Predrag Radivojac

Unsupervised domain adaptation (UDA) for semantic segmentation aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Despite the effectiveness of self-training techniques in UDA, they struggle to learn each…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wangkai Li , Rui Sun , Bohao Liao , Zhaoyang Li , Tianzhu Zhang

Active learning (AL), which aims to construct an effective training set by iteratively curating the most formative unlabeled data for annotation, has been widely used in low-resource tasks. Most active learning techniques in classification…

Computation and Language · Computer Science 2024-12-17 Yun Luo , Zhen Yang , Fandong Meng , Yingjie Li , Fang Guo , Qinglin Qi , Jie Zhou , Yue Zhang

Deep learning methods can classify various unstructured data such as images, language, and voice as input data. As the task of classifying anomalies becomes more important in the real world, various methods exist for classifying using deep…

Computer Vision and Pattern Recognition · Computer Science 2022-01-06 UJu Gim , YeongHyeon Park

We address imbalanced classification, the problem in which a label may have low marginal probability relative to other labels, by weighting losses according to the correct class. First, we examine the convergence rates of the expected…

Machine Learning · Statistics 2020-05-28 Ziyu Xu , Chen Dan , Justin Khim , Pradeep Ravikumar