English
Related papers

Related papers: On Symmetric Losses for Learning from Corrupted La…

200 papers

In many real-world classification problems, the labels of training examples are randomly corrupted. Most previous theoretical work on classification with label noise assumes that the two classes are separable, that the label noise is…

Machine Learning · Statistics 2016-08-08 Gilles Blanchard , Marek Flaska , Gregory Handy , Sara Pozzi , Clayton Scott

Empirical studies suggest that machine learning models trained with empirical risk minimization (ERM) often rely on attributes that may be spuriously correlated with the class labels. Such models typically lead to poor performance during…

Machine Learning · Computer Science 2023-03-02 Sheng Liu , Xu Zhang , Nitesh Sekhar , Yue Wu , Prateek Singhal , Carlos Fernandez-Granda

Learning with noisy labels is a crucial task for training accurate deep neural networks. To mitigate label noise, prior studies have proposed various robust loss functions, particularly symmetric losses. Nevertheless, symmetric losses…

Machine Learning · Computer Science 2025-07-24 Jialiang Wang , Xianming Liu , Xiong Zhou , Gangfeng Hu , Deming Zhai , Junjun Jiang , Xiangyang Ji

Metric learning is an important problem in machine learning. It aims to group similar examples together. Existing state-of-the-art metric learning approaches require class labels to learn a metric. As obtaining class labels in all…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Ujjal Kr Dutta , Mehrtash Harandi , Chellu Chandra Sekhar

In a typical multi-label setting, a picture contains on average few positive labels, and many negative ones. This positive-negative imbalance dominates the optimization process, and can lead to under-emphasizing gradients from positive…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Emanuel Ben-Baruch , Tal Ridnik , Nadav Zamir , Asaf Noy , Itamar Friedman , Matan Protter , Lihi Zelnik-Manor

Complementary-label learning is a weakly supervised learning problem in which each training example is associated with one or multiple complementary labels indicating the classes to which it does not belong. Existing consistent approaches…

Machine Learning · Computer Science 2024-10-14 Wei Wang , Takashi Ishida , Yu-Jie Zhang , Gang Niu , Masashi Sugiyama

Contrastive learning is a major studied topic in metric learning. However, sampling effective contrastive pairs remains a challenge due to factors such as limited batch size, imbalanced data distribution, and the risk of overfitting. In…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Bolun Cai , Pengfei Xiong , Shangxuan Tian

Various evaluation measures have been developed for multi-label classification, including Hamming Loss (HL), Subset Accuracy (SA) and Ranking Loss (RL). However, there is a gap between empirical results and the existing theories: 1) an…

Machine Learning · Computer Science 2020-11-17 Guoqiang Wu , Jun Zhu

In a binary classification problem where the goal is to fit an accurate predictor, the presence of corrupted labels in the training data set may create an additional challenge. However, in settings where likelihood maximization is poorly…

Statistics Theory · Mathematics 2021-06-18 Yonghoon Lee , Rina Foygel Barber

Sign information is the key to overcoming the inevitable saturation error in compressive sensing systems, which causes information loss and results in bias. For sparse signal recovery from saturation, we propose to use a linear loss to…

Information Theory · Computer Science 2021-02-02 Fan He , Xiaolin Huang , Yipeng Liu , Ming Yan

The multi-label classification framework, where each observation can be associated with a set of labels, has generated a tremendous amount of attention over recent years. The modern multi-label problems are typically large-scale in terms of…

Statistics Theory · Mathematics 2017-03-16 Evgenii Chzhen , Christophe Denis , Mohamed Hebiri , Joseph Salmon

Adversarially robust classification seeks a classifier that is insensitive to adversarial perturbations of test patterns. This problem is often formulated via a minimax objective, where the target loss is the worst-case value of the 0-1…

Machine Learning · Statistics 2021-05-14 Han Bao , Clayton Scott , Masashi Sugiyama

Incorrectly labelled training data are frustratingly ubiquitous in both benchmark and specially curated datasets. Such mislabelling clearly adversely affects the performance and generalizability of models trained through supervised learning…

Machine Learning · Computer Science 2025-11-27 Nicholas Pellegrino , David Szczecina , Paul Fieguth

Recognizing symmetries in data allows for significant boosts in neural network training, which is especially important where training data are limited. In many cases, however, the exact underlying symmetry is present only in an idealized…

High Energy Physics - Phenomenology · Physics 2025-04-07 Seth Nabat , Aishik Ghosh , Edmund Witkowski , Gregor Kasieczka , Daniel Whiteson

A new way of addressing loss errors is introduced which combines ideas from measurement-based quantum computation and concatenated quantum codes, allowing for universal quantum computation. It is shown that for the case where leakage is…

Quantum Physics · Physics 2015-03-20 David A. Herrera-Martí , Terry Rudolph

We study the problem of estimation and testing in logistic regression with class-conditional noise in the observed labels, which has an important implication in the Positive-Unlabeled (PU) learning setting. With the key observation that the…

Methodology · Statistics 2020-08-14 Hyebin Song , Ran Dai , Garvesh Raskutti , Rina Foygel Barber

Label noise presents a real challenge for supervised learning algorithms. Consequently, mitigating label noise has attracted immense research in recent years. Noise robust losses is one of the more promising approaches for dealing with…

Machine Learning · Computer Science 2021-04-27 Neta Shoham , Tomer Avidor , Nadav Israel

Metric learning seeks perceptual embeddings where visually similar instances are close and dissimilar instances are apart, but learned representations can be sub-optimal when the distribution of intra-class samples is diverse and distinct…

Machine Learning · Computer Science 2021-08-30 Elad Levi , Tete Xiao , Xiaolong Wang , Trevor Darrell

Multi-label learning is an emerging extension of the multi-class classification where an image contains multiple labels. Not only acquiring a clean and fully labeled dataset in multi-label learning is extremely expensive, but also many of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Cosmin Octavian Pene , Amirmasoud Ghiassi , Taraneh Younesian , Robert Birke , Lydia Y. Chen

The modern image search system requires semantic understanding of image, and a key yet under-addressed problem is to learn a good metric for measuring the similarity between images. While deep metric learning has yielded impressive…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Jian Wang , Feng Zhou , Shilei Wen , Xiao Liu , Yuanqing Lin