English
Related papers

Related papers: On Symmetric Losses for Learning from Corrupted La…

200 papers

We investigate the problem of classification in the presence of unknown class-conditional label noise in which the labels observed by the learner have been corrupted with some unknown class dependent probability. In order to obtain finite…

Machine Learning · Statistics 2019-06-11 Henry W J Reeve , Ata Kaban

Recent years have witnessed many successful applications of contrastive learning in diverse domains, yet its self-supervised version still remains many exciting challenges. As the negative samples are drawn from unlabeled datasets, a…

Machine Learning · Computer Science 2024-02-01 Bin Liu , Bang Wang , Tianrui Li

Supervised learning has been very successful for automatic segmentation of images from a single scanner. However, several papers report deteriorated performances when using classifiers trained on images from one scanner to segment images…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Veronika Cheplygina , Annegreet van Opbroek , M. Arfan Ikram , Meike W. Vernooij , Marleen de Bruijne

In traditional supervised learning, the cross-entropy loss treats all incorrect predictions equally, ignoring the relevance or proximity of wrong labels to the correct answer. By leveraging a tree hierarchy for fine-grained labels, we…

Sound · Computer Science 2025-01-23 Haokun Tian , Stefan Lattner , Brian McFee , Charalampos Saitis

We consider a type of hypothetical compound materials in which its refractive index in spatial distribution meet $n(-x)=-n^{*}(x)$, belonging to anti-parity-time (APT) symmetric structures. Additionally, we demand balanced real positive-…

Optics · Physics 2025-04-25 Jeng Yi Lee

Complementary-label learning (CLL) is widely used in weakly supervised classification, but it faces a significant challenge in real-world datasets when confronted with class-imbalanced training samples. In such scenarios, the number of…

Machine Learning · Computer Science 2024-03-21 Meng Wei , Yong Zhou , Zhongnian Li , Xinzheng Xu

In semi-supervised learning, information from unlabeled examples is used to improve the model learned from labeled examples. In some learning problems, partial label information can be inferred from otherwise unlabeled examples and used to…

Machine Learning · Computer Science 2024-06-04 Colin B. Hansen , Vishwesh Nath , Diego A. Mesa , Yuankai Huo , Bennett A. Landman , Thomas A. Lasko

In many real-world inverse problems, only incomplete measurement data are available for training which can pose a problem for learning a reconstruction function. Indeed, unsupervised learning using a fixed incomplete measurement process is…

Machine Learning · Statistics 2022-09-30 Julián Tachella , Dongdong Chen , Mike Davies

Contrastive Learning has shown impressive results on natural and medical images, without requiring annotated data. However, a particularity of medical images is the availability of meta-data (such as age or sex) that can be exploited for…

Machine Learning · Computer Science 2021-11-11 Benoit Dufumier , Pietro Gori , Julie Victor , Antoine Grigis , Edouard Duchesnay

Direct loss minimization is a popular approach for learning predictors over structured label spaces. This approach is computationally appealing as it replaces integration with optimization and allows to propagate gradients in a deep net…

Machine Learning · Statistics 2021-06-15 Hedda Cohen Indelman , Tamir Hazan

We study the problem of learning generalized linear models under adversarial corruptions. We analyze a classical heuristic called the iterative trimmed maximum likelihood estimator which is known to be effective against label corruptions in…

Machine Learning · Computer Science 2022-10-25 Pranjal Awasthi , Abhimanyu Das , Weihao Kong , Rajat Sen

While machine learning (ML) architectures have evolved rapidly to account for complex data, loss functions like cross-entropy remain mostly structure-agnostic in many real-world applications. However, the `class-symmetric' nature of these…

Machine Learning · Computer Science 2026-05-28 Yasser Taha , Grégoire Montavon , Nils Körber

Robustness to label noise is a critical property for weakly-supervised classifiers trained on massive datasets. Robustness to label noise is a critical property for weakly-supervised classifiers trained on massive datasets. In this paper,…

Machine Learning · Computer Science 2020-07-14 Amirmasoud Ghiassi , Taraneh Younesian , Robert Birke , Lydia Y. Chen

Corrupted labels and class imbalance are commonly encountered in practically collected training data, which easily leads to over-fitting of deep neural networks (DNNs). Existing approaches alleviate these issues by adopting a sample…

Machine Learning · Computer Science 2022-01-05 Shenwang Jiang , Jianan Li , Ying Wang , Bo Huang , Zhang Zhang , Tingfa Xu

Mitigating the negative impact of noisy labels has been aperennial issue in supervised learning. Robust loss functions have emerged as a prevalent solution to this problem. In this work, we introduce the Variation Ratio as a novel property…

Machine Learning · Computer Science 2025-11-18 Jialiang Wang , Xiong Zhou , Xianming Liu , Gangfeng Hu , Deming Zhai , Junjun Jiang , Haoliang Li

State-of-the-art anomalous sound detection systems often utilize angular margin losses to learn suitable representations of acoustic data using an auxiliary task, which usually is a supervised or self-supervised classification task. The…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Kevin Wilkinghoff , Frank Kurth

Modern learning classifier systems typically exploit a niched genetic algorithm to facilitate rule discovery. When used for reinforcement learning, such rules represent generalisations over the state-action-reward space. Whilst encouraging…

Neural and Evolutionary Computing · Computer Science 2014-01-14 Larry Bull

Various tasks are reformulated as multi-label classification problems, in which the binary cross-entropy (BCE) loss is frequently utilized for optimizing well-designed models. However, the vanilla BCE loss cannot be tailored for diverse…

Machine Learning · Computer Science 2023-04-12 Yusheng Huang , Jiexing Qi , Xinbing Wang , Zhouhan Lin

Contrastive representation learning has been outstandingly successful in practice. In this work, we identify two key properties related to the contrastive loss: (1) alignment (closeness) of features from positive pairs, and (2) uniformity…

Machine Learning · Computer Science 2022-08-17 Tongzhou Wang , Phillip Isola

This paper provides an extension of compressed sensing which bridges a substantial gap between existing theory and its current use in real-world applications. It introduces a mathematical framework that generalizes the three standard…

Information Theory · Computer Science 2014-06-24 Ben Adcock , Anders C. Hansen , Clarice Poon , Bogdan Roman