English
Related papers

Related papers: Understanding Domain Generalization: A Noise Robus…

200 papers

Diffusion models have become a leading paradigm in generative AI, with score estimation via denoising score matching as a central component. While recent theory provides strong statistical guarantees, it typically relies on…

Machine Learning · Computer Science 2026-04-21 Yinbin Han , Meisam Razaviyayn , Renyuan Xu

Machine learning models trained with purely observational data and the principle of empirical risk minimization \citep{vapnik_principles_1992} can fail to generalize to unseen domains. In this paper, we focus on the case where the problem…

Machine Learning · Statistics 2020-10-27 Maximilian Ilse , Jakub M. Tomczak , Patrick Forré

Domain generalization aims at performing well on unseen test environments with data from a limited number of training environments. Despite a proliferation of proposal algorithms for this task, assessing their performance both theoretically…

Machine Learning · Computer Science 2021-11-24 Yining Chen , Elan Rosenfeld , Mark Sellke , Tengyu Ma , Andrej Risteski

Large-scale datasets are essential for the success of deep learning in image retrieval. However, manual assessment errors and semi-supervised annotation techniques can lead to label noise even in popular datasets. As previous works…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Stanislav Dereka , Ivan Karpukhin , Sergey Kolesnikov

The Invariant Risk Minimization (IRM) approach aims to address the challenge of domain generalization by training a feature representation that remains invariant across multiple environments. However, in noisy environments, IRM-related…

Machine Learning · Computer Science 2025-02-11 Gaojie Jin , Ronghui Mu , Xinping Yi , Xiaowei Huang , Lijun Zhang

The adversarial vulnerability of deep neural networks (DNNs) has been actively investigated in the past several years. This paper investigates the scale-variant property of cross-entropy loss, which is the most commonly used loss function…

Machine Learning · Computer Science 2022-10-12 Ziquan Liu , Antoni B. Chan

Label noise is ubiquitous in real-world scenarios, posing a practical challenge to supervised models due to its effect in hurting the generalization performance of deep neural networks. Existing methods primarily employ the sample selection…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Mengmeng Sheng , Zeren Sun , Tao Chen , Shuchao Pang , Yucheng Wang , Yazhou Yao

Learning with noisy labels is a common challenge in supervised learning. Existing approaches often require practitioners to specify noise rates, i.e., a set of parameters controlling the severity of label noises in the problem, and the…

Machine Learning · Computer Science 2020-08-18 Yang Liu , Hongyi Guo

In machine learning, one must acquire labels to help supervise a model that will be able to generalize to unseen data. However, the labeling process can be tedious, long, costly, and error-prone. It is often the case that most of our data…

Machine Learning · Computer Science 2020-09-29 Bruno Klaus de Aquino Afonso , Lilian Berton

A recent technique of randomized smoothing has shown that the worst-case (adversarial) $\ell_2$-robustness can be transformed into the average-case Gaussian-robustness by "smoothing" a classifier, i.e., by considering the averaged…

Machine Learning · Computer Science 2021-01-11 Jongheon Jeong , Jinwoo Shin

To assess generalization, machine learning scientists typically either (i) bound the generalization gap and then (after training) plug in the empirical risk to obtain a bound on the true risk; or (ii) validate empirically on holdout data.…

Machine Learning · Computer Science 2021-11-09 Saurabh Garg , Sivaraman Balakrishnan , J. Zico Kolter , Zachary C. Lipton

End-to-end speaker diarization approaches have shown exceptional performance over the traditional modular approaches. To further improve the performance of the end-to-end speaker diarization for real speech recordings, recently works have…

Sound · Computer Science 2022-04-19 Chenyu Yang , Yu Wang

Deep classifiers are known to rely on spurious features $\unicode{x2013}$ patterns which are correlated with the target on the training data but not inherently relevant to the learning problem, such as the image backgrounds when classifying…

Machine Learning · Computer Science 2022-10-21 Pavel Izmailov , Polina Kirichenko , Nate Gruver , Andrew Gordon Wilson

Long-tailed learning has attracted much attention recently, with the goal of improving generalisation for tail classes. Most existing works use supervised learning without considering the prevailing noise in the training dataset. To move…

Machine Learning · Computer Science 2021-08-27 Tong Wei , Jiang-Xin Shi , Wei-Wei Tu , Yu-Feng Li

Noisy labels are inevitable in large real-world datasets. In this work, we explore an area understudied by previous works -- how the network's architecture impacts its robustness to noisy labels. We provide a formal framework connecting the…

Machine Learning · Computer Science 2021-11-30 Jingling Li , Mozhi Zhang , Keyulu Xu , John P. Dickerson , Jimmy Ba

Accurate perception is critical for vehicle safety, with LiDAR as a key enabler in autonomous driving. To ensure robust performance across environments, sensor types, and weather conditions without costly re-annotation, domain…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Weitong Kong , Zichao Zeng , Di Wen , Jiale Wei , Kunyu Peng , June Moh Goo , Jan Boehm , Rainer Stiefelhagen

Deep neural classifiers tend to rely on spurious correlations between spurious attributes of inputs and targets to make predictions, which could jeopardize their generalization capability. Training classifiers robust to spurious…

Machine Learning · Computer Science 2024-05-07 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Neural network robustness has recently been highlighted by the existence of adversarial examples. Many previous works show that the learned networks do not perform well on perturbed test data, and significantly more labeled data is required…

Machine Learning · Computer Science 2019-09-27 Runtian Zhai , Tianle Cai , Di He , Chen Dan , Kun He , John Hopcroft , Liwei Wang

Generalization remains a critical challenge in speech deepfake detection (SDD). While various approaches aim to improve robustness, generalization is typically assessed through performance metrics like equal error rate without a theoretical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Wen Huang , Xuechen Liu , Xin Wang , Junichi Yamagishi , Yanmin Qian

Learning with Noisy Labels (LNL) has attracted significant attention from the research community. Many recent LNL methods rely on the assumption that clean samples tend to have "small loss". However, this assumption always fails to…

Machine Learning · Computer Science 2022-11-17 MingCai Chen , Yu Zhao , Bing He , Zongbo Han , Bingzhe Wu , Jianhua Yao
‹ Prev 1 3 4 5 6 7 10 Next ›