English
Related papers

Related papers: Contrastive Representations for Label Noise Requir…

200 papers

Because large, human-annotated datasets suffer from labeling errors, it is crucial to be able to train deep neural networks in the presence of label noise. While training image classification models with label noise have received much…

Machine Learning · Computer Science 2019-03-19 Ishan Jindal , Daniel Pressel , Brian Lester , Matthew Nokleby

Although the self-supervised pre-training of transformer models has resulted in the revolutionizing of natural language processing (NLP) applications and the achievement of state-of-the-art results with regard to various benchmarks, this…

Computation and Language · Computer Science 2023-01-26 Xiang Chen , Xin Xie , Zhen Bi , Hongbin Ye , Shumin Deng , Ningyu Zhang , Huajun Chen

Collecting large-scale datasets is crucial for training deep models, annotating the data, however, inevitably yields noisy labels, which poses challenges to deep learning algorithms. Previous efforts tend to mitigate this problem via…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Yuanpeng Tu , Boshen Zhang , Yuxi Li , Liang Liu , Jian Li , Jiangning Zhang , Yabiao Wang , Chengjie Wang , Cai Rong Zhao

A command-following robot that serves people in everyday life must continually improve itself in deployment domains with minimal help from its end users, instead of engineers. Previous methods are either difficult to continuously improve…

Label noise is a significant obstacle in deep learning model training. It can have a considerable impact on the performance of image classification models, particularly deep neural networks, which are especially susceptible because they…

Machine Learning · Computer Science 2023-04-25 Pengwei Yang , Chongyangzi Teng , Jack George Mangos

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jiachen Lei , Julius Berner , Jiongxiao Wang , Zhongzhu Chen , Zhongjia Ba , Kui Ren , Jun Zhu , Anima Anandkumar

Learning from noisy labels is a critical challenge in machine learning, with vast implications for numerous real-world scenarios. While supervised contrastive learning has recently emerged as a powerful tool for navigating label noise, many…

Machine Learning · Computer Science 2025-01-03 Jingyi Cui , Yi-Ge Zhang , Hengyu Liu , Yisen Wang

Existed pre-trained models have achieved state-of-the-art performance on various text classification tasks. These models have proven to be useful in learning universal language representations. However, the semantic discrepancy between…

Machine Learning · Computer Science 2022-01-07 Jinhe Lan , Qingyuan Zhan , Chenhao Jiang , Kunping Yuan , Desheng Wang

Adversarial perturbations are noise-like patterns that can subtly change the data, while failing an otherwise accurate classifier. In this paper, we propose to use such perturbations within a novel contrastive learning setup to build…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Jue Wang , Anoop Cherian

Recently, video recognition is emerging with the help of multi-modal learning, which focuses on integrating distinct modalities to improve the performance or robustness of the model. Although various multi-modal learning methods have been…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Haochen Han , Qinghua Zheng , Minnan Luo , Kaiyao Miao , Feng Tian , Yan Chen

Machine learning classifiers have been demonstrated, both empirically and theoretically, to be robust to label noise under certain conditions -- notably the typical assumption is that label noise is independent of the features given the…

Machine Learning · Computer Science 2022-06-03 Diane Oyen , Michal Kucer , Nick Hengartner , Har Simrat Singh

Noisy labels can impair model performance, making the study of learning with noisy labels an important topic. Two conventional approaches are noise modeling and noise detection. However, these two methods are typically studied…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Siqi Wang , Chau Pham , Bryan A. Plummer

Acoustic scene classification (ASC) models on edge devices typically operate under fixed class assumptions, lacking the transferability needed for real-world applications that require adaptation to new or refined acoustic categories. We…

Sound · Computer Science 2026-02-13 Kuang Yuan , Yang Gao , Xilin Li , Xinhao Mei , Syavosh Zadissa , Tarun Pruthi , Saeed Bagheri Sereshki

In recent years, deep neural networks (DNNs) have gained remarkable achievement in computer vision tasks, and the success of DNNs often depends greatly on the richness of data. However, the acquisition process of data and high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Mengting Li , Chuang Zhu

Learning in the presence of label noise is a challenging yet important task: it is crucial to design models that are robust in the presence of mislabeled datasets. In this paper, we discover that a new class of loss functions called the…

Machine Learning · Computer Science 2020-02-18 Liu Ziyin , Blair Chen , Ru Wang , Paul Pu Liang , Ruslan Salakhutdinov , Louis-Philippe Morency , Masahito Ueda

Modeling various aspects that make a music piece unique is a challenging task, requiring the combination of multiple sources of information. Deep learning is commonly used to obtain representations using various sources of information, such…

Sound · Computer Science 2021-04-05 Andres Ferraro , Xavier Favory , Konstantinos Drossos , Yuntae Kim , Dmitry Bogdanov

The presence of noisy labels in a training dataset can significantly impact the performance of machine learning models. To tackle this issue, researchers have explored methods for Learning with Noisy Labels to identify clean samples and…

Machine Learning · Computer Science 2023-10-30 Sumyeong Ahn , Sihyeon Kim , Jongwoo Ko , Se-Young Yun

Fine-tuning a pre-trained language model via the contrastive learning framework with a large amount of unlabeled sentences or labeled sentence pairs is a common way to obtain high-quality sentence representations. Although the contrastive…

Computation and Language · Computer Science 2022-11-01 Tianduo Wang , Wei Lu

Incorporating every annotator's perspective is crucial for unbiased data modeling. Annotator fatigue and changing opinions over time can distort dataset annotations. To combat this, we propose to learn a more accurate representation of…

Machine Learning · Computer Science 2024-06-05 Uthman Jinadu , Yi Ding

Contrastive learning relies on an assumption that positive pairs contain related views, e.g., patches of an image or co-occurring multimodal signals of a video, that share certain underlying information about an instance. But what if this…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Ching-Yao Chuang , R Devon Hjelm , Xin Wang , Vibhav Vineet , Neel Joshi , Antonio Torralba , Stefanie Jegelka , Yale Song
‹ Prev 1 4 5 6 7 8 10 Next ›