English
Related papers

Related papers: An effective self-supervised learning method for v…

200 papers

Data denoising is a persistent challenge across scientific and engineering domains. Real-world data is frequently corrupted by complex, non-linear noise, rendering traditional rule-based denoising methods inadequate. To overcome these…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Chang Nie , Tianchen Deng , Zhe Liu , Hesheng Wang

Recent studies indicate that deep neural networks degrade in generalization performance under noisy supervision. Existing methods focus on isolating clean subsets or correcting noisy labels, facing limitations such as high computational…

Machine Learning · Computer Science 2025-10-30 Kuan Zhang , Chengliang Chai , Jingzhe Xu , Chi Zhang , Han Han , Ye Yuan , Guoren Wang , Lei Cao

Existing deep learning-based speech denoising approaches require clean speech signals to be available for training. This paper presents a deep learning-based approach to improve speech denoising in real-world audio environments by not…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-25 Nasim Alamdari , Arian Azarang , Nasser Kehtarnavaz

Self-supervised learning systems have gained significant attention in recent years by leveraging clustering-based pseudo-labels to provide supervision without the need for human annotations. However, the noise in these pseudo-labels caused…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Zia-ur-Rehman , Arif Mahmood , Wenxiong Kang

Time series self-supervised learning (SSL) aims to exploit unlabeled data for pre-training to mitigate the reliance on labels. Despite the great success in recent years, there is limited discussion on the potential noise in the time series,…

Machine Learning · Computer Science 2024-06-10 Shuang Zhou , Daochen Zha , Xiao Shen , Xiao Huang , Rui Zhang , Fu-Lai Chung

We propose self-adaptive training -- a unified training algorithm that dynamically calibrates and enhances training processes by model predictions without incurring an extra computational cost -- to advance both supervised and…

Machine Learning · Computer Science 2022-10-17 Lang Huang , Chao Zhang , Hongyang Zhang

Recently, denoising methods based on supervised learning have exhibited promising performance. However, their reliance on external datasets containing noisy-clean image pairs restricts their applicability. To address this limitation,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Jaekyun Ko , Sanghwan Lee

The recent success of deep neural networks is powered in part by large-scale well-labeled training data. However, it is a daunting task to laboriously annotate an ImageNet-like dateset. On the contrary, it is fairly convenient, fast, and…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Yifan Ding , Liqiang Wang , Deliang Fan , Boqing Gong

Accurate interpolation of seismic data is crucial for improving the quality of imaging and interpretation. In recent years, deep learning models such as U-Net and generative adversarial networks have been widely applied to seismic data…

Trace-wise noise is a type of noise often seen in seismic data, which is characterized by vertical coherency and horizontal incoherency. Using self-supervised deep learning to attenuate this type of noise, the conventional blind-trace deep…

Geophysics · Physics 2024-04-04 Mohammad Mahdi Abedi , David Pardo , Tariq Alkhalifah

We propose a novel self-supervised image blind denoising approach in which two neural networks jointly predict the clean signal and infer the noise distribution. Assuming that the noisy observations are independent conditionally to the…

Machine Learning · Computer Science 2021-02-17 Jean Ollion , Charles Ollion , Elisabeth Gassiat , Luc Lehéricy , Sylvain Le Corff

In recent years, self-supervised procedures have advanced the field of seismic noise attenuation, due to not requiring a massive amount of clean labeled data in the training stage, an unobtainable requirement for seismic data. However,…

Seismic data preconditioning is essential for subsurface interpretation. It enhances signal quality while attenuating noise, improving the accuracy of geophysical tasks that would otherwise be biased by noise. Although classical poststack…

Tunneling spectroscopy is an important tool for the study of both real-space and momentum-space electronic structure of correlated electron systems. However, such measurements often yield noisy data. Machine learning provides techniques to…

Deep learning with noisy labels is a challenging task. Recent prominent methods that build on a specific sample selection (SS) strategy and a specific semi-supervised learning (SSL) model achieved state-of-the-art performance. Intuitively,…

Machine Learning · Computer Science 2020-12-03 Zhuowei Wang , Jing Jiang , Bo Han , Lei Feng , Bo An , Gang Niu , Guodong Long

Despite the success of deep neural networks (DNNs) in image classification tasks, the human-level performance relies on massive training data with high-quality manual annotations, which are expensive and time-consuming to collect. There…

Machine Learning · Computer Science 2019-04-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Recently, Self-supervised learning methods able to perform image denoising without ground truth labels have been proposed. These methods create low-quality images by adding random or Gaussian noise to images and then train a model for…

Image and Video Processing · Electrical Eng. & Systems 2021-04-07 Dongkyu Won , Euijin Jung , Sion An , Philip Chikontwe , Sang Hyun Park

Distantly supervised named entity recognition (DS-NER) efficiently reduces labor costs but meanwhile intrinsically suffers from the label noise due to the strong assumption of distant supervision. Typically, the wrongly labeled instances…

Computation and Language · Computer Science 2023-02-16 Xinghua Zhang , Bowen Yu , Tingwen Liu , Zhenyu Zhang , Jiawei Sheng , Mengge Xue , Hongbo Xu

Noisy labels are ubiquitous in real-world datasets, especially in the large-scale ones derived from crowdsourcing and web searching. It is challenging to train deep neural networks with noisy datasets since the networks are prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Yangdi Lu , Wenbo He

The major driving force behind the immense success of deep learning models is the availability of large datasets along with their clean labels. Unfortunately, this is very difficult to obtain, which has motivated research on the training of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Devraj Mandal , Shrisha Bharadwaj , Soma Biswas