English
Related papers

Related papers: Using Neural Networks for Data Cleaning in Weather…

200 papers

A key requirement for supervised machine learning is labeled training data, which is created by annotating unlabeled data with the appropriate class. Because this process can in many cases not be done by machines, labeling needs to be…

Machine Learning · Computer Science 2019-12-12 Nicolas Michael Müller , Karla Markert

Learning with noisy labels (LNL) aims at designing strategies to improve model performance and generalization by mitigating the effects of model overfitting to noisy labels. The key success of LNL lies in identifying as many clean samples…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Jichang Li , Guanbin Li , Feng Liu , Yizhou Yu

The success of Deep Neural Network (DNN) models significantly depends on the quality of provided annotations. In medical image segmentation, for example, having multiple expert annotations for each data point is common to minimize…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Asma Ahmed Hashmi , Aigerim Zhumabayeva , Nikita Kotelevskii , Artem Agafonov , Mohammad Yaqub , Maxim Panov , Martin Takáč

Learning against label noise is a vital topic to guarantee a reliable performance for deep neural networks. Recent research usually refers to dynamic noise modeling with model output probabilities and loss values, and then separates clean…

Machine Learning · Statistics 2022-07-13 Yingsong Huang , Bing Bai , Shengwei Zhao , Kun Bai , Fei Wang

This paper attempts to analyze the effectiveness of deep learning for tabular data processing. It is believed that decision trees and their ensembles is the leading method in this domain, and deep neural networks must be content with…

Machine Learning · Computer Science 2021-12-08 Ivan Bondarenko

Noisy labels are ubiquitous in real-world datasets, which poses a challenge for robustly training deep neural networks (DNNs) as DNNs usually have the high capacity to memorize the noisy labels. In this paper, we find that the test accuracy…

Machine Learning · Computer Science 2019-05-14 Pengfei Chen , Benben Liao , Guangyong Chen , Shengyu Zhang

Building rich machine learning datasets in a scalable manner often necessitates a crowd-sourced data collection pipeline. In this work, we use human studies to investigate the consequences of employing such a pipeline, focusing on the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Dimitris Tsipras , Shibani Santurkar , Logan Engstrom , Andrew Ilyas , Aleksander Madry

Data-driven approaches, most prominently deep learning, have become powerful tools for prediction in many domains. A natural question to ask is whether data-driven methods could also be used to predict global weather patterns days in…

Atmospheric and Oceanic Physics · Physics 2020-12-30 Stephan Rasp , Peter D. Dueben , Sebastian Scher , Jonathan A. Weyn , Soukayna Mouatadid , Nils Thuerey

Not all data in a typical training set help with generalization; some samples can be overly ambiguous or outrightly mislabeled. This paper introduces a new method to identify such samples and mitigate their impact when training neural…

Machine Learning · Computer Science 2020-12-24 Geoff Pleiss , Tianyi Zhang , Ethan R. Elenberg , Kilian Q. Weinberger

Recent studies indicate that deep neural networks degrade in generalization performance under noisy supervision. Existing methods focus on isolating clean subsets or correcting noisy labels, facing limitations such as high computational…

Machine Learning · Computer Science 2025-10-30 Kuan Zhang , Chengliang Chai , Jingzhe Xu , Chi Zhang , Han Han , Ye Yuan , Guoren Wang , Lei Cao

Semantic segmentation of SAR images has garnered significant attention in remote sensing due to the immunity of SAR sensors to cloudy weather and light conditions. Nevertheless, SAR imagery lacks detailed information and is plagued by…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Wang Liu , Zhiyu Wang , Xin Guo , Puhong Duan , Xudong Kang , Shutao Li

The midlatitude climate and weather are shaped by storms, yet the factors governing their predictability remain insufficiently understood. Here, we use a Convolutional Neural Network (CNN) to predict and quantify uncertainty in the…

Atmospheric and Oceanic Physics · Physics 2025-10-30 Wuqiushi Yao , Or Hadas , Yohai Kaspi

Collecting large training datasets, annotated with high-quality labels, is costly and time-consuming. This paper proposes a novel framework for training deep convolutional neural networks from noisy labeled datasets that can be obtained…

Machine Learning · Computer Science 2017-11-06 Arash Vahdat

Deep-learning (DL) weather prediction models offer some notable advantages over traditional physics-based models, including auto-differentiability and low computational cost, enabling detailed diagnostics of forecast errors. Using our…

Atmospheric and Oceanic Physics · Physics 2025-07-23 Uros Perkan , Ziga Zaplotnik , Gregor Skok

Adverse weather conditions can severely affect the performance of LiDAR sensors by introducing unwanted noise in the measurements. Therefore, differentiating between noise and valid points is crucial for the reliable use of these sensors.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Aldi Piroli , Vinzenz Dallabetta , Johannes Kopp , Marc Walessa , Daniel Meissner , Klaus Dietmayer

Modern neural networks have the capacity to overfit noisy labels frequently found in real-world datasets. Although great progress has been made, existing techniques are limited in providing theoretical guarantees for the performance of the…

Machine Learning · Computer Science 2020-11-17 Baharan Mirzasoleiman , Kaidi Cao , Jure Leskovec

Neural networks are widespread due to their powerful performance. Yet, they degrade in the presence of noisy labels at training time. Inspired by the setting of learning with expert advice, where multiplicative weights (MW) updates were…

Machine Learning · Computer Science 2025-11-12 Noga Bar , Tomer Koren , Raja Giryes

Quantifying uncertainty in weather forecasts is critical, especially for predicting extreme weather events. This is typically accomplished with ensemble prediction systems, which consist of many perturbed numerical weather simulations, or…

Machine Learning · Computer Science 2021-03-17 Peter Grönquist , Chengyuan Yao , Tal Ben-Nun , Nikoli Dryden , Peter Dueben , Shigang Li , Torsten Hoefler

Collecting large-scale data with clean labels for supervised training of neural networks is practically challenging. Although noisy labels are usually cheap to acquire, existing methods suffer a lot from label noise. This paper targets at…

Machine Learning · Computer Science 2020-06-16 Zizhao Zhang , Han Zhang , Sercan O. Arik , Honglak Lee , Tomas Pfister

Numerical simulations of Earth's weather and climate require substantial amounts of computation. This has led to a growing interest in replacing subroutines that explicitly compute physical processes with approximate machine learning (ML)…

Machine Learning · Computer Science 2021-11-30 Salva Rühling Cachay , Venkatesh Ramesh , Jason N. S. Cole , Howard Barker , David Rolnick
‹ Prev 1 3 4 5 6 7 10 Next ›