中文
相关论文

相关论文: Using Neural Networks for Data Cleaning in Weather…

200 篇论文

Weather sensing and forecasting has become increasingly accurate in the last decade thanks to high-resolution radars, efficient computational algorithms, and high-performance computing facilities. Through a distributed and federated network…

网络与互联网体系结构 · 计算机科学 2022-03-29 Robert Thompson , Eric Lyons , Ishita Dasgupta , Spyridon Mastorakis , Michael Zink , Susmit Shannigrahi

Data assimilation is a central problem in many geophysical applications, such as weather forecasting. It aims to estimate the state of a potentially large system, such as the atmosphere, from sparse observations, supplemented by prior…

机器学习 · 计算机科学 2024-06-24 Matthieu Blanke , Ronan Fablet , Marc Lelarge

Miscalibration - a mismatch between a model's confidence and its correctness - of Deep Neural Networks (DNNs) makes their predictions hard to rely on. Ideally, we want networks to be accurate, calibrated and confident. We show that, as…

Ensemble forecasts from numerical weather prediction models show systematic errors that require correction via post-processing. While there has been substantial progress in flexible neural network-based post-processing methods over the past…

机器学习 · 计算机科学 2024-07-17 Moritz Feik , Sebastian Lerch , Jan Stühmer

Data cleansing is a well studied strategy for cleaning erroneous labels in datasets, which has not yet been widely adopted in Music Information Retrieval. Previously proposed data cleansing models do not consider structured (e.g. time…

机器学习 · 计算机科学 2021-04-28 Gabriel Meseguer-Brocal , Rachel Bittner , Simon Durand , Brian Brost

Ensemble weather forecasts enable a measure of uncertainty to be attached to each forecast, by computing the ensemble's spread. However, generating an ensemble with a good spread-error relationship is far from trivial, and a wide range of…

大气与海洋物理 · 物理学 2021-01-05 Sebastian Scher , Gabriele Messori

It is crucial to distinguish mislabeled samples for dealing with noisy labels. Previous methods such as Coteaching and JoCoR introduce two different networks to select clean samples out of the noisy ones and only use these clean ones to…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Rumeng Yi , Yaping Huang

A new method for estimating tropical cyclone track uncertainty is presented and tested. This method uses a neural network to predict a bivariate normal distribution, which serves as an estimate for track uncertainty. We train the network…

大气与海洋物理 · 物理学 2025-03-14 M. A. Fernandez , Elizabeth A. Barnes , Randal J. Barnes , Mark DeMaria , Marie McGraw , Galina Chirokova , Lixin Lu

Machine Learning has become a pervasive tool in climate science applications. However, current models fail to address nonstationarity induced by anthropogenic alterations in greenhouse emissions and do not routinely quantify the uncertainty…

机器学习 · 计算机科学 2024-02-22 Simon Dräger , Maike Sonnewald

Noisy labels are ubiquitous in real-world datasets, especially in the large-scale ones derived from crowdsourcing and web searching. It is challenging to train deep neural networks with noisy datasets since the networks are prone to…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Yangdi Lu , Wenbo He

The introduction of large, foundational models to computer vision has led to drastically improved performance on the task of semantic segmentation. However, these existing methods exhibit a large performance drop when testing on images…

计算机视觉与模式识别 · 计算机科学 2023-12-18 Blake Gella , Howard Zhang , Rishi Upadhyay , Tiffany Chang , Matthew Waliman , Yunhao Ba , Alex Wong , Achuta Kadambi

The diversity of deep learning applications, datasets, and neural network architectures necessitates a careful selection of the architecture and data that match best to a target application. As an attempt to mitigate this dilemma, this…

机器学习 · 计算机科学 2021-10-22 Amin Banitalebi-Dehkordi , Xinyu Kang , Yong Zhang

When data is generated by multiple sources, conventional training methods update models assuming equal reliability for each source and do not consider their individual data quality. However, in many applications, sources have varied levels…

机器学习 · 计算机科学 2025-02-17 Alexander Capstick , Francesca Palermo , Tianyu Cui , Payam Barnaghi

Robust generalization under climate change remains a major challenge for machine learning applications in climate science. Most existing approaches struggle to extrapolate beyond the climate they were trained on, leading to a strong…

大气与海洋物理 · 物理学 2025-09-03 Shuchang Liu , Paul A. O'Gorman

Neural Networks can perform poorly when the training label distribution is heavily imbalanced, as well as when the testing data differs from the training distribution. In order to deal with shift in the testing label distribution, which…

机器学习 · 计算机科学 2020-10-23 Junjiao Tian , Yen-Cheng Liu , Nathan Glaser , Yen-Chang Hsu , Zsolt Kira

Neural networks are not learning optimal decision boundaries. We show that decision boundaries are situated in areas of low training data density. They are impacted by few training samples which can easily lead to overfitting. We provide a…

机器学习 · 计算机科学 2023-10-09 Johannes Schneider

Modern deep learning faces significant challenges with noisy labels, class ambiguity, as well as the need to robustly reject out-of-distribution or corrupted samples. In this work, we propose a unified framework based on the concept of a…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Yasser Taha , Grégoire Montavon , Nils Körber

The growing importance of massive datasets used for deep learning makes robustness to label noise a critical property for classifiers to have. Sources of label noise include automatic labeling, non-expert labeling, and label corruption by…

机器学习 · 计算机科学 2019-01-30 Dan Hendrycks , Mantas Mazeika , Duncan Wilson , Kevin Gimpel

In this paper, we introduced the novel concept of advisor network to address the problem of noisy labels in image classification. Deep neural networks (DNN) are prone to performance reduction and overfitting problems on training data with…

计算机视觉与模式识别 · 计算机科学 2024-08-19 Simone Ricci , Tiberio Uricchio , Alberto Del Bimbo