English
Related papers

Related papers: Using Neural Networks for Data Cleaning in Weather…

200 papers

Noisy labels are inevitable in large real-world datasets. In this work, we explore an area understudied by previous works -- how the network's architecture impacts its robustness to noisy labels. We provide a formal framework connecting the…

Machine Learning · Computer Science 2021-11-30 Jingling Li , Mozhi Zhang , Keyulu Xu , John P. Dickerson , Jimmy Ba

Wind gust prediction plays an important role in warning strategies of national meteorological services due to the high impact of its extreme values. However, forecasting wind gusts is challenging because they are influenced by small-scale…

Applications · Statistics 2024-01-24 Cristina Primo , Benedikt Schulz , Sebastian Lerch , Reinhold Hess

Noisy labels, which are common in real-world datasets, can significantly impair the training of deep learning models. However, recent adversarial noise-combating methods overlook the long-tailed distribution of real data, which can…

Machine Learning · Computer Science 2024-08-09 Mengting Li , Chuang Zhu

In the data deluge context, pattern recognition or labeling in streams is becoming quite an essential and pressing task as data flows inside always bigger streams. The assessment of such tasks is not so easy when dealing with temporal data,…

Information Retrieval · Computer Science 2016-12-01 Pierre-François Marteau

Learning with noisy labels aims to ensure model generalization given a label-corrupted training set. The sample selection strategy achieves promising performance by selecting a label-reliable subset for model training. In this paper, we…

Machine Learning · Computer Science 2025-04-11 Qi Wei , Lei Feng , Haobo Wang , Bo An

Over the past decade the use of machine learning in meteorology has grown rapidly. Specifically neural networks and deep learning have been used at an unprecedented rate. In order to fill the dearth of resources covering neural networks…

Machine Learning · Computer Science 2023-05-26 Randy J. Chase , David R. Harrison , Gary Lackmann , Amy McGovern

Detecting clouds and snow in remote sensing images is an essential preprocessing task for remote sensing imagery. Previous works draw inspiration from semantic segmentation models in computer vision, with most research focusing on improving…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zili Liu , Hao Chen , Wenyuan Li , Keyan Chen , Zipeng Qi , Chenyang Liu , Zhengxia Zou , Zhenwei Shi

Datasets often contain biases which unfairly disadvantage certain groups, and classifiers trained on such datasets can inherit these biases. In this paper, we provide a mathematical formulation of how this bias can arise. We do so by…

Machine Learning · Computer Science 2019-01-16 Heinrich Jiang , Ofir Nachum

Uncertainty calibration is crucial for various machine learning applications, yet it remains challenging. Many models exhibit hallucinations - confident yet inaccurate responses - due to miscalibrated confidence. Here, we show that the…

Machine Learning · Computer Science 2025-03-28 Jeonghwan Cheon , Se-Bum Paik

Detecting extreme events in large datasets is a major challenge in climate science research. Current algorithms for extreme event detection are build upon human expertise in defining events based on subjective thresholds of relevant…

Computer Vision and Pattern Recognition · Computer Science 2016-05-05 Yunjie Liu , Evan Racah , Prabhat , Joaquin Correa , Amir Khosrowshahi , David Lavers , Kenneth Kunkel , Michael Wehner , William Collins

Incorrect labels in training data occur when human annotators make mistakes or when the data is generated via weak or distant supervision. It has been shown that complex noise-handling techniques - by modeling, cleaning or filtering the…

Computation and Language · Computer Science 2022-04-21 Dawei Zhu , Michael A. Hedderich , Fangzhou Zhai , David Ifeoluwa Adelani , Dietrich Klakow

The monotonic ordinal classification has increased the interest of researchers and practitioners within machine learning community in the last years. In real applications, the problems with monotonicity constraints are very frequent. To…

Artificial Intelligence · Computer Science 2018-10-23 José-Ramón Cano , Julián Luengo , Salvador García

This paper addresses a multi-label predictive fault classification problem for multidimensional time-series data. While fault (event) detection problems have been thoroughly studied in literature, most of the state-of-the-art techniques…

Machine Learning · Computer Science 2020-01-29 Wenyu Zhang , Devesh K. Jha , Emil Laftchiev , Daniel Nikovski

Recent theoretical studies (Kou et al., 2023; Cao et al., 2022) have revealed a sharp phase transition from benign to harmful overfitting when the noise-to-feature ratio exceeds a threshold-a situation common in long-tailed data…

Machine Learning · Computer Science 2025-06-10 Ruichen Xu , Kexin Chen

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

Machine Learning · Computer Science 2021-11-11 Abhishek Kumar , Ehsan Amid

The performance of a model trained with noisy labels is often improved by simply \textit{retraining} the model with its \textit{own predicted hard labels} (i.e., 1/0 labels). Yet, a detailed theoretical characterization of this phenomenon…

Poor air quality can have a significant impact on human health. The National Oceanic and Atmospheric Administration (NOAA) air quality forecasting guidance is challenged by the increasing presence of extreme air quality events due to…

Machine Learning · Computer Science 2023-03-24 Sophia Hamer , Jennifer Sleeman , Ivanka Stajner

Thousands of scanned historical topographic maps contain valuable information covering long periods of time, such as how the hydrography of a region has changed over time. Efficiently unlocking the information in these maps requires…

Image and Video Processing · Electrical Eng. & Systems 2021-12-14 Weiwei Duan , Yao-Yi Chiang , Stefan Leyk , Johannes H. Uhl , Craig A. Knoblock

Neural networks have revolutionized many empirical fields, yet their application to financial time series forecasting remains controversial. In this study, we demonstrate that the conventional practice of estimating models locally in…

Econometrics · Economics 2025-02-21 Chen Liu , Minh-Ngoc Tran , Chao Wang , Richard Gerlach , Robert Kohn

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen