中文
相关论文

相关论文: Using Neural Networks for Data Cleaning in Weather…

200 篇论文

Noisy labels are inevitable in large real-world datasets. In this work, we explore an area understudied by previous works -- how the network's architecture impacts its robustness to noisy labels. We provide a formal framework connecting the…

机器学习 · 计算机科学 2021-11-30 Jingling Li , Mozhi Zhang , Keyulu Xu , John P. Dickerson , Jimmy Ba

Wind gust prediction plays an important role in warning strategies of national meteorological services due to the high impact of its extreme values. However, forecasting wind gusts is challenging because they are influenced by small-scale…

应用统计 · 统计学 2024-01-24 Cristina Primo , Benedikt Schulz , Sebastian Lerch , Reinhold Hess

Noisy labels, which are common in real-world datasets, can significantly impair the training of deep learning models. However, recent adversarial noise-combating methods overlook the long-tailed distribution of real data, which can…

机器学习 · 计算机科学 2024-08-09 Mengting Li , Chuang Zhu

In the data deluge context, pattern recognition or labeling in streams is becoming quite an essential and pressing task as data flows inside always bigger streams. The assessment of such tasks is not so easy when dealing with temporal data,…

信息检索 · 计算机科学 2016-12-01 Pierre-François Marteau

Learning with noisy labels aims to ensure model generalization given a label-corrupted training set. The sample selection strategy achieves promising performance by selecting a label-reliable subset for model training. In this paper, we…

机器学习 · 计算机科学 2025-04-11 Qi Wei , Lei Feng , Haobo Wang , Bo An

Over the past decade the use of machine learning in meteorology has grown rapidly. Specifically neural networks and deep learning have been used at an unprecedented rate. In order to fill the dearth of resources covering neural networks…

机器学习 · 计算机科学 2023-05-26 Randy J. Chase , David R. Harrison , Gary Lackmann , Amy McGovern

Detecting clouds and snow in remote sensing images is an essential preprocessing task for remote sensing imagery. Previous works draw inspiration from semantic segmentation models in computer vision, with most research focusing on improving…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Zili Liu , Hao Chen , Wenyuan Li , Keyan Chen , Zipeng Qi , Chenyang Liu , Zhengxia Zou , Zhenwei Shi

Datasets often contain biases which unfairly disadvantage certain groups, and classifiers trained on such datasets can inherit these biases. In this paper, we provide a mathematical formulation of how this bias can arise. We do so by…

机器学习 · 计算机科学 2019-01-16 Heinrich Jiang , Ofir Nachum

Uncertainty calibration is crucial for various machine learning applications, yet it remains challenging. Many models exhibit hallucinations - confident yet inaccurate responses - due to miscalibrated confidence. Here, we show that the…

机器学习 · 计算机科学 2025-03-28 Jeonghwan Cheon , Se-Bum Paik

Detecting extreme events in large datasets is a major challenge in climate science research. Current algorithms for extreme event detection are build upon human expertise in defining events based on subjective thresholds of relevant…

计算机视觉与模式识别 · 计算机科学 2016-05-05 Yunjie Liu , Evan Racah , Prabhat , Joaquin Correa , Amir Khosrowshahi , David Lavers , Kenneth Kunkel , Michael Wehner , William Collins

Incorrect labels in training data occur when human annotators make mistakes or when the data is generated via weak or distant supervision. It has been shown that complex noise-handling techniques - by modeling, cleaning or filtering the…

计算与语言 · 计算机科学 2022-04-21 Dawei Zhu , Michael A. Hedderich , Fangzhou Zhai , David Ifeoluwa Adelani , Dietrich Klakow

The monotonic ordinal classification has increased the interest of researchers and practitioners within machine learning community in the last years. In real applications, the problems with monotonicity constraints are very frequent. To…

人工智能 · 计算机科学 2018-10-23 José-Ramón Cano , Julián Luengo , Salvador García

This paper addresses a multi-label predictive fault classification problem for multidimensional time-series data. While fault (event) detection problems have been thoroughly studied in literature, most of the state-of-the-art techniques…

机器学习 · 计算机科学 2020-01-29 Wenyu Zhang , Devesh K. Jha , Emil Laftchiev , Daniel Nikovski

Recent theoretical studies (Kou et al., 2023; Cao et al., 2022) have revealed a sharp phase transition from benign to harmful overfitting when the noise-to-feature ratio exceeds a threshold-a situation common in long-tailed data…

机器学习 · 计算机科学 2025-06-10 Ruichen Xu , Kexin Chen

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

机器学习 · 计算机科学 2021-11-11 Abhishek Kumar , Ehsan Amid

The performance of a model trained with noisy labels is often improved by simply \textit{retraining} the model with its \textit{own predicted hard labels} (i.e., 1/0 labels). Yet, a detailed theoretical characterization of this phenomenon…

Poor air quality can have a significant impact on human health. The National Oceanic and Atmospheric Administration (NOAA) air quality forecasting guidance is challenged by the increasing presence of extreme air quality events due to…

机器学习 · 计算机科学 2023-03-24 Sophia Hamer , Jennifer Sleeman , Ivanka Stajner

Thousands of scanned historical topographic maps contain valuable information covering long periods of time, such as how the hydrography of a region has changed over time. Efficiently unlocking the information in these maps requires…

图像与视频处理 · 电气工程与系统科学 2021-12-14 Weiwei Duan , Yao-Yi Chiang , Stefan Leyk , Johannes H. Uhl , Craig A. Knoblock

Neural networks have revolutionized many empirical fields, yet their application to financial time series forecasting remains controversial. In this study, we demonstrate that the conventional practice of estimating models locally in…

计量经济学 · 经济学 2025-02-21 Chen Liu , Minh-Ngoc Tran , Chao Wang , Richard Gerlach , Robert Kohn

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

计算机视觉与模式识别 · 计算机科学 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen