English
Related papers

Related papers: Using Neural Networks for Data Cleaning in Weather…

200 papers

Improper or erroneous labelling can pose a hindrance to reliable generalization for supervised learning. This can have negative consequences, especially for critical fields such as healthcare. We propose an effective new approach for…

Machine Learning · Computer Science 2021-11-16 Konstantinos Nikolaidis , Thomas Plagemann , Stein Kristiansen , Vera Goebel , Mohan Kankanhalli

Data used by automated decision-making systems, such as Machine Learning models, often reflects discriminatory behavior that occurred in the past. These biases in the training data are sometimes related to label noise, such as in COMPAS,…

Machine Learning · Computer Science 2024-10-15 Inês Oliveira e Silva , Sérgio Jesus , Hugo Ferreira , Pedro Saleiro , Inês Sousa , Pedro Bizarro , Carlos Soares

Multiple studies have now demonstrated that machine learning (ML) can give improved skill for predicting or simulating fairly typical weather events, for tasks such as short-term and seasonal weather forecasting, downscaling simulations to…

Atmospheric and Oceanic Physics · Physics 2023-08-30 Peter AG Watson

Although numerous methods to reduce the overfitting of convolutional neural networks (CNNs) exist, it is still not clear how to confidently measure the degree of overfitting. A metric reflecting the overfitting level might be, however,…

Machine Learning · Computer Science 2022-09-28 Svetlana Pavlitskaya , Joël Oswald , J. Marius Zöllner

Class imbalance and label noise are pervasive in large-scale datasets, yet much of machine learning research assumes well-labeled, balanced data, which rarely reflects real world conditions. Existing approaches typically address either…

Machine Learning · Computer Science 2025-01-16 John Brandon Graham-Knight , Jamil Fayyad , Nourhan Bayasi , Patricia Lasserre , Homayoun Najjaran

Memorization in over-parameterized neural networks could severely hurt generalization in the presence of mislabeled examples. However, mislabeled examples are hard to avoid in extremely large datasets collected with weak supervision. We…

Machine Learning · Computer Science 2020-04-10 Jiaming Song , Lunjia Hu , Michael Auli , Yann Dauphin , Tengyu Ma

We propose a semi-supervised text classifier based on self-training using one positive and one negative property of neural networks. One of the weaknesses of self-training is the semantic drift problem, where noisy pseudo-labels accumulate…

Computation and Language · Computer Science 2024-01-02 Payam Karisani

Models based on neural networks and machine learning are seeing a rise in popularity in space physics. In particular, the forecasting of geomagnetic indices with neural network models is becoming a popular field of study. These models are…

Machine Learning · Computer Science 2022-03-15 Brecht Laperre , Jorge Amaya , Giovanni Lapenta

Image classification systems recently made a giant leap with the advancement of deep neural networks. However, these systems require an excessive amount of labeled data to be adequately trained. Gathering a correctly annotated dataset is…

Machine Learning · Computer Science 2021-01-19 Görkem Algan , Ilkay Ulusoy

Two major uncertainties, dataset bias and adversarial examples, prevail in state-of-the-art AI algorithms with deep neural networks. In this paper, we present an intuitive explanation for these issues as well as an interpretation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-12 Yifei Fan , Anthony Yezzi

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

Computation and Language · Computer Science 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

Climate science studies the structure and dynamics of Earth's climate system and seeks to understand how climate changes over time, where the data is usually stored in the format of time series, recording the climate features, geolocation,…

Class-imbalanced data, in which some classes contain far more samples than others, is ubiquitous in real-world applications. Standard techniques for handling class-imbalance usually work by training on a re-weighted loss or on re-balanced…

Artificial Intelligence · Computer Science 2021-06-18 Arpit Bansal , Micah Goldblum , Valeriia Cherepanova , Avi Schwarzschild , C. Bayan Bruss , Tom Goldstein

Training modern neural networks is an inherently noisy process that can lead to high \emph{prediction churn} -- disagreements between re-trainings of the same model due to factors such as randomization in the parameter initialization and…

Machine Learning · Computer Science 2021-06-15 Dara Bahri , Heinrich Jiang

Labor-intensive labeling becomes a bottleneck in developing computer vision algorithms based on deep learning. For this reason, dealing with imperfect labels has increasingly gained attention and has become an active field of study. We…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Heewon Kim , Hyun Sung Chang , Kiho Cho , Jaeyun Lee , Bohyung Han

Time-series forecasting plays an important role in many domains. Boosted by the advances in Deep Learning algorithms, it has for instance been used to predict wind power for eolic energy production, stock market fluctuations, or motor…

Machine Learning · Computer Science 2021-07-23 Luis P. Silvestrin , Leonardos Pantiskas , Mark Hoogendoorn

Long-term rainfall prediction is a challenging task especially in the modern world where we are facing the major environmental problem of global warming. In general, climate and rainfall are highly non-linear phenomena in nature exhibiting…

Artificial Intelligence · Computer Science 2007-05-23 Ajith Abraham , Dan Steinberg

Samples in large-scale datasets may be mislabeled due to various reasons, and Deep Neural Networks can easily over-fit to the noisy label data. To tackle this problem, the key point is to alleviate the harm of these noisy labels. Many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Xuefeng Liang , Longshan Yao , Xingyu Liu , Ying Zhou

Recently deep neural networks have been successfully used for various classification tasks, especially for problems with massive perfectly labeled training data. However, it is often costly to have large-scale credible labels in real-world…

Machine Learning · Computer Science 2019-01-15 Mingxiao An , Yongzhou Chen , Qi Liu , Chuanren Liu , Guangyi Lv , Fangzhao Wu , Jianhui Ma

Modeling weather and climate is an essential endeavor to understand the near- and long-term impacts of climate change, as well as inform technology and policymaking for adaptation and mitigation efforts. In recent years, there has been a…

Machine Learning · Computer Science 2023-07-06 Tung Nguyen , Jason Jewik , Hritik Bansal , Prakhar Sharma , Aditya Grover