中文
相关论文

相关论文: Using Neural Networks for Data Cleaning in Weather…

200 篇论文

Improper or erroneous labelling can pose a hindrance to reliable generalization for supervised learning. This can have negative consequences, especially for critical fields such as healthcare. We propose an effective new approach for…

机器学习 · 计算机科学 2021-11-16 Konstantinos Nikolaidis , Thomas Plagemann , Stein Kristiansen , Vera Goebel , Mohan Kankanhalli

Data used by automated decision-making systems, such as Machine Learning models, often reflects discriminatory behavior that occurred in the past. These biases in the training data are sometimes related to label noise, such as in COMPAS,…

Multiple studies have now demonstrated that machine learning (ML) can give improved skill for predicting or simulating fairly typical weather events, for tasks such as short-term and seasonal weather forecasting, downscaling simulations to…

大气与海洋物理 · 物理学 2023-08-30 Peter AG Watson

Although numerous methods to reduce the overfitting of convolutional neural networks (CNNs) exist, it is still not clear how to confidently measure the degree of overfitting. A metric reflecting the overfitting level might be, however,…

机器学习 · 计算机科学 2022-09-28 Svetlana Pavlitskaya , Joël Oswald , J. Marius Zöllner

Class imbalance and label noise are pervasive in large-scale datasets, yet much of machine learning research assumes well-labeled, balanced data, which rarely reflects real world conditions. Existing approaches typically address either…

Memorization in over-parameterized neural networks could severely hurt generalization in the presence of mislabeled examples. However, mislabeled examples are hard to avoid in extremely large datasets collected with weak supervision. We…

机器学习 · 计算机科学 2020-04-10 Jiaming Song , Lunjia Hu , Michael Auli , Yann Dauphin , Tengyu Ma

We propose a semi-supervised text classifier based on self-training using one positive and one negative property of neural networks. One of the weaknesses of self-training is the semantic drift problem, where noisy pseudo-labels accumulate…

计算与语言 · 计算机科学 2024-01-02 Payam Karisani

Models based on neural networks and machine learning are seeing a rise in popularity in space physics. In particular, the forecasting of geomagnetic indices with neural network models is becoming a popular field of study. These models are…

机器学习 · 计算机科学 2022-03-15 Brecht Laperre , Jorge Amaya , Giovanni Lapenta

Image classification systems recently made a giant leap with the advancement of deep neural networks. However, these systems require an excessive amount of labeled data to be adequately trained. Gathering a correctly annotated dataset is…

机器学习 · 计算机科学 2021-01-19 Görkem Algan , Ilkay Ulusoy

Two major uncertainties, dataset bias and adversarial examples, prevail in state-of-the-art AI algorithms with deep neural networks. In this paper, we present an intuitive explanation for these issues as well as an interpretation of the…

计算机视觉与模式识别 · 计算机科学 2019-02-12 Yifei Fan , Anthony Yezzi

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

计算与语言 · 计算机科学 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

Climate science studies the structure and dynamics of Earth's climate system and seeks to understand how climate changes over time, where the data is usually stored in the format of time series, recording the climate features, geolocation,…

Class-imbalanced data, in which some classes contain far more samples than others, is ubiquitous in real-world applications. Standard techniques for handling class-imbalance usually work by training on a re-weighted loss or on re-balanced…

人工智能 · 计算机科学 2021-06-18 Arpit Bansal , Micah Goldblum , Valeriia Cherepanova , Avi Schwarzschild , C. Bayan Bruss , Tom Goldstein

Training modern neural networks is an inherently noisy process that can lead to high \emph{prediction churn} -- disagreements between re-trainings of the same model due to factors such as randomization in the parameter initialization and…

机器学习 · 计算机科学 2021-06-15 Dara Bahri , Heinrich Jiang

Labor-intensive labeling becomes a bottleneck in developing computer vision algorithms based on deep learning. For this reason, dealing with imperfect labels has increasingly gained attention and has become an active field of study. We…

计算机视觉与模式识别 · 计算机科学 2024-01-10 Heewon Kim , Hyun Sung Chang , Kiho Cho , Jaeyun Lee , Bohyung Han

Time-series forecasting plays an important role in many domains. Boosted by the advances in Deep Learning algorithms, it has for instance been used to predict wind power for eolic energy production, stock market fluctuations, or motor…

机器学习 · 计算机科学 2021-07-23 Luis P. Silvestrin , Leonardos Pantiskas , Mark Hoogendoorn

Long-term rainfall prediction is a challenging task especially in the modern world where we are facing the major environmental problem of global warming. In general, climate and rainfall are highly non-linear phenomena in nature exhibiting…

人工智能 · 计算机科学 2007-05-23 Ajith Abraham , Dan Steinberg

Samples in large-scale datasets may be mislabeled due to various reasons, and Deep Neural Networks can easily over-fit to the noisy label data. To tackle this problem, the key point is to alleviate the harm of these noisy labels. Many…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Xuefeng Liang , Longshan Yao , Xingyu Liu , Ying Zhou

Recently deep neural networks have been successfully used for various classification tasks, especially for problems with massive perfectly labeled training data. However, it is often costly to have large-scale credible labels in real-world…

机器学习 · 计算机科学 2019-01-15 Mingxiao An , Yongzhou Chen , Qi Liu , Chuanren Liu , Guangyi Lv , Fangzhao Wu , Jianhui Ma

Modeling weather and climate is an essential endeavor to understand the near- and long-term impacts of climate change, as well as inform technology and policymaking for adaptation and mitigation efforts. In recent years, there has been a…

机器学习 · 计算机科学 2023-07-06 Tung Nguyen , Jason Jewik , Hritik Bansal , Prakhar Sharma , Aditya Grover