English
Related papers

Related papers: Data-driven super-parameterization using deep lear…

200 papers

Sub-seasonal climate forecasting (SSF) focuses on predicting key climate variables such as temperature and precipitation in the 2-week to 2-month time scales. Skillful SSF would have immense societal value, in areas such as agricultural…

Machine Learning · Computer Science 2020-06-25 Sijie He , Xinyan Li , Timothy DelSole , Pradeep Ravikumar , Arindam Banerjee

Digital Signal Processing (DSP) and Digital Image Processing (DIP) with Machine Learning (ML) and Deep Learning (DL) are popular research areas in Computer Vision and related fields. We highlight transformative applications in image…

Accurate weather prediction is essential for many aspects of life, notably the early warning of extreme weather events such as rainstorms. Short-term predictions of these events rely on forecasts from numerical weather models, in which,…

Machine Learning · Computer Science 2023-04-05 Guoxing Chen , Wei-Chyung Wang

Weather forecasting remains a crucial yet challenging domain, where recently developed models based on deep learning (DL) have approached the performance of traditional numerical weather prediction (NWP) models. However, these DL models,…

Atmospheric and Oceanic Physics · Physics 2024-02-13 Zhanxiang Hua , Yutong He , Chengqian Ma , Alexandra Anderson-Frey

Data parallelism has emerged as a necessary technique to accelerate the training of deep neural networks (DNN). In a typical data parallelism approach, the local workers push the latest updates of all the parameters to the parameter server…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-28 Shizhao Sun , Wei Chen , Jiang Bian , Xiaoguang Liu , Tie-Yan Liu

Downscaling (DS) of meteorological variables involves obtaining high-resolution states from low-resolution meteorological fields and is an important task in weather forecasting. Previous methods based on deep learning treat downscaling as a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Zili Liu , Hao Chen , Lei Bai , Wenyuan Li , Keyan Chen , Zhengyi Wang , Wanli Ouyang , Zhengxia Zou , Zhenwei Shi

A promising method for improving the representation of clouds in climate models, and hence climate projections, is to develop machine learning-based parameterizations using output from global storm-resolving models. While neural networks…

Atmospheric and Oceanic Physics · Physics 2025-05-06 Arthur Grundner , Tom Beucler , Pierre Gentine , Veronika Eyring

Merging the two cultures of deep and statistical learning provides insights into structured high-dimensional data. Traditional statistical modeling is still a dominant strategy for structured tabular data. Deep learning can be viewed…

Methodology · Statistics 2021-10-25 Anindya Bhadra , Jyotishka Datta , Nick Polson , Vadim Sokolov , Jianeng Xu

Ensemble weather predictions require statistical post-processing of systematic errors to obtain reliable and accurate probabilistic forecasts. Traditionally, this is accomplished with distributional regression models in which the parameters…

Machine Learning · Statistics 2019-04-01 Stephan Rasp , Sebastian Lerch

Most advanced supervised Machine Learning (ML) models rely on vast amounts of point-by-point labelled training examples. Hand-labelling vast amounts of data may be tedious, expensive, and error-prone. Recently, some studies have explored…

Machine Learning · Computer Science 2021-08-27 Chufan Gao , Mononito Goswami

Based on deep neural networks (DNNs), deep learning has been successfully applied to many problems, but its mechanism is still not well understood -- especially the reason why over-parametrized DNNs can generalize. A recent statistical…

Disordered Systems and Neural Networks · Physics 2025-06-10 Gang Huang , Lai Shun Chan , Hajime Yoshino , Ge Zhang , Yuliang Jin

Multiple studies have now demonstrated that machine learning (ML) can give improved skill for predicting or simulating fairly typical weather events, for tasks such as short-term and seasonal weather forecasting, downscaling simulations to…

Atmospheric and Oceanic Physics · Physics 2023-08-30 Peter AG Watson

Downscaling is necessary to generate high-resolution observation data to validate the climate model forecast or monitor rainfall at the micro-regional level operationally. Dynamical and statistical downscaling models are often used to get…

Atmospheric and Oceanic Physics · Physics 2023-02-28 Bipin Kumar , Rajib Chattopadhyay , Manmeet Singh , Niraj Chaudhari , Karthik Kodari , Amit Barve

Weather forecasting centers currently rely on statistical postprocessing methods to minimize forecast error. This improves skill but can lead to predictions that violate physical principles or disregard dependencies between variables, which…

Atmospheric and Oceanic Physics · Physics 2023-05-23 Francesco Zanetta , Daniele Nerini , Tom Beucler , Mark A. Liniger

Modern deep neural network (DNN) systems are highly configurable with large a number of options that significantly affect their non-functional behavior, for example inference time and energy consumption. Performance models allow to…

Machine Learning · Computer Science 2019-04-08 Md Shahriar Iqbal , Lars Kotthoff , Pooyan Jamshidi

The deep learning (DL)-based methods of low-level tasks have many advantages over the traditional camera in terms of hardware prospects, error accumulation and imaging effects. Recently, the application of deep learning to replace the image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hongyang Chen , Kaisheng Ma

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

Spatio-temporal data are ubiquitous in the agricultural, ecological, and environmental sciences, and their study is important for understanding and predicting a wide variety of processes. One of the difficulties with modeling spatial…

Machine Learning · Statistics 2019-02-25 Christopher K. Wikle

Numerical Weather Prediction (NWP) models represent sub-grid processes using parameterizations, which are often complex and a major source of uncertainty in weather forecasting. In this work, we devise a simple machine learning (ML)…

Atmospheric and Oceanic Physics · Physics 2019-03-26 Pablo Rozas Larraondo , Luigi J. Renzullo , Inaki Inza , Jose A. Lozano

Deep Learning (DL) based downscaling has become a popular tool in earth sciences recently. Increasingly, different DL approaches are being adopted to downscale coarser precipitation data and generate more accurate and reliable estimates at…