English
Related papers

Related papers: Data-driven super-parameterization using deep lear…

200 papers

Machine learning (ML) techniques, especially neural networks (NNs), have shown promise in learning subgrid-scale parameterizations for climate models. However, a major problem with data-driven parameterizations, particularly those learned…

Atmospheric and Oceanic Physics · Physics 2024-07-17 Hamid A. Pahlavan , Pedram Hassanzadeh , M. Joan Alexander

Estimating spatial regression models on large, irregularly structured datasets poses significant computational hurdles. While Pairwise Likelihood (PL) methods offer a pathway to simplify these estimations, the efficient selection of…

Methodology · Statistics 2025-07-11 Giuseppe Arbia , Vincenzo Nardelli , Niccolo Salvini

Deep learning models have become a cornerstone of modern AI research, yet their initializations and learning rates may at times be set in an opaque or ad-hoc fashion due to the high cost of hyperparameter sweeps. The $\mu$-Parameterization…

Machine Learning · Computer Science 2025-02-17 Lucas Lingle

This paper considers decentralized optimization with application to machine learning on graphs. The growing size of neural network (NN) models has motivated prior works on decentralized stochastic gradient algorithms to incorporate…

Optimization and Control · Mathematics 2021-10-12 Arjun Ashok Rao , Hoi-To Wai

A common task in Earth Sciences is to infer climate information at local and regional scales from global climate models. Dynamical downscaling requires running expensive numerical models at high resolution which can be prohibitive due to…

Machine Learning · Computer Science 2022-05-19 Carlos Alberto Gomez Gonzalez

Accurate weather forecasting holds significant importance to human activities. Currently, there are two paradigms for weather forecasting: Numerical Weather Prediction (NWP) and Deep Learning-based Prediction (DLP). NWP utilizes atmospheric…

Atmospheric and Oceanic Physics · Physics 2024-01-10 Wenyuan Li , Zili Liu , Keyan Chen , Hao Chen , Shunlin Liang , Zhengxia Zou , Zhenwei Shi

As artificial intelligence (AI) continues to rapidly evolve, the realm of Earth and atmospheric sciences is increasingly adopting data-driven models, powered by progressive developments in deep learning (DL). Specifically, DL techniques are…

Machine Learning · Computer Science 2023-12-07 Shengchao Chen , Guodong Long , Jing Jiang , Dikai Liu , Chengqi Zhang

Deep learning models have gained popularity in climate science, following their success in computer vision and other domains. For instance, researchers are increasingly employing deep learning techniques for downscaling climate data,…

Machine Learning · Computer Science 2023-06-21 Xingying Huang

In several domains obtaining class annotations is expensive while at the same time unlabelled data are abundant. While most semi-supervised approaches enforce restrictive assumptions on the data distribution, recent work has managed to…

Machine Learning · Statistics 2017-10-11 Martin Trapp , Tamas Madl , Robert Peharz , Franz Pernkopf , Robert Trappl

With the emergence of various molecular tasks and massive datasets, how to perform efficient training has become an urgent yet under-explored issue in the area. Data pruning (DP), as an oft-stated approach to saving training burdens,…

Machine Learning · Computer Science 2024-09-04 Dingshuo Chen , Zhixun Li , Yuyan Ni , Guibin Zhang , Ding Wang , Qiang Liu , Shu Wu , Jeffrey Xu Yu , Liang Wang

Gaussian processes (GPs) are a popular model for spatially referenced data and allow descriptive statements, predictions at new locations, and simulation of new fields. Often a few parameters are sufficient to parameterize the covariance…

Machine Learning · Statistics 2021-01-01 Florian Gerber , Douglas W. Nychka

The sensor placement problem is a common problem that arises when monitoring correlated phenomena, such as temperature, precipitation, and salinity. Existing approaches to this problem typically formulate it as the maximization of…

Robotics · Computer Science 2024-08-23 Kalvik Jakkala , Srinivas Akella

The development of highly accurate deep learning methods for indoor localization is often hindered by the unavailability of sufficient data measurements in the desired environment to perform model training. To overcome the challenge of…

Signal Processing · Electrical Eng. & Systems 2021-08-06 Mohamed I. AlHajri , Raed M. Shubair , Marwa Chafii

Physical parameterizations are used as representations of unresolved subgrid processes within weather and global climate models or coarse-scale turbulent models, whose resolutions are too coarse to resolve small-scale processes. These…

Machine Learning · Statistics 2022-10-27 Mohamed Aziz Bhouri , Pierre Gentine

A data-driven model (DDM) suitable for regional weather forecasting applications is presented. The model extends the Artificial Intelligence Forecasting System by introducing a stretched-grid architecture that dedicates higher resolution…

As global climate change intensifies, accurate weather forecasting has become increasingly important, affecting agriculture, energy management, environmental protection, and daily life. This study introduces a hybrid model combining…

Machine Learning · Computer Science 2024-10-22 Yuhao Gong , Yuchen Zhang , Fei Wang , Chi-Han Lee

Statistical downscaling of global climate models (GCMs) allows researchers to study local climate change effects decades into the future. A wide range of statistical models have been applied to downscaling GCMs but recent advances in…

Machine Learning · Statistics 2017-02-15 Thomas Vandal , Evan Kodra , Auroop R Ganguly

Deep Gaussian Processes (DGP) are hierarchical generalizations of Gaussian Processes (GP) that have proven to work effectively on a multiple supervised regression tasks. They combine the well calibrated uncertainty estimates of GPs with the…

Machine Learning · Statistics 2018-01-10 Marton Havasi , José Miguel Hernández-Lobato , Juan José Murillo-Fuentes

Climate models are complicated software systems that approximate atmospheric and oceanic fluid mechanics at a coarse spatial resolution. Typical climate forecasts only explicitly resolve processes larger than 100 km and approximate any…

Retrieval-augmented in-context learning has emerged as a powerful approach for addressing knowledge-intensive tasks using frozen language models (LM) and retrieval models (RM). Existing work has combined these in simple "retrieve-then-read"…

Computation and Language · Computer Science 2023-01-24 Omar Khattab , Keshav Santhanam , Xiang Lisa Li , David Hall , Percy Liang , Christopher Potts , Matei Zaharia