English
Related papers

Related papers: Data-driven super-parameterization using deep lear…

200 papers

Persistent systematic errors in Earth system models (ESMs) arise from difficulties in representing the full diversity of subgrid, multiscale atmospheric convection and turbulence. Machine learning (ML) parameterizations trained on short…

Atmospheric and Oceanic Physics · Physics 2026-05-18 Helge Heuer , Tom Beucler , Mierk Schwabe , Julien Savre , Manuel Schlund , Veronika Eyring

We propose a new data-centric synchronization framework for carrying out of machine learning (ML) tasks in a distributed environment. Our framework exploits the iterative nature of ML algorithms and relaxes the application agnostic bulk…

Databases · Computer Science 2015-08-06 Naman Goel , Divyakant Agrawal , Sanjay Chawla , Ahmed Elmagarmid

Large, pre-trained models are problematic to use in resource constrained applications. Fortunately, task-aware structured pruning methods offer a solution. These approaches reduce model size by dropping structural units like layers and…

Computation and Language · Computer Science 2023-11-14 Lucio Dery , David Grangier , Awni Hannun

Against the backdrop of increasingly severe global environmental changes, accurately predicting and meeting renewable energy demands has become a key challenge for sustainable business development. Traditional energy demand forecasting…

Machine Learning · Computer Science 2024-10-22 Te Li , Mengze Zhang , Yan Zhou

Fine-tuning large pre-trained language models on downstream tasks has become the de-facto learning paradigm in NLP. However, conventional approaches fine-tune all the parameters of the pre-trained model, which becomes prohibitive as the…

Computation and Language · Computer Science 2022-02-03 Junxian He , Chunting Zhou , Xuezhe Ma , Taylor Berg-Kirkpatrick , Graham Neubig

Data-driven defect prediction has become increasingly important in software engineering process. Since it is not uncommon that data from a software project is insufficient for training a reliable defect prediction model, transfer learning…

Neural and Evolutionary Computing · Computer Science 2020-02-11 Ke Li , Zilin Xiang , Tao Chen , Shuo Wang , Kay Chen Tan

We explore the potential of feed-forward deep neural networks (DNNs) for emulating cloud superparameterization in realistic geography, using offline fits to data from the Super Parameterized Community Atmospheric Model. To identify the…

Atmospheric and Oceanic Physics · Physics 2021-06-09 Griffin Mooers , Mike Pritchard , Tom Beucler , Jordan Ott , Galen Yacalis , Pierre Baldi , Pierre Gentine

Machine learning-based weather forecasting models now surpass state-of-the-art numerical weather prediction systems, but training and operating these models at high spatial resolution remains computationally expensive. We present a modular…

Machine Learning · Computer Science 2026-04-02 Aymeric Delefosse , Anastase Charantonis , Dominique Béréziat

Solar sensor-based monitoring systems have become a crucial agricultural innovation, advancing farm management and animal welfare through integrating sensor technology, Internet-of-Things, and edge and cloud computing. However, the…

Machine Learning · Computer Science 2025-05-07 Dian Chen , Zelin Wan , Dong Sam Ha , Jin-Hee Cho

Data-enabled predictive control (DeePC) has emerged as a powerful technique to control complex systems without the need for extensive modeling efforts. However, relying solely on offline collected data trajectories to represent the system…

Systems and Control · Electrical Eng. & Systems 2025-08-06 Sebastian Zieglmeier , Mathias Hudoba de Badyn , Narada D. Warakagoda , Thomas R. Krogstad , Paal Engelstad

Deep neural networks (DNN) have achieved remarkable success in various fields, including computer vision and natural language processing. However, training an effective DNN model still poses challenges. This paper aims to propose a method…

Machine Learning · Computer Science 2024-07-03 Hejie Ying , Mengmeng Song , Yaohong Tang , Shungen Xiao , Zimin Xiao

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Current climate models often struggle with accuracy because they lack sufficient resolution, a limitation caused by computational constraints. This reduces the precision of weather forecasts and long-term climate predictions. To address…

Atmospheric and Oceanic Physics · Physics 2024-10-03 Adib Bazgir , Yuwen Zhang

Modeling of turbulent flows is still challenging. One way to deal with the large scale separation due to turbulence is to simulate only the large scales and model the unresolved contributions as done in large-eddy simulation (LES). This…

Computational Physics · Physics 2019-10-03 Mathis Bode , Michael Gauding , Konstantin Kleinheinz , Heinz Pitsch

Reduced order models based on the transport of a lower dimensional manifold representation of the thermochemical state, such as Principal Component (PC) transport and Machine Learning (ML) techniques, have been developed to reduce the…

Chemical Physics · Physics 2024-05-20 Bruno S. Soriano , Ki Sung Jung , Tarek Echekki , Jacqueline H. Chen , Mohammad Khalil

This study investigates the application of deep-learning diffusion models for the super-resolution of weather data, a novel approach aimed at enhancing the spatial resolution and detail of meteorological variables. Leveraging the…

Machine Learning · Computer Science 2024-09-02 Jan Martinů , Petr Šimánek

Accurate short range weather forecasting has significant implications for various sectors. Machine learning based approaches, e.g., deep learning, have gained popularity in this domain where the existing numerical weather prediction (NWP)…

In recent years, Deep-Learning Earth System Models (DL-ESMs) have emerged as promising, computationally efficient complements to traditional Earth system models. Here, we present an evaluation framework for testing DL-ESMs from a…

Atmospheric and Oceanic Physics · Physics 2026-05-20 Giuliana Pallotta , Shiheng Duan , Céline Bonfils , Jiwoo Lee , Seth Goodnight , Paul Ullrich

Parameter estimation for dynamical systems remains challenging due to non-convexity and sensitivity to initial parameter guesses. Recent deep learning approaches enable accurate and fast parameter estimation but do not exploit transferable…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Fabian Raisch , Timo Germann , J. Nathan Kutz , Christoph Goebel , Benjamin Tischler

This paper introduces a new data analysis method for big data using a newly defined regression model named multiple model linear regression(MMLR), which separates input datasets into subsets and construct local linear regression models of…

Machine Learning · Computer Science 2023-08-25 Bohan Lyu , Jianzhong Li