English
Related papers

Related papers: FastNet: Improving the physical consistency of mac…

200 papers

Dynamic evaluation of language models (LMs) adapts model parameters at test time using gradient information from previous tokens and substantially improves LM performance. However, it requires over 3x more compute than standard inference.…

Computation and Language · Computer Science 2022-12-06 Kevin Clark , Kelvin Guu , Ming-Wei Chang , Panupong Pasupat , Geoffrey Hinton , Mohammad Norouzi

Most of the available advanced misfit functions for full waveform inversion (FWI) are hand-crafted, and the performance of those misfit functions is data-dependent. Thus, we propose to learn a misfit function for FWI, entitled ML-misfit,…

Geophysics · Physics 2020-03-19 Bingbing Sun , Tariq Alkhalifah

We present WeatherMesh-3 (WM-3), an operational transformer-based global weather forecasting system that improves the state of the art in both accuracy and computational efficiency. We introduce the following advances: 1) a latent rollout…

Machine Learning · Computer Science 2025-03-31 Haoxing Du , Lyna Kim , Joan Creus-Costa , Jack Michaels , Anuj Shetty , Todd Hutchinson , Christopher Riedel , John Dean

Long-term climate projections require running global Earth system models on timescales of hundreds of years and have relatively coarse resolution (from 40 to 160 km in the horizontal) due to their high computational costs. Unresolved…

Quantum Physics · Physics 2025-02-17 Lorenzo Pastori , Arthur Grundner , Veronika Eyring , Mierk Schwabe

Climate events arise from intricate, multivariate dynamics governed by global-scale drivers, profoundly impacting food, energy, and infrastructure. Yet, accurate weather prediction remains elusive due to physical processes unfolding across…

Machine Learning · Computer Science 2025-10-31 Thomas Bailie , S. Karthik Mukkavilli , Varvara Vetrova , Yun Sing Koh

Numerical Weather Prediction (NWP), is widely used in precipitation forecasting, based on complex equations of atmospheric motion requires supercomputers to infer the state of the atmosphere. Due to the complexity of the task and the huge…

Signal Processing · Electrical Eng. & Systems 2020-01-10 Xinyu Xiao , Qiuming Kuang , Shiming Xiang , Junnan Hu , Chunhong Pan

Accurate weather forecasts are essential for supporting a wide range of activities and decision-making processes, as well as mitigating the impacts of adverse weather events. While traditional numerical weather prediction (NWP) remains the…

Machine Learning · Computer Science 2026-02-16 Daniele Zambon , Michele Cattaneo , Ivan Marisca , Jonas Bhend , Daniele Nerini , Cesare Alippi

In this paper we discuss and address the challenges of predicting extreme atmospheric events like intense rainfall, hail, and strong winds. These events can cause significant damage and have become more frequent due to climate change.…

Atmospheric and Oceanic Physics · Physics 2023-10-06 Mikhail Mozikov , Ilya Makarov , Alexandr Bulkin , Daria Taniushkina , Roland Grinis , Yury Maximov

Deep Learning models have achieved state-of-the-art performance in medium-range weather prediction but often fail to maintain physically consistent rollouts beyond 14 days. In contrast, a few atmospheric models demonstrate stability over…

Machine Learning · Computer Science 2025-05-06 Florian Gallusser , Simon Hentschel , Anna Krause , Andreas Hotho

Numerical Weather Prediction (NWP) models that integrate coupled physical equations forward in time are the traditional tools for simulating atmospheric processes and forecasting weather. With recent advancements in deep learning, AI-based…

Computational Physics · Physics 2025-12-22 Milton Gomez , Louis Poulain--Auzeau , Alexis Berne , Tom Beucler

We study optimization for losses that admit a variance-mean scale-mixture representation. Under this representation, each EM iteration is a weighted least squares update in which latent variables determine observation and parameter weights;…

Computation · Statistics 2026-02-17 Nick Polson , Vadim Sokolov

Accurate time series forecasting models are often compromised by data drift, where underlying data distributions change over time, leading to significant declines in prediction performance. To address this challenge, this study proposes an…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Nikhil Pawar , Guilherme Vieira Hollweg , Akhtar Hussain , Wencong Su , Van-Hai Bui

Accurate load prediction is an effective way to reduce power system operation costs. Traditionally, the mean square error (MSE) is a common-used loss function to guide the training of an accurate load forecasting model. However, the MSE…

Systems and Control · Electrical Eng. & Systems 2021-07-06 Jialun Zhang , Yi Wang , Gabriela Hug

The world is moving towards clean and renewable energy sources, such as wind energy, in an attempt to reduce greenhouse gas emissions that contribute to global warming. To enhance the analysis and storage of wind data, we introduce a deep…

Machine Learning · Computer Science 2024-11-07 Alif Bin Abdul Qayyum , Xihaier Luo , Nathan M. Urban , Xiaoning Qian , Byung-Jun Yoon

Wind energy forecasting helps to manage power production, and hence, reduces energy cost. Deep Neural Networks (DNN) mimics hierarchical learning in the human brain and thus possesses hierarchical, distributed, and multi-task learning…

Machine Learning · Computer Science 2018-08-01 Asifullah Khan , Aneela Zameer , Tauseef Jamal , Ahmad Raza

In machine learning, the cost function is crucial because it measures how good or bad a system is. In image classification, well-known networks only consider modifying the network structures and applying cross-entropy loss at the end of the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Trung Dung Do , Cheng-Bin Jin , Hakil Kim , Van Huan Nguyen

Automatic building extraction from aerial imagery has several applications in urban planning, disaster management, and change detection. In recent years, several works have adopted deep convolutional neural networks (CNNs) for building…

Image and Video Processing · Electrical Eng. & Systems 2020-01-22 Clint Sebastian , Raffaele Imbriaco , Egor Bondarev , Peter H. N. de With

Climate change is one of the most concerning issues of this century. Emission from electric power generation is a crucial factor that drives the concern to the next level. Renewable energy sources are widespread and available globally,…

Machine Learning · Computer Science 2020-05-27 Md Amimul Ehsan , Amir Shahirinia , Nian Zhang , Timothy Oladunni

Global warming leads to the increase in frequency and intensity of climate extremes that cause tremendous loss of lives and property. Accurate long-range climate prediction allows more time for preparation and disaster risk management for…

Machine Learning · Computer Science 2021-12-13 Ken C. L. Wong , Hongzhi Wang , Etienne E. Vos , Bianca Zadrozny , Campbell D. Watson , Tanveer Syeda-Mahmood

Numerical Weather Prediction (NWP) has advanced significantly in recent decades but still faces challenges in accuracy, computational efficiency, and scalability. Data-driven weather models have shown great promise, sometimes surpassing…

Atmospheric and Oceanic Physics · Physics 2025-03-18 Animesh Choudhury , Jagabandhu Panda