English
Related papers

Related papers: Inductive biases in deep learning models for weath…

200 papers

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

Time series foundation models (TSFMs) are a class of potentially powerful, general-purpose tools for time series forecasting and related temporal tasks, but their behavior is strongly shaped by subtle inductive biases in their design.…

Modern weather and climate models share a common heritage, and often even components, however they are used in different ways to answer fundamentally different questions. As such, attempts to emulate them using machine learning should…

Atmospheric and Oceanic Physics · Physics 2022-03-21 Duncan Watson-Parris

Regression models are used for inference and prediction in a wide range of applications providing a powerful scientific tool for researchers and analysts from different fields. In many research fields the amount of available data as well as…

Methodology · Statistics 2018-06-08 Aliaksandr Hubin , Geir Storvik , Florian Frommlet

NLP models often rely on superficial cues known as dataset biases to achieve impressive performance, and can fail on examples where these biases do not hold. Recent work sought to develop robust, unbiased models by filtering biased examples…

Computation and Language · Computer Science 2023-05-31 Yuval Reif , Roy Schwartz

With broad applications in various public services like aviation management and urban disaster warning, numerical precipitation prediction plays a crucial role in weather forecast. However, constrained by the limitation of observation and…

Machine Learning · Computer Science 2019-10-18 Xiaoyang Xu , Yiqun Liu , Hanqing Chao , Youcheng Luo , Hai Chu , Lei Chen , Junping Zhang , Leiming Ma

There is growing interest in data-driven weather prediction (DDWP), for example using convolutional neural networks such as U-NETs that are trained on data from models or reanalysis. Here, we propose 3 components to integrate with commonly…

Atmospheric and Oceanic Physics · Physics 2025-07-04 Ashesh Chattopadhyay , Mustafa Mustafa , Pedram Hassanzadeh , Eviatar Bach , Karthik Kashinath

Deep learning models have gained popularity in climate science, following their success in computer vision and other domains. For instance, researchers are increasingly employing deep learning techniques for downscaling climate data,…

Machine Learning · Computer Science 2023-06-21 Xingying Huang

Recent years have seen a surge in interest in building deep learning-based fully data-driven models for weather prediction. Such deep learning models if trained on observations can mitigate certain biases in current state-of-the-art weather…

Machine Learning · Computer Science 2022-05-11 Ashesh Chattopadhyay , Jaideep Pathak , Ebrahim Nabizadeh , Wahid Bhimji , Pedram Hassanzadeh

Deep Learning models have achieved state-of-the-art performance in medium-range weather prediction but often fail to maintain physically consistent rollouts beyond 14 days. In contrast, a few atmospheric models demonstrate stability over…

Machine Learning · Computer Science 2025-05-06 Florian Gallusser , Simon Hentschel , Anna Krause , Andreas Hotho

Forecasting global precipitation patterns and, in particular, extreme precipitation events is of critical importance to preparing for and adapting to climate change. Making accurate high-resolution precipitation forecasts using traditional…

Machine Learning · Computer Science 2022-10-25 James Duncan , Shashank Subramanian , Peter Harrington

Machine Learning algorithms have had a profound impact on the field of computer science over the past few decades. These algorithms performance is greatly influenced by the representations that are derived from the data in the learning…

Widespread deployment of societal-scale machine learning systems necessitates a thorough understanding of the resulting long-term effects these systems have on their environment, including loss of trustworthiness, bias amplification, and…

Machine Learning · Computer Science 2024-05-07 Andrey Veprikov , Alexander Afanasiev , Anton Khritankov

Deep learning techniques have become one of the main propellers for solving engineering problems effectively and efficiently. For instance, Predictive Maintenance methods have been used to improve predictions of when maintenance is needed…

Machine Learning · Computer Science 2023-06-30 Julio Hurtado , Dario Salvati , Rudy Semola , Mattia Bosio , Vincenzo Lomonaco

Reasoning is an important task for large language models (LLMs). Among all the reasoning paradigms, inductive reasoning is one of the fundamental types, which is characterized by its particular-to-general thinking process and the…

Computation and Language · Computer Science 2026-04-14 Kedi Chen , Dezhao Ruan , Yuhao Dan , Yaoting Wang , Siyu Yan , Xuecheng Wu , Yinqi Zhang , Qin Chen , Jie Zhou , Liang He , Biqing Qi , Linyang Li , Qipeng Guo , Xiaoming Shi , Wei Zhang

Numerical Weather Prediction (NWP), is widely used in precipitation forecasting, based on complex equations of atmospheric motion requires supercomputers to infer the state of the atmosphere. Due to the complexity of the task and the huge…

Signal Processing · Electrical Eng. & Systems 2020-01-10 Xinyu Xiao , Qiuming Kuang , Shiming Xiang , Junnan Hu , Chunhong Pan

Numerical weather prediction (NWP) centers around the world operate a variety of NWP models. In addition, recent advances in AI-driven NWP models have further increased the availability of NWP outputs. While this expansion holds the…

Machine Learning · Computer Science 2025-06-24 Atsushi Kudo

The unusually warm sea surface temperature events known as marine heatwaves (MHWs) have a profound impact on marine ecosystems. Accurate prediction of extreme MHWs has significant scientific and financial worth. However, existing methods…

Atmospheric and Oceanic Physics · Physics 2024-12-23 Ruiqi Shu , Hao Wu , Yuan Gao , Fanghua Xu , Ruijian Gou , Xiaomeng Huang

The recent advancements in Deep Learning models and techniques have led to significant strides in performance across diverse tasks and modalities. However, while the overall capabilities of models show promising growth, our understanding of…

Artificial Intelligence · Computer Science 2025-04-04 Erik Arakelyan

Agriculture plays a fundamental role in driving economic growth and ensuring food security for populations around the world. Although labor-intensive agriculture has led to steady increases in food grain production in many developing…