English
Related papers

Related papers: Inductive biases in deep learning models for weath…

200 papers

Deep learning-based time series forecasting has dominated the short-term precipitation forecasting field with the help of its ability to estimate motion flow in high-resolution datasets. The growing interest in precipitation nowcasting…

Machine Learning · Computer Science 2024-06-17 Sojung An , Tae-Jin Oh , Eunha Sohn , Donghyun Kim

Wind is one kind of high-efficient, environmentally-friendly and cost-effective energy source. Wind power, as one of the largest renewable energy in the world, has been playing a more and more important role in supplying electricity. Though…

Computational Engineering, Finance, and Science · Computer Science 2024-01-02 Wei Fan , Yanjie Fu , Shun Zheng , Jiang Bian , Yuanchun Zhou , Hui Xiong

Precipitation governs Earth's hydroclimate, and its daily spatiotemporal fluctuations have major socioeconomic effects. Advances in Numerical weather prediction (NWP) have been measured by the improvement of forecasts for various physical…

Atmospheric and Oceanic Physics · Physics 2022-11-14 Manmeet Singh , Vaisakh S B , Nachiketa Acharya , Aditya Grover , Suryachandra A Rao , Bipin Kumar , Zong-Liang Yang , Dev Niyogi

The emergence of Deep Learning has marked a profound shift in machine learning, driven by numerous breakthroughs achieved in recent years. However, as Deep Learning becomes increasingly present in everyday tools and applications, there is a…

Machine Learning · Computer Science 2024-11-18 David W. Romero

Seasonal forecasting remains challenging due to the inherent chaotic nature of atmospheric dynamics. This paper introduces DeepSeasons, a novel deep learning approach designed to enhance the accuracy and reliability of seasonal forecasts.…

Atmospheric and Oceanic Physics · Physics 2025-09-16 A. Navarra , G. G. Navarra

Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede…

Atmospheric and Oceanic Physics · Physics 2024-03-29 Ruyi Yang , Jingyu Hu , Zihao Li , Jianli Mu , Tingzhao Yu , Jiangjiang Xia , Xuhong Li , Aritra Dasgupta , Haoyi Xiong

In this work we revisit the most fundamental building block in deep learning, the multi-layer perceptron (MLP), and study the limits of its performance on vision tasks. Empirical insights into MLPs are important for multiple reasons. (1)…

Machine Learning · Computer Science 2023-10-04 Gregor Bachmann , Sotiris Anagnostidis , Thomas Hofmann

Data-driven modeling based on machine learning (ML) is showing enormous potential for weather forecasting. Rapid progress has been made with impressive results for some applications. The uptake of ML methods could be a game-changer for the…

Typical deep learning approaches to modeling high-dimensional data often result in complex models that do not easily reveal a new understanding of the data. Research in the deep learning field is very actively pursuing new methods to…

Machine Learning · Computer Science 2022-05-16 Charles Anderson , Jason Stock , David Anderson

The formation of precipitation in state-of-the-art weather and climate models is an important process. The understanding of its relationship with other variables can lead to endless benefits, particularly for the world's monsoon regions…

Atmospheric and Oceanic Physics · Physics 2021-08-25 Manmeet Singh , Bipin Kumar , Suryachandra Rao , Sukhpal Singh Gill , Rajib Chattopadhyay , Ravi S Nanjundiah , Dev Niyogi

A major problem in machine learning is that of inductive bias: how to choose a learner's hypothesis space so that it is large enough to contain a solution to the problem being learnt, yet small enough to ensure reliable generalization from…

Artificial Intelligence · Computer Science 2011-06-02 J. Baxter

Inductive bias is a key factor in spatial regression models, determining how well a model can learn from limited data and capture spatial patterns. This work revisits the inductive biases in Geographically Neural Network Weighted Regression…

Machine Learning · Computer Science 2025-07-23 Zhenyuan Chen

Learning with limited data is one of the biggest problems of machine learning. Current approaches to this issue consist in learning general representations from huge amounts of data before fine-tuning the model on a small dataset of…

Machine Learning · Computer Science 2023-02-22 Grégoire Mialon

Hypercomplex algebras have recently been gaining prominence in the field of deep learning owing to the advantages of their division algebras over real vector spaces and their superior results when dealing with multidimensional signals in…

Machine Learning · Computer Science 2024-05-14 Danilo Comminiello , Eleonora Grassucci , Danilo P. Mandic , Aurelio Uncini

Climate models play a critical role in understanding and projecting climate change. Due to their complexity, their horizontal resolution of about 40-100 km remains too coarse to resolve processes such as clouds and convection, which need to…

Machine Learning · Computer Science 2025-03-18 Birgit Kühbacher , Fernando Iglesias-Suarez , Niki Kilbertus , Veronika Eyring

Deep learning models have grown increasingly popular in time series applications. However, the large quantity of newly proposed architectures, together with often contradictory empirical results, makes it difficult to assess which…

Machine Learning · Computer Science 2025-12-30 Valentina Moretti , Andrea Cini , Ivan Marisca , Cesare Alippi

There has been a lot of recent interest in adopting machine learning methods for scientific and engineering applications. This has in large part been inspired by recent successes and advances in the domains of Natural Language Processing…

Machine Learning · Statistics 2023-02-28 Paul J. Atzberger

Wind energy plays a critical role in the transition towards renewable energy sources. However, the uncertainty and variability of wind can impede its full potential and the necessary growth of wind power capacity. To mitigate these…

Machine Learning · Computer Science 2026-01-13 Stefan Jonas , Kevin Winter , Bernhard Brodbeck , Angela Meyer

Deep learning has emerged as a compelling solution to many NLP tasks with remarkable performances. However, due to their opacity, such models are hard to interpret and trust. Recent work on explaining deep models has introduced approaches…

Computation and Language · Computer Science 2019-05-21 Reza Ghaeini , Xiaoli Z. Fern , Hamed Shahbazi , Prasad Tadepalli

Data-driven weather prediction (DDWP) models are increasingly becoming popular for weather forecasting. However, while operational weather forecasts predict a wide variety of weather variables, DDWPs currently forecast a specific set of key…

Machine Learning · Computer Science 2023-12-04 Peetak P. Mitra , Vivek Ramavajjala