English
Related papers

Related papers: Beyond the Hype: Comparing Lightweight and Deep Le…

200 papers

Numerical weather prediction (NWP) models struggle to skillfully predict tropical precipitation occurrence and amount, calling for alternative approaches. For instance, it has been shown that fairly simple, purely data-driven logistic…

Atmospheric and Oceanic Physics · Physics 2024-01-09 Eva-Maria Walz , Peter Knippertz , Andreas H. Fink , Gregor Köhler , Tilmann Gneiting

Post-processing typically takes the outputs of a Numerical Weather Prediction (NWP) model and applies linear statistical techniques to produce improve localized forecasts, by including additional observations, or determining systematic…

Current climate models often struggle with accuracy because they lack sufficient resolution, a limitation caused by computational constraints. This reduces the precision of weather forecasts and long-term climate predictions. To address…

Atmospheric and Oceanic Physics · Physics 2024-10-03 Adib Bazgir , Yuwen Zhang

High levels of air pollution may seriously affect people's living environment and even endanger their lives. In order to reduce air pollution concentrations, and warn the public before the occurrence of hazardous air pollutants, it is…

Machine Learning · Computer Science 2019-06-03 Pei Du , Jianzhou Wang , Yan Hao , Tong Niu , Wendong Yang

In the rapidly evolving landscape of enterprise natural language processing (NLP), the demand for efficient, lightweight models capable of handling multi-domain text automation tasks has intensified. This study conducts a comparative…

Computation and Language · Computer Science 2026-01-05 Muhammad Shahmeer Khan

The customizable nature of deep learning models have allowed them to be successful predictors in various disciplines. These models are often trained with respect to thousands or millions of instances for complicated problems, but the…

Machine Learning · Computer Science 2019-12-24 Drimik Roy Chowdhury , Muhammad Firmansyah Kasim

Although pre-trained models (PLMs) have achieved remarkable improvements in a wide range of NLP tasks, they are expensive in terms of time and resources. This calls for the study of training more efficient models with less computation but…

Computation and Language · Computer Science 2021-10-15 Zhuosheng Zhang , Hanqing Zhang , Keming Chen , Yuhang Guo , Jingyun Hua , Yulong Wang , Ming Zhou

Gaining a deeper understanding of weather and being able to predict its future conduct have always been considered important endeavors for the growth of our society. This research paper explores the advancements in understanding and…

In this proof-of-concept study, we conduct multivariate timeseries forecasting for the concentrations of nitrogen dioxide (NO2), ozone (O3), and (fine) particulate matter (PM10 & PM2.5) with meteorological covariates between two locations…

Machine Learning · Computer Science 2024-10-04 Valentijn Oldenburg , Juan Cardenas-Cartagena , Matias Valdenegro-Toro

Accurate weather and climate modeling is critical for both scientific advancement and safeguarding communities against environmental risks. Traditional approaches rely heavily on Numerical Weather Prediction (NWP) models, which simulate…

Machine Learning · Computer Science 2024-09-13 Muhammad Akhtar Munir , Fahad Shahbaz Khan , Salman Khan

Air pollution has emerged as a major public health challenge in megacities. Numerical simulations and single-site machine learning approaches have been widely applied in air quality forecasting tasks. However, these methods face multiple…

Machine Learning · Computer Science 2025-06-10 Zhixin Geng , Xu Fan , Xiqiao Lu , Yan Zhang , Guangyuan Yu , Cheng Huang , Qian Wang , Yuewu Li , Weichun Ma , Qi Yu , Libo Wu , Hao Li

The field of meteorological forecasting has undergone a significant transformation with the integration of large models, especially those employing deep learning techniques. This paper reviews the advancements and applications of these…

Machine Learning · Computer Science 2024-04-11 Hailong Shu , Yue Wang , Weiwei Song , Huichuang Guo , Zhen Song

Monitoring real-time air quality is essential for safeguarding public health and fostering social progress. However, the widespread deployment of air quality monitoring stations is constrained by their significant costs. To address this…

Machine Learning · Computer Science 2025-07-03 Qiongyan Wang , Yutong Xia , Siru ZHong , Weichuang Li , Yuankai Wu , Shifen Cheng , Junbo Zhang , Yu Zheng , Yuxuan Liang

Current operational air quality forecasts are computationally expensive, sensitive to errors in physics and emissions, and often neglect weather-related uncertainty. To address these limitations, we present AirFusion, a hybrid,…

Atmospheric and Oceanic Physics · Physics 2026-03-24 Ao Ding , Aoxing Zhang , Tzung-May Fu , Yuanlong Huang , Qianjie Chen , Yuyang Chen , Jiajia Mo , Wei Tao , Wai-Chi Cheng , Lei Zhu , Xin Yang , Guy Brasseur

This paper demonstrates that pre-trained language models (PLMs) are strong foundation models for on-device meteorological variables modeling. We present LM-Weather, a generic approach to taming PLMs, that have learned massive sequential…

Atmospheric and Oceanic Physics · Physics 2024-06-03 Shengchao Chen , Guodong Long , Jing Jiang , Chengqi Zhang

Air pollution is a significant global health risk, contributing to millions of premature deaths annually. Nitrogen dioxide (NO2), a harmful pollutant, disproportionately affects urban areas where monitoring networks are often sparse. We…

Signal Processing · Electrical Eng. & Systems 2025-05-12 Finn Gueterbock , Raul Santos-Rodriguez , Jeffrey N. Clark

Nowadays, neural network (NN) and deep learning (DL) techniques are widely adopted in many applications, including recommender systems. Given the sparse and stochastic nature of collaborative filtering (CF) data, recent works have…

Information Retrieval · Computer Science 2024-07-03 Giuseppe Serra , Peter Tino , Zhao Xu , Xin Yao

In recent years, deep learning techniques have outperformed traditional models in many machine learning tasks. Deep neural networks have successfully been applied to address time series forecasting problems, which is a very important topic…

Machine Learning · Computer Science 2021-04-09 Pedro Lara-Benítez , Manuel Carranza-García , José C. Riquelme

In this work, we use ML techniques to develop presumed PDF models for large eddy simulations of reacting flows. The joint sub-filter PDF of mixture fraction and progress variable is modeled using various ML algorithms and commonly used…

Computational Physics · Physics 2019-09-04 Marc T. Henry de Frahan , Shashank Yellapantula , Ryan King , Marc S. Day , Ray W. Grout

Short-term load forecasting (STLF) is vital for the effective and economic operation of power grids and energy markets. However, the non-linearity and non-stationarity of electricity demand as well as its dependency on various external…