English
Related papers

Related papers: Utilizing Strategic Pre-training to Reduce Overfit…

200 papers

For autonomous agents to successfully operate in the real world, anticipation of future events and states of their environment is a key competence. This problem can be formalized as a sequence prediction problem, where a number of…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Apratim Bhattacharyya , Mario Fritz , Bernt Schiele

Scientific and technological advances in numerical modelling have improved the quality of climate predictions over recent decades, but predictive skill remains limited in many aspects. Extreme events such as heat and cold waves, droughts,…

Personalizing diffusion models using limited data presents significant challenges, including overfitting, loss of prior knowledge, and degradation of text alignment. Overfitting leads to shifts in the noise prediction distribution,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 JungWoo Chae , Jiyoon Kim , JaeWoong Choi , Kyungyul Kim , Sangheum Hwang

Large-scale pre-trained models have achieved remarkable success in many applications, but how to leverage them to improve the prediction reliability of downstream models is undesirably under-explored. Moreover, modern neural networks have…

Machine Learning · Computer Science 2023-10-31 Peng Cui , Dan Zhang , Zhijie Deng , Yinpeng Dong , Jun Zhu

Cloud-related parameterizations remain a leading source of uncertainty in climate projections. Although machine learning holds promise for Earth system models (ESMs), many data-driven parameterizations lack interpretability, physical…

Atmospheric and Oceanic Physics · Physics 2025-11-25 Arthur Grundner , Tom Beucler , Julien Savre , Axel Lauer , Manuel Schlund , Veronika Eyring

In recent years, a study by environmental organizations in the world and Vietnam shows that weather change is quite complex. global warming has become a serious problem in the modern world, which is a concern for scientists. last century,…

Machine Learning · Computer Science 2024-05-29 Nguyen Phuc Tran , Duy Thanh Tran , Thi Thuy Nga Duong

This paper provides an outlook on the future of operational weather prediction given the recent evolution in science, computing and machine learning. In many parts, this evolution strongly deviates from the strategy operational centres have…

Atmospheric and Oceanic Physics · Physics 2024-09-06 Peter Bauer

Short- or mid-term rainfall forecasting is a major task with several environmental applications such as agricultural management or flood risk monitoring. Existing data-driven approaches, especially deep learning models, have shown…

Signal Processing · Electrical Eng. & Systems 2021-01-13 Vincent Bouget , Dominique Béréziat , Julien Brajard , Anastase Charantonis , Arthur Filoche

Learned dynamics models combined with both planning and policy learning algorithms have shown promise in enabling artificial agents to learn to perform many diverse tasks with limited supervision. However, one of the fundamental challenges…

Machine Learning · Computer Science 2020-08-12 Suraj Nair , Silvio Savarese , Chelsea Finn

Machine learning methods are increasingly adopted in communications problems, particularly those arising in next generation wireless settings. Though seen as a key climate mitigation and societal adaptation enabler, communications related…

Networking and Internet Architecture · Computer Science 2023-11-23 A. Ryo Koblitz , Lorenzo Maggi , Matthew Andrews

Recent advances in unsupervised learning have shown that unsupervised pre-training, followed by fine-tuning, can improve model generalization. However, a rigorous understanding of how the representation function learned on an unlabeled…

Machine Learning · Computer Science 2024-03-12 Yuyang Deng , Junyuan Hong , Jiayu Zhou , Mehrdad Mahdavi

Most forecasting methods use recent past observations (lags) to model the future values of univariate time series. Selecting an adequate number of lags is important for training accurate forecasting models. Several approaches and heuristics…

Machine Learning · Statistics 2024-05-21 José Leites , Vitor Cerqueira , Carlos Soares

Radio signal-based (indoor) localisation technique is important for IoT applications such as smart factory and warehouse. Through machine learning, especially neural networks methods, more accurate mapping from signal features to target…

Machine Learning · Computer Science 2022-03-09 Xingchi Liu , Peizheng Li , Ziming Zhu

Recent years have seen a surge in interest in building deep learning-based fully data-driven models for weather prediction. Such deep learning models if trained on observations can mitigate certain biases in current state-of-the-art weather…

Machine Learning · Computer Science 2022-05-11 Ashesh Chattopadhyay , Jaideep Pathak , Ebrahim Nabizadeh , Wahid Bhimji , Pedram Hassanzadeh

Weather forecasting centers currently rely on statistical postprocessing methods to minimize forecast error. This improves skill but can lead to predictions that violate physical principles or disregard dependencies between variables, which…

Atmospheric and Oceanic Physics · Physics 2023-05-23 Francesco Zanetta , Daniele Nerini , Tom Beucler , Mark A. Liniger

In an era of frequent extreme weather and global warming, obtaining precise, fine-grained near-surface weather forecasts is increasingly essential for human activities. Downscaling (DS), a crucial task in meteorological forecasting, enables…

Atmospheric and Oceanic Physics · Physics 2024-08-21 Zili Liu , Hao Chen , Lei Bai , Wenyuan Li , Wanli Ouyang , Zhengxia Zou , Zhenwei Shi

Pre-training is a widely used approach to develop models that are robust to distribution shifts. However, in practice, its effectiveness varies: fine-tuning a pre-trained model improves robustness significantly in some cases but not at all…

Machine Learning · Computer Science 2024-12-24 Benjamin Cohen-Wang , Joshua Vendrow , Aleksander Madry

Physics-based numerical models have been the bedrock of atmospheric sciences for decades, offering robust solutions but often at the cost of significant computational resources. Deep learning (DL) models have emerged as powerful tools in…

Pre-trained foundation models (FMs) have shown exceptional performance in univariate time series forecasting tasks. However, several practical challenges persist, including managing intricate dependencies among features and quantifying…

To tackle the global climate challenge, it urgently needs to develop a collaborative platform for comprehensive weather forecasting on large-scale meteorological data. Despite urgency, heterogeneous meteorological sensors across countries…

Machine Learning · Computer Science 2023-05-30 Shengchao Chen , Guodong Long , Tao Shen , Jing Jiang