English
Related papers

Related papers: Skill of data based predictions versus dynamical m…

200 papers

Accurate modeling of ship performance is crucial for the shipping industry to optimize fuel consumption and subsequently reduce emissions. However, predicting the speed-power relation in real-world conditions remains a challenge. In this…

Machine Learning · Computer Science 2022-12-27 Simon DeKeyser , Casimir Morobé , Malte Mittendorf

Statistical physics and dynamical systems theory are key tools to study high-impact geophysical events such as temperature extremes, cyclones, thunderstorms, geomagnetic storms and many more. Despite the intrinsic differences between these…

In natural phenomena, data distributions often deviate from normality. One can think of cataclysms as a self-explanatory example: events that occur almost never, and at the same time are many standard deviations away from the common…

Machine Learning · Computer Science 2022-12-16 Nuno Costa , Nuno Moniz

In this paper, we analyze several instrumental records of temperatures at different locations by using new techniques originally developed for the analysis of extreme values of dynamical systems. We show that they have the same recurrence…

Geophysics · Physics 2014-03-24 Davide Faranda , Sandro Vaienti

Statistical and structural modeling represent two distinct approaches to data analysis. In this paper, we propose a set of novel methods for combining statistical and structural models for improved prediction and causal inference. Our first…

Econometrics · Economics 2020-06-11 Jiaming Mao , Jingzhi Xu

We give a finite-sample analysis of predictive inference procedures after model selection in regression with random design. The analysis is focused on a statistically challenging scenario where the number of potentially important…

Statistics Theory · Mathematics 2009-08-26 Hannes Leeb

Rapid technological innovation threatens to leave much of the global workforce behind. Today's economy juxtaposes white-hot demand for skilled labor against stagnant employment prospects for workers unprepared to participate in a digital…

While the accuracy of modern deep learning models has significantly improved in recent years, the ability of these models to generate uncertainty estimates has not progressed to the same degree. Uncertainty methods are designed to provide…

Machine Learning · Statistics 2020-06-17 Adam M. Oberman , Chris Finlay , Alexander Iannantuono , Tiago Salvador

Adaptation-relevant predictions of climate change are often derived by combining climate model simulations in a multi-model ensemble. Model evaluation methods used in performance-based ensemble weighting schemes have limitations in the…

Atmospheric and Oceanic Physics · Physics 2023-04-19 Mala Virdee , Markus Kaiser , Emily Shuckburgh , Carl Henrik Ek , Ieva Kazlauskaite

Numerous methods exist and were developed for global radiation forecasting. The two most popular types are the numerical weather predictions (NWP) and the predictions using stochastic approaches. We propose to compute a parameter noted…

The evaluation of probabilistic forecasts plays a central role both in the interpretation and in the use of forecast systems and their development. Probabilistic scores (scoring rules) provide statistical measures to assess the quality of…

Methodology · Statistics 2020-12-24 Hailiang Du

Seasonal climate forecasts are being used increasingly across a range of application sectors. A recent UK governmental report asked: How good are seasonal climate forecasts on a scale of 1-5 (where 5 is very good), and how good can we…

Atmospheric and Oceanic Physics · Physics 2013-10-15 Antje Weisheimer , T. N. Palmer

The atmosphere is chaotic. This fundamental property of the climate system makes forecasting weather incredibly challenging: it's impossible to expect weather models to ever provide perfect predictions of the Earth system beyond timescales…

Atmospheric and Oceanic Physics · Physics 2020-12-15 Elizabeth A. Barnes , Kirsten Mayer , Benjamin Toms , Zane Martin , Emily Gordon

Current techniques for predicting climate change are mainly based on "massive" deterministic numerical modeling. However, the ocean-atmosphere system is a so-called "complex system", made up of a large number of interacting elements. We…

Atmospheric and Oceanic Physics · Physics 2022-05-31 Francois Louchet

Understanding model performance on unlabeled data is a fundamental challenge of developing, deploying, and maintaining AI systems. Model performance is typically evaluated using test sets or periodic manual quality assessments, both of…

Machine Learning · Computer Science 2020-12-17 Benjamin Elder , Matthew Arnold , Anupama Murthi , Jiri Navratil

Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying…

The seasonality of respiratory diseases (common cold, influenza, etc.) is a well-known phenomenon studied from ancient times. The development of predictive models is still not only an actual unsolved problem of mathematical epidemiology but…

Populations and Evolution · Quantitative Biology 2014-04-28 Eugene B. Postnikov , Dmitry V. Tatarenkov

As artificial intelligence and machine learning tools become more accessible, and scientists face new obstacles to data collection (e.g. rising costs, declining survey response rates), researchers increasingly use predictions from…

Methodology · Statistics 2024-02-06 Kentaro Hoffman , Stephen Salerno , Awan Afiaz , Jeffrey T. Leek , Tyler H. McCormick

Statistical analysis of extremes can be used to predict the probability of future extreme events, such as large rainfalls or devastating windstorms. The quality of these forecasts can be measured through scoring rules. Locally scale…

Methodology · Statistics 2024-02-22 Helga Kristin Olafsdottir , Holger Rootzén , David Bolin

Conditions ensuring optimal parameter estimation in the presence of missing data are well established in inference, typically relying on the Missing-at-Random (MAR) assumption. In prediction, similar principles are often assumed to apply.…

Methodology · Statistics 2026-03-19 Pierre Catoire , Robin Genuer , Cecile Proust-Lima