English
Related papers

Related papers: Uncertainty-Aware Solar Flare Regression

200 papers

Methods for reasoning under uncertainty are a key building block of accurate and reliable machine learning systems. Bayesian methods provide a general framework to quantify uncertainty. However, because of model misspecification and the use…

Machine Learning · Computer Science 2018-07-03 Volodymyr Kuleshov , Nathan Fenner , Stefano Ermon

Conformal prediction is a statistical tool for producing prediction regions of machine learning models that are valid with high probability. However, applying conformal prediction to time series data leads to conservative prediction…

Systems and Control · Electrical Eng. & Systems 2024-01-10 Matthew Cleaveland , Insup Lee , George J. Pappas , Lars Lindemann

Data-driven decision making frequently relies on predicting counterfactual outcomes. In practice, researchers commonly train counterfactual prediction models on a source dataset to inform decisions on a possibly separate target population.…

Machine Learning · Statistics 2026-04-07 Keith Barnatchez , Kevin P. Josey , Rachel C. Nethery , Giovanni Parmigiani

High energy solar flares and coronal mass ejections have the potential to destroy Earth's ground and satellite infrastructures, causing trillions of dollars in damage and mass human suffering. Destruction of these critical systems would…

Machine Learning · Computer Science 2021-10-18 Erik Larsen

We present a new method for generating confidence sets within the split conformal prediction framework. Our method performs a trainable transformation of any given conformity score to improve conditional coverage while ensuring exact…

We report a data-parsimonious machine learning model for short-term forecasting of solar irradiance. The model inputs include sky camera images that are reduced to scalar features to meet data transmission constraints. The output irradiance…

Machine Learning · Computer Science 2025-03-25 Joshua Edward Hammond , Ricardo A. Lara Orozco , Michael Baldea , Brian A. Korgel

Conformal Prediction provides distribution-free prediction intervals with guaranteed coverage, but its reliance on a single global calibration threshold obscures the sources of uncertainty at the instance level. In particular, it conflates…

Space weather forecasting is critical for mitigating radiation risks in space exploration and protecting Earth-based technologies from geomagnetic disturbances. This paper presents the development of a Machine Learning (ML)- ready data…

Solar and Stellar Astrophysics · Physics 2025-02-13 Maher A Dayeh , Michael J Starkey , Subhamoy Chatterjee , Heather Elliott , Samuel Hart , Kimberly Moreland

Conformal predictive systems allow forecasters to issue predictive distributions for real-valued future outcomes that have out-of-sample calibration guarantees. On a more abstract level, conformal prediction makes use of in-sample…

Methodology · Statistics 2025-03-07 Sam Allen , Georgios Gavrilopoulos , Alexander Henzi , Gian-Reto Kleger , Johanna Ziegel

In heliophysics research, predicting solar flares is crucial due to their potential to impact both space-based systems and Earth's infrastructure substantially. Magnetic field data from solar active regions, recorded by solar imaging…

Machine Learning · Computer Science 2024-11-19 Onur Vural , Shah Muhammad Hamdi , Soukaina Filali Boubrahimi

Intermittent magnetohydrodynamical turbulence is most likely at work in the magnetized solar atmosphere. As a result, an array of scaling and multi-scaling image-processing techniques can be used to measure the expected self-organization of…

Astrophysics · Physics 2007-05-23 Manolis K. Georgoulis

We conduct the first comprehensive meta-analysis of deterministic solar forecasting based on skill score, screening 1,447 papers from Google Scholar and reviewing the full texts of 320 papers for data extraction. A database of 4,687 points…

Applications · Statistics 2023-04-13 Thi Ngoc Nguyen , Felix Müsgens

Predictive inference is a fundamental task in statistics, traditionally addressed using parametric assumptions about the data distribution and detailed analyses of how models learn from data. In recent years, conformal prediction has…

Methodology · Statistics 2026-03-26 Matteo Sesia , Stefano Favaro

Conformal prediction is a distribution-free framework for uncertainty quantification that replaces point predictions with sets, offering marginal coverage guarantees (i.e., ensuring that the prediction sets contain the true label with a…

Machine Learning · Computer Science 2025-02-25 Margarida M. Campos , João Calém , Sophia Sklaviadis , Mário A. T. Figueiredo , André F. T. Martins

Machine learning (ML) has often been applied to space weather (SW) problems in recent years. SW originates from solar perturbations and is comprised of the resulting complex variations they cause within the systems between the Sun and…

Machine Learning · Computer Science 2022-01-07 Richard J. Licata , Piyush M. Mehta

While the predictions produced by conformal prediction are set-valued, the data used for training and calibration is supposed to be precise. In the setting of superset learning or learning from partial labels, a variant of weakly supervised…

Machine Learning · Computer Science 2023-06-05 Alireza Javanmardi , Yusuf Sale , Paul Hofman , Eyke Hüllermeier

Conformal prediction provides a distribution-free framework for uncertainty quantification via prediction sets with exact finite-sample coverage. In low dimensions these sets are easy to interpret, but in high-dimensional or structured…

Machine Learning · Statistics 2026-05-08 Trevor Harris

Modern black-box predictive models are often accompanied by weak performance guarantees that only hold asymptotically in the size of the dataset or require strong parametric assumptions. In response to this, split conformal prediction…

Machine Learning · Statistics 2022-10-27 Roel Hulsman

We extend conformal prediction methodology beyond the case of exchangeable data. In particular, we show that a weighted version of conformal prediction can be used to compute distribution-free prediction intervals for problems in which the…

Methodology · Statistics 2020-07-08 Ryan J. Tibshirani , Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas

Depth measures have gained popularity in the statistical literature for defining level sets in complex data structures like multivariate data, functional data, and graphs. Despite their versatility, integrating depth measures into…