English
Related papers

Related papers: Diffusion index forecasts under weaker loadings: P…

200 papers

In climate science and meteorology, high-resolution local precipitation (rain and snowfall) predictions are limited by the computational costs of simulation-based methods. Statistical downscaling, or super-resolution, is a common workaround…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Prakhar Srivastava , Ruihan Yang , Gavin Kerrigan , Gideon Dresdner , Jeremy McGibbon , Christopher Bretherton , Stephan Mandt

The objective-based forecasting considers the asymmetric and non-linear impacts of forecasting errors on decision objectives, thus improving the effectiveness of its downstream decision-making process. However, existing objective-based…

Systems and Control · Electrical Eng. & Systems 2023-03-22 Haipeng Zhang , Ran Li , Yan Chen , Zhongda Chu , Mingyang Sun , Fei Teng

Ridge leverage scores provide a balance between low-rank approximation and regularization, and are ubiquitous in randomized linear algebra and machine learning. Deterministic algorithms are also of interest in the moderately big data…

Statistics Theory · Mathematics 2018-12-27 Shannon R. McCurdy

Rolling origin forecast instability refers to variability in forecasts for a specific period induced by updating the forecast when new data points become available. Recently, an extension to the N-BEATS model for univariate time series…

Machine Learning · Computer Science 2025-01-22 Daan Caljon , Jeff Vercauteren , Simon De Vos , Wouter Verbeke , Jente Van Belle

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

Data Structures and Algorithms · Computer Science 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

The paper introduces a new methodology for assessing on-line the prediction risk of short-term wind power forecasts. The first part of this methodology consists in computing confidence intervals with a confidence level defined by the…

Data Analysis, Statistics and Probability · Physics 2023-10-05 Georges Kariniotakis , Pierre Pinson

This paper develops a novel, fully automated forecast averaging scheme, which combines LASSO estimation method with Principal Component Averaging (PCA). LASSO-PCA (LPCA) explores a pool of predictions based on a single model but calibrated…

Applications · Statistics 2024-04-09 Bartosz Uniejewski , Katarzyna Maciejowska

Sparse Principal Component Analysis (PCA) is a dimensionality reduction technique wherein one seeks a low-rank representation of a data matrix with additional sparsity constraints on the obtained representation. We consider two…

Information Theory · Computer Science 2014-05-06 Yash Deshpande , Andrea Montanari

Principal Component Analysis (PCA) is the most widely used tool for linear dimensionality reduction and clustering. Still it is highly sensitive to outliers and does not scale well with respect to the number of data samples. Robust PCA…

Computer Vision and Pattern Recognition · Computer Science 2015-04-24 Nauman Shahid , Vassilis Kalofolias , Xavier Bresson , Michael Bronstein , Pierre Vandergheynst

This article is concerned with the mathematical analysis of a family of adaptive importance sampling algorithms applied to diffusion processes. These methods, referred to as Adaptive Biasing Potential methods, are designed to efficiently…

Probability · Mathematics 2018-05-10 Michel Benaïm , Charles-Edouard Bréhier

We consider a difference-of-convex formulation where one of the terms is allowed to be hypoconvex (or weakly convex). We first examine the precise behavior of a single iteration of the Difference-of-Convex algorithm (DCA), giving a tight…

Optimization and Control · Mathematics 2024-03-26 Teodor Rotaru , Panagiotis Patrinos , François Glineur

Probabilistic prediction aims to compute predictive distributions rather than single point predictions. These distributions enable practitioners to quantify uncertainty, compute risk, and detect outliers. However, most probabilistic methods…

Machine Learning · Computer Science 2024-10-23 Nicolas Beltran-Velez , Alessandro Antonio Grande , Achille Nazaret , Alp Kucukelbir , David Blei

Real-world data in health, economics, and environmental sciences are often collected across heterogeneous domains (such as hospitals, regions, or time periods). In such settings, distributional shifts can make standard PCA unreliable, in…

Machine Learning · Statistics 2026-03-13 Anya Fries , Markus Reichstein , David Blei , Jonas Peters

Short-term load forecasting is a critical element of power systems energy management systems. In recent years, probabilistic load forecasting (PLF) has gained increased attention for its ability to provide uncertainty information that helps…

Machine Learning · Computer Science 2019-03-27 Qicheng Chang , Yishen Wang , Xiao Lu , Di Shi , Haifeng Li , Jiajun Duan , Zhiwei Wang

Predictions are often probabilities; e.g., a prediction could be for precipitation tomorrow, but with only a 30% chance. Given such probabilistic predictions together with the actual outcomes, "reliability diagrams" help detect and diagnose…

Statistics Theory · Mathematics 2022-11-15 Imanol Arrieta-Ibarra , Paman Gujral , Jonathan Tannen , Mark Tygert , Cherie Xu

This paper continues the examination of inventory control in which the inventory is modelled by a diffusion process and a long-term average cost criterion is used to make decisions. The class of such models under consideration have general…

Optimization and Control · Mathematics 2018-09-10 Kurt L. Helmes , Richard H. Stockbridge , Chao Zhu

We study computational-statistical gaps for improper learning in sparse linear regression. More specifically, given $n$ samples from a $k$-sparse linear model in dimension $d$, we ask what is the minimum sample complexity to efficiently (in…

Machine Learning · Computer Science 2024-06-26 Rares-Darius Buhai , Jingqiu Ding , Stefan Tiegel

Various bias-correction methods such as EXTRA, gradient tracking methods, and exact diffusion have been proposed recently to solve distributed {\em deterministic} optimization problems. These methods employ constant step-sizes and converge…

Machine Learning · Computer Science 2023-07-19 Kun Yuan , Sulaiman A. Alghunaim , Bicheng Ying , Ali H. Sayed

Distributional forecasts are important for a wide variety of applications, including forecasting epidemics. Often, forecasts are miscalibrated, or unreliable in assigning uncertainty to future events. We present a recalibration method that…

Machine Learning · Computer Science 2023-01-11 Aaron Rumack , Ryan J. Tibshirani , Roni Rosenfeld

Score-based generative modeling, informally referred to as diffusion models, continue to grow in popularity across several important domains and tasks. While they provide high-quality and diverse samples from empirical distributions,…

Machine Learning · Statistics 2023-12-29 Jacopo Teneggi , Matthew Tivnan , J. Webster Stayman , Jeremias Sulam