English
Related papers

Related papers: Regularization for electricity price forecasting

200 papers

We propose a novel machine learning approach for probabilistic forecasting of hourly day-ahead electricity prices. In contrast with the recent advances in data-rich probabilistic forecasting, which approximates distributions with few…

General Economics · Economics 2025-07-04 Jozef Barunik , Lubos Hanus

Variable (feature, gene, model, which we use interchangeably) selections for regression with high-dimensional BIGDATA have found many applications in bioinformatics, computational biology, image processing, and engineering. One appealing…

Machine Learning · Computer Science 2014-07-29 Zhenqiu Liu , Gang Li

The effects of several nonlinear regularization techniques are discussed in the framework of 3D seismic tomography. Traditional, linear, $\ell_2$ penalties are compared to so-called sparsity promoting $\ell_1$ and $\ell_0$ penalties, and a…

Geophysics · Physics 2010-08-19 I. Loris , H. Douma , G. Nolet , I. Daubechies , C. Regone

Trading on the day-ahead electricity markets requires accurate information about the realization of electricity prices and the uncertainty attached to the predictions. Deriving accurate forecasting models presents a difficult task due to…

Machine Learning · Computer Science 2024-03-25 Hannes Hilger , Dirk Witthaut , Manuel Dahmen , Leonardo Rydin Gorjao , Julius Trebbien , Eike Cramer

Electricity price forecasting is an essential task in all the deregulated markets of the world. The accurate prediction of the day-ahead electricity prices is an active research field and available data from various markets can be used as…

Signal Processing · Electrical Eng. & Systems 2022-11-18 Salih Gunduz , Umut Ugurlu , Ilkay Oksuz

During the inversion of discrete linear systems noise in data can be amplified and result in meaningless solutions. To combat this effect, characteristics of solutions that are considered desirable are mathematically implemented during…

Numerical Analysis · Mathematics 2023-02-07 Michael J. Byrne , Rosemary A. Renaut

Matrix regression plays an important role in modern data analysis due to its ability to handle complex relationships involving both matrix and vector variables. We propose a class of regularized regression models capable of predicting both…

Optimization and Control · Mathematics 2025-01-14 Meixia Lin , Ziyang Zeng , Yangjing Zhang

Model predictive control (MPC) is a control strategy widely used in industrial applications. However, its implementation typically requires a mathematical model of the system being controlled, which can be a time-consuming and expensive…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Valentina Breschi , Alessandro Chiuso , Marco Fabris , Simone Formentin

This work proposes new estimators for discrete optimal transport plans that enjoy Gaussian limits centered at the true solution. This behavior stands in stark contrast with the performance of existing estimators, including those based on…

Statistics Theory · Mathematics 2025-05-08 Shuyu Liu , Florentina Bunea , Jonathan Niles-Weed

Reliability Options are capacity remuneration mechanisms aimed at enhancing security of supply in electricity systems. They can be framed as call options on electricity sold by power producers to System Operators. This paper provides a…

Pricing of Securities · Quantitative Finance 2019-09-13 Luisa Andreis , Maria Flora , Fulvio Fontini , Tiziano Vargiolu

We conduct an extensive empirical study on short-term electricity price forecasting (EPF) to address the long-standing question if the optimal model structure for EPF is univariate or multivariate. We provide evidence that despite a minor…

Applications · Statistics 2018-05-18 Florian Ziel , Rafal Weron

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

Econometrics · Economics 2020-06-12 Matteo Mogliani , Anna Simoni

Challenging research in various fields has driven a wide range of methodological advances in variable selection for regression models with high-dimensional predictors. In comparison, selection of nonlinear functions in models with additive…

Methodology · Statistics 2013-03-05 Fabian Scheipl , Thomas Kneib , Ludwig Fahrmeir

The expectation-maximization (EM) algorithm and its variants are widely used in statistics. In high-dimensional mixture linear regression, the model is assumed to be a finite mixture of linear regression and the number of predictors is much…

Statistics Theory · Mathematics 2023-07-24 Ning Wang , Xin Zhang , Qing Mai

Short-term electricity markets are becoming more relevant due to less-predictable renewable energy sources, attracting considerable attention from the industry. The balancing market is the closest to real-time and the most volatile among…

Machine Learning · Computer Science 2024-02-14 Ciaran O'Connor , Joseph Collins , Steven Prestwich , Andrea Visentin

Regularization plays a pivotal role when facing the challenge of solving ill-posed inverse problems, where the number of observations is smaller than the ambient dimension of the object to be estimated. A line of recent work has studied…

Optimization and Control · Mathematics 2014-07-03 Samuel Vaiter , Mohammad Golbabaee , Jalal M. Fadili , Gabriel Peyré

This letter proposes to estimate low-rank matrices by formulating a convex optimization problem with non-convex regularization. We employ parameterized non-convex penalty functions to estimate the non-zero singular values more accurately…

Computer Vision and Pattern Recognition · Computer Science 2016-04-14 Ankit Parekh , Ivan W. Selesnick

Deep neural networks have had an enormous impact on image analysis. State-of-the-art training methods, based on weight decay and DropOut, result in impressive performance when a very large training set is available. However, they tend to…

Machine Learning · Computer Science 2019-09-02 Amal Rannen Triki , Matthew B. Blaschko

We present algorithms for efficiently learning regularizers that improve generalization. Our approach is based on the insight that regularizers can be viewed as upper bounds on the generalization gap, and that reducing the slack in the…

Machine Learning · Computer Science 2019-02-25 Matthew Streeter

While the field of electricity price forecasting has benefited from plenty of contributions in the last two decades, it arguably lacks a rigorous approach to evaluating new predictive algorithms. The latter are often compared using unique,…

Applications · Statistics 2022-04-07 Jesus Lago , Grzegorz Marcjasz , Bart De Schutter , Rafał Weron