English
Related papers

Related papers: Lasso-based forecast combinations for forecasting …

200 papers

We study the problem of variable selection in convex nonparametric least squares (CNLS). Whereas the least absolute shrinkage and selection operator (Lasso) is a popular technique for least squares, its variable selection performance is…

Methodology · Statistics 2025-10-31 Zhiqiang Liao , Zhaonan Qu

The precision matrix that encodes conditional linear dependency relations among a set of variables forms an important object of interest in multivariate analysis. Sparse estimation procedures for precision matrices such as the graphical…

Methodology · Statistics 2023-03-09 Gaëtan Louvet , Jakob Raymaekers , Germain Van Bever , Ines Wilms

This paper aims to examine the use of sparse methods to forecast the real, in the chain-linked volume sense, expenditure components of the US and EU GDP in the short-run sooner than the national institutions of statistics officially release…

Econometrics · Economics 2020-10-29 Saulius Jokubaitis , Dmitrij Celov , Remigijus Leipus

This paper proposes a parsimoniously time varying parameter vector autoregressive model (with exogenous variables, VARX) and studies the properties of the Lasso and adaptive Lasso as estimators of this model. The parameters of the model are…

Statistics Theory · Mathematics 2014-11-21 Laurent Callot , Johannes Tang Kristensen

For high-dimensional omics data, sparsity-inducing regularization methods such as the Lasso are widely used and often yield strong predictive performance, even in settings when the assumption of sparsity is likely violated. We demonstrate…

Methodology · Statistics 2025-02-13 Andrea Bratsberg , Magne Thoresen , Jelle J. Goeman

When a series of (related) linear models has to be estimated it is often appropriate to combine the different data-sets to construct more efficient estimators. We use $\ell_1$-penalized estimators like the Lasso or the Adaptive Lasso which…

Statistics Theory · Mathematics 2007-12-18 Lukas Meier , Peter Bühlmann

Water demand is a highly important variable for operational control and decision making. Hence, the development of accurate forecasts is a valuable field of research to further improve the efficiency of water utilities. Focusing on…

Applications · Statistics 2020-05-12 Jens Kley-Holsteg , Florian Ziel

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

Statistics Theory · Mathematics 2009-03-02 Nicolai Meinshausen , Bin Yu

An approach to inference for relative sparsity was developed in prior work, and an adaptive lasso asymptotic normality theorem was given there, but this theorem was not fully used when estimating the variance of the policy coefficients.…

Methodology · Statistics 2026-05-05 Samuel Julian Weisenthal

The $\ell_1$-penalized method, or the Lasso, has emerged as an important tool for the analysis of large data sets. Many important results have been obtained for the Lasso in linear regression which have led to a deeper understanding of…

Machine Learning · Statistics 2011-12-30 Jian Huang , Cun-Hui Zhang

Many theoretical results for the lasso require the samples to be iid. Recent work has provided guarantees for the lasso assuming that the time series is generated by a sparse Vector Auto-Regressive (VAR) model with Gaussian innovations.…

Statistics Theory · Mathematics 2019-03-22 Kam Chung Wong , Zifan Li , Ambuj Tewari

Improvement of time series forecasting accuracy through combining multiple models is an important as well as a dynamic area of research. As a result, various forecasts combination methods have been developed in literature. However, most of…

Artificial Intelligence · Computer Science 2013-02-28 Ratnadip Adhikari , R. K. Agrawal

The adaptive LASSO has been used for consistent variable selection in place of LASSO in the linear regression model. In this article, we propose a modified LARS algorithm to combine adaptive LASSO with some biased estimators, namely the…

Methodology · Statistics 2024-07-02 Manickavasagar Kayanan , Pushpakanthie Wijekoon

We propose a generalization of the lasso that allows the model coefficients to vary as a function of a general set of modifying variables. These modifiers might be variables such as gender, age or time. The paradigm is quite general, with…

Methodology · Statistics 2018-01-11 Robert Tibshirani , Jerome Friedman

Forecast combinations have flourished remarkably in the forecasting community and, in recent years, have become part of the mainstream of forecasting research and activities. Combining multiple forecasts produced from single (target) series…

Methodology · Statistics 2022-09-26 Xiaoqian Wang , Rob J Hyndman , Feng Li , Yanfei Kang

A model-based approach to forecasting chaotic dynamical systems utilizes knowledge of the physical processes governing the dynamics to build an approximate mathematical model of the system. In contrast, machine learning techniques have…

Machine Learning · Computer Science 2018-05-09 Jaideep Pathak , Alexander Wikner , Rebeckah Fussell , Sarthak Chandra , Brian Hunt , Michelle Girvan , Edward Ott

In high-dimensions, many variable selection methods, such as the lasso, are often limited by excessive variability and rank deficiency of the sample covariance matrix. Covariance sparsity is a natural phenomenon in high-dimensional…

Methodology · Statistics 2010-06-08 X. Jessie Jeng And Z. John Daye

Nowadays an increasing amount of data is available and we have to deal with models in high dimension (number of covariates much larger than the sample size). Under sparsity assumption it is reasonable to hope that we can make a good…

Statistics Theory · Mathematics 2014-01-23 Mélanie Blazère , Jean-Michel Loubes , Fabrice Gamboa

We consider situations where a user feeds her attributes to a machine learning method that tries to predict her best option based on a random sample of other users. The predictor is incentive-compatible if the user has no incentive to…

Econometrics · Economics 2021-09-07 Mehmet Caner , Kfir Eliaz

Selective inference methods are developed for group lasso estimators for use with a wide class of distributions and loss functions. The method includes the use of exponential family distributions, as well as quasi-likelihood modeling for…

Methodology · Statistics 2024-03-28 Yiling Huang , Sarah Pirenne , Snigdha Panigrahi , Gerda Claeskens