English
Related papers

Related papers: Sparse structures with LASSO through Principal Com…

200 papers

In the field of big data analytics, the search for efficient subdata selection methods that enable robust statistical inferences with minimal computational resources is of high importance. A procedure prior to subdata selection could…

Methodology · Statistics 2024-11-12 Vasilis Chasiotis , Lin Wang , Dimitris Karlis

Sparse linear prediction methods suffer from decreased prediction accuracy when the predictor variables have cluster structure (e.g. there are highly correlated groups of variables). To improve prediction accuracy, various methods have been…

Machine Learning · Statistics 2022-02-03 Rebecca Marion , Johannes Lederer , Bernadette Govaerts , Rainer von Sachs

This paper is about a curious phenomenon. Suppose we have a data matrix, which is the superposition of a low-rank component and a sparse component. Can we recover each component individually? We prove that under some suitable assumptions,…

Information Theory · Computer Science 2009-12-21 Emmanuel J. Candes , Xiaodong Li , Yi Ma , John Wright

High-dimensional real-world systems can often be well characterized by a small number of simultaneous low-complexity interactions. The analysis of variance (ANOVA) decomposition and the anchored decomposition are typical techniques to find…

Numerical Analysis · Mathematics 2024-03-29 Fatima Antarou Ba , Oleh Melnyk , Christian Wald , Gabriele Steidl

We study private matrix analysis in the sliding window model where only the last $W$ updates to matrices are considered useful for analysis. We give first efficient $o(W)$ space differentially private algorithms for spectral approximation,…

Machine Learning · Computer Science 2020-09-08 Jalaj Upadhyay , Sarvagya Upadhyay

The lasso has become an important practical tool for high dimensional regression as well as the object of intense theoretical investigation. But despite the availability of efficient algorithms, the lasso remains computationally demanding…

Statistics Theory · Mathematics 2009-11-23 Christopher Genovese , Jiashun Jin , Larry Wasserman

Sparse principal component analysis (sparse PCA) aims at finding a sparse basis to improve the interpretability over the dense basis of PCA, meanwhile the sparse basis should cover the data subspace as much as possible. In contrast to most…

Machine Learning · Computer Science 2014-05-02 Zhenfang Hu , Gang Pan , Yueming Wang , Zhaohui Wu

Approximations to Gaussian processes based on inducing variables, combined with variational inference techniques, enable state-of-the-art sparse approaches to infer GPs at scale through mini batch-based learning. In this work, we address…

Machine Learning · Statistics 2021-07-21 Gia-Lac Tran , Dimitrios Milios , Pietro Michiardi , Maurizio Filippone

This chapter covers methodological issues related to estimation, testing and computation for models involving structural changes. Our aim is to review developments as they relate to econometric applications based on linear models.…

Econometrics · Economics 2018-05-11 Alessandro Casini , Pierre Perron

Gaussian Graphical Models (GGMs) are popular tools for studying network structures. However, many modern applications such as gene network discovery and social interactions analysis often involve high-dimensional noisy data with outliers or…

Machine Learning · Statistics 2015-10-30 Eunho Yang , Aurélie C. Lozano

Understanding and predicting the electric consumption patterns in the short-, mid- and long-term, at the distribution and transmission level, is a fundamental asset for smart grids infrastructure planning, dynamic network reconfiguration,…

Systems and Control · Electrical Eng. & Systems 2020-02-27 Davide Beretta , Samuele Grillo , Davide Pigoli , Enea Bionda , Claudio Bossi , Carlo Tornelli

We show that pooling countries across a panel dimension to macroeconomic data can improve by a statistically significant margin the generalization ability of structural, reduced form, and machine learning (ML) methods to produce…

General Economics · Economics 2022-03-15 Cameron Fen , Samir Undavia

We propose a functional MIDAS model to leverage high-frequency information for forecasting and nowcasting distributions observed at a lower frequency. We approximate the low-frequency distribution using Functional Principal Component…

Econometrics · Economics 2024-11-11 Massimiliano Marcellino , Andrea Renzetti , Tommaso Tornese

Stochastic principal component analysis (SPCA) has become a popular dimensionality reduction strategy for large, high-dimensional datasets. We derive a simplified algorithm, called Lazy SPCA, which has reduced computational complexity and…

Machine Learning · Statistics 2017-09-22 Michael Wojnowicz , Dinh Nguyen , Li Li , Xuan Zhao

We develop a novel Bayesian framework for dynamic modeling of mixed frequency data to nowcast quarterly U.S. GDP growth. The introduced framework utilizes foundational Bayesian theory and treats data sampled at different frequencies as…

Methodology · Statistics 2018-06-11 Kenichiro McAlinn

The LASSO is a recent technique for variable selection in the regression model \bean y & = & X\beta + z, \eean where $X\in \R^{n\times p}$ and $z$ is a centered gaussian i.i.d. noise vector $\mathcal N(0,\sigma^2I)$. The LASSO has been…

Statistics Theory · Mathematics 2023-12-21 Mohamed Ibrahim Assoweh , Emmanuel Caron , Stéphane Chrétien

The paper uses structured machine learning regressions for nowcasting with panel data consisting of series sampled at different frequencies. Motivated by the problem of predicting corporate earnings for a large cross-section of firms with…

Econometrics · Economics 2023-07-07 Andrii Babii , Ryan T. Ball , Eric Ghysels , Jonas Striaukas

Similar to variable selection in the linear regression model, selecting significant components in the popular additive regression model is of great interest. However, such components are unknown smooth functions of independent variables,…

Methodology · Statistics 2011-01-04 Xia Cui , Heng Peng , Songqiao Wen , Lixing Zhu

Many businesses and industries require accurate forecasts for weekly time series nowadays. However, the forecasting literature does not currently provide easy-to-use, automatic, reproducible and accurate approaches dedicated to this task.…

Machine Learning · Computer Science 2023-12-05 Rakshitha Godahewa , Christoph Bergmeir , Geoffrey I. Webb , Pablo Montero-Manso

In a variety of disciplines such as social sciences, psychology, medicine and economics, the recorded data are considered to be noisy measurements of latent variables connected by some causal structure. This corresponds to a family of…

Machine Learning · Computer Science 2014-08-12 Ricardo Silva , Robert B. Gramacy