English
Related papers

Related papers: A weighted L1-minimization approach for sparse pol…

200 papers

The aim of sparse approximation is to estimate a sparse signal according to the measurement matrix and an observation vector. It is widely used in data analytics, image processing, and communication, etc. Up to now, a lot of research has…

Signal Processing · Electrical Eng. & Systems 2018-05-31 Hao Wang , Ruibin Feng , Chi-Sing Leung

Surrogate-modelling techniques including Polynomial Chaos Expansion (PCE) is commonly used for statistical estimation (aka. Uncertainty Quantification) of quantities of interests obtained from expensive computational models. PCE is a…

Computational Engineering, Finance, and Science · Computer Science 2019-09-05 Alexander Tarakanov , Ahmed H. Elsheikh

We extend the work of Hahn and Carvalho (2015) and develop a doubly-regularized sparse regression estimator by synthesizing Bayesian regularization with penalized least squares within a decision-theoretic framework. In contrast to existing…

Methodology · Statistics 2025-02-04 Aihua Li , Surya T. Tokdar , Jason Xu

In this paper we study the compressed sensing problem of recovering a sparse signal from a system of underdetermined linear equations when we have prior information about the probability of each entry of the unknown signal being nonzero. In…

Information Theory · Computer Science 2009-01-20 M. Amin Khajehnejad , Weiyu Xu , Salman Avestimehr , Babak Hassibi

Sparse reconstruction approaches using the re-weighted l1-penalty have been shown, both empirically and theoretically, to provide a significant improvement in recovering sparse signals in comparison to the l1-relaxation. However, numerical…

Machine Learning · Statistics 2013-12-06 Dmitry Malioutov , Aleksandr Aravkin

Growing uncertainty from renewable energy integration and distributed energy resources motivate the need for advanced tools to quantify the effect of uncertainty and assess the risks it poses to secure system operation. Polynomial chaos…

Optimization and Control · Mathematics 2019-10-16 David Métivier , Marc Vuffray , Sidhant Misra

Presence of a high-dimensional stochastic parameter space with discontinuities poses major computational challenges in analyzing and quantifying the effects of the uncertainties in a physical system. In this paper, we propose a stochastic…

Numerical Analysis · Mathematics 2018-08-01 Anindya Bhaduri , Yanyan He , Michael D. Shields , Lori Graham-Brady , Robert M. Kirby

$\ell_1$ penalized quantile regression is used in many fields as an alternative to penalized least squares regressions for high-dimensional data analysis. Existing algorithms for penalized quantile regression either use linear programming,…

Computation · Statistics 2025-02-19 Sanghee Kim , Sumanta Basu

In this paper we consider sparse approximation problems, that is, general $l_0$ minimization problems with the $l_0$-"norm" of a vector being a part of constraints or objective function. In particular, we first study the first-order…

Machine Learning · Computer Science 2012-05-31 Zhaosong Lu , Yong Zhang

This work considers the problem of computing the canonical polyadic decomposition (CPD) of large tensors. Prior works mostly leverage data sparsity to handle this problem, which is not suitable for handling dense tensors that often arise in…

Signal Processing · Electrical Eng. & Systems 2020-03-26 Xiao Fu , Shahana Ibrahim , Hoi-To Wai , Cheng Gao , Kejun Huang

Polynomial chaos expansions (PCEs) have been used in many real-world engineering applications to quantify how the uncertainty of an output is propagated from inputs. PCEs for models with independent inputs have been extensively explored in…

Systems and Control · Electrical Eng. & Systems 2021-06-02 Zhanlin Liu , Youngjun Choe

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. They were first dedicated to linear variable selection but numerous extensions have now emerged such as structured sparsity or kernel…

Machine Learning · Computer Science 2011-11-24 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

The paper deals with the problem of finding sparse solutions to systems of polynomial equations possibly perturbed by noise. In particular, we show how these solutions can be recovered from group-sparse solutions of a derived system of…

Information Theory · Computer Science 2014-07-17 Fabien Lauer , Henrik Ohlsson

We consider the problem of approximating a function from $L^2$ by an element of a given $m$-dimensional space $V_m$, associated with some feature map $\boldsymbol{\varphi}$, using evaluations of the function at random points $x_1,…

Numerical Analysis · Mathematics 2025-08-01 Anthony Nouy , Bertrand Michel

This paper aims to build an estimate of an unknown density of the data with measurement error as a linear combination of functions from a dictionary. Inspired by the penalization approach, we propose the weighted Elastic-net penalized…

Statistics Theory · Mathematics 2020-07-07 Xiaowei Yang , Huiming Zhang , Haoyu Wei , Shouzheng Zhang

Sampling orthogonal polynomial bases via Monte Carlo is of interest for uncertainty quantification of models with high-dimensional random inputs, using Polynomial Chaos (PC) expansions. It is known that bounding a probabilistic parameter,…

Probability · Mathematics 2015-06-22 Jerrad Hampton , Alireza Doostan

In the context of uncertainty quantification, computational models are required to be repeatedly evaluated. This task is intractable for costly numerical models. Such a problem turns out to be even more severe for stochastic simulators, the…

Computation · Statistics 2022-11-29 X. Zhu , B. Sudret

A new approximation format for solutions of partial differential equations depending on infinitely many parameters is introduced. By combining low-rank tensor approximation in a selected subset of variables with a sparse polynomial…

Numerical Analysis · Mathematics 2025-06-25 Markus Bachmayr , Huqing Yang

Randomized matrix compression techniques, such as the Johnson-Lindenstrauss transform, have emerged as an effective and practical way for solving large-scale problems efficiently. With a focus on computational efficiency, however, forsaking…

Machine Learning · Statistics 2015-10-19 Stephen Becker , Ban Kawas , Marek Petrik , Karthikeyan N. Ramamurthy

Polynomial chaos expansion (PCE) is a classical and widely used surrogate modeling technique in physical simulation and uncertainty quantification. By taking a linear combination of a set of basis polynomials - orthonormal with respect to…

Machine Learning · Computer Science 2026-04-01 Johannes Exenberger , Sascha Ranftl , Robert Peharz