English
Related papers

Related papers: Sparse Polynomial Chaos Expansion for Universal St…

200 papers

We propose a novel method for establishing the sparsity of the coefficients of the Laguerre generalized polynomial chaos expansion of solutions to parametric elliptic PDEs with log-gamma inputs on $\mathbb{R}_+^\infty$. The established…

Numerical Analysis · Mathematics 2026-03-17 Dinh Dũng , Van Kien Nguyen , Viet Ha Hoang

Stochastic collocation (SC) is a well-known non-intrusive method of constructing surrogate models for uncertainty quantification. In dynamical systems, SC is especially suited for full-field uncertainty propagation that characterizes the…

Numerical Analysis · Mathematics 2023-10-18 Saibal De , Reese E. Jones , Hemanth Kolla

We present an enriched formulation of the Least Squares (LSQ) regression method for Uncertainty Quantification (UQ) using generalised polynomial chaos (gPC). More specifically, we enrich the linear system with additional equations for the…

Numerical Analysis · Mathematics 2023-08-09 Kyriakos D. Kantarakias , George Papadakis

Building upon our earlier work of a martingale approach to global optimization, a powerful stochastic search scheme for the global optimum of cost functions is proposed on the basis of change of measures on the states that evolve as…

Methodology · Statistics 2015-12-23 Mamatha Venugopal , Ram Mohan Vasu , Debasish Roy

Polynomial chaos expansion (PCE) is an increasingly popular technique for uncertainty propagation and quantification in systems and control. Based on the theory of Hilbert spaces and orthogonal polynomials, PCE allows for a unifying…

Systems and Control · Electrical Eng. & Systems 2020-04-09 Tillmann Mühlpfordt , Frederik Zahn , Veit Hagenmeyer , Timm Faulwasser

We consider bi-objective ranking and selection problems, where the goal is to correctly identify the Pareto optimal solutions among a finite set of candidates for which the two objective outcomes have been observed with uncertainty (e.g.,…

Machine Learning · Statistics 2024-03-29 Sebastian Rojas Gonzalez , Juergen Branke , Inneke van Nieuwenhuyse

The aim of sparse approximation is to estimate a sparse signal according to the measurement matrix and an observation vector. It is widely used in data analytics, image processing, and communication, etc. Up to now, a lot of research has…

Signal Processing · Electrical Eng. & Systems 2018-05-31 Hao Wang , Ruibin Feng , Chi-Sing Leung

We consider the problem of maximizing the variance explained from a data matrix using orthogonal sparse principal components that have a support of fixed cardinality. While most existing methods focus on building principal components (PCs)…

Optimization and Control · Mathematics 2022-10-14 Dimitris Bertsimas , Driss Lahlou Kitane

We propose a sparsity-aware evolutionary (SAE) framework for model merging that involves iterative pruning-merging cycles to act as a novel mutation operator. We incorporate the sparsity constraints into the score function, which steers the…

Machine Learning · Computer Science 2026-02-10 Huan Zhang , Yanjian Zhang , Guillaume Wisniewski , Nadi Tomeh , Bang Liu

We present and analyze a simple, two-step algorithm to approximate the optimal solution of the sparse PCA problem. Our approach first solves a L1 penalized version of the NP-hard sparse PCA optimization problem and then uses a randomized…

Data Structures and Algorithms · Computer Science 2016-11-24 Kimon Fountoulakis , Abhisek Kundu , Eugenia-Maria Kontopoulou , Petros Drineas

Principal component analysis (PCA) is a widely used technique for data analysis and dimension reduction with numerous applications in science and engineering. However, the standard PCA suffers from the fact that the principal components…

Optimization and Control · Mathematics 2009-07-14 Zhaosong Lu , Yong Zhang

Polynomial approximations of computationally intensive models are central to uncertainty quantification. This paper describes an adaptive method for non-intrusive pseudospectral approximation, based on Smolyak's algorithm with generalized…

Numerical Analysis · Computer Science 2013-06-27 Patrick R. Conrad , Youssef M. Marzouk

Sparse principal component analysis (PCA) and sparse canonical correlation analysis (CCA) are two essential techniques from high-dimensional statistics and machine learning for analyzing large-scale data. Both problems can be formulated as…

Machine Learning · Statistics 2019-03-28 Shixiang Chen , Shiqian Ma , Lingzhou Xue , Hui Zou

Maximum likelihood estimation (MLE) is a well-known estimation method used in many robotic and computer vision applications. Under Gaussian assumption, the MLE converts to a nonlinear least squares (NLS) problem. Efficient solutions to NLS…

Robotics · Computer Science 2016-08-11 Viorela Ila , Lukas Polok , Marek Solony , Pavel Svoboda

Since the introduction of the lasso in regression, various sparse methods have been developed in an unsupervised context like sparse principal component analysis (s-PCA), sparse canonical correlation analysis (s-CCA) and sparse singular…

Methodology · Statistics 2020-12-09 Ruiping Liu , Ndeye Niang , Gilbert Saporta , Huiwen Wang

Sparse Principal Component Analysis (sPCA) is a popular matrix factorization approach based on Principal Component Analysis (PCA) that combines variance maximization and sparsity with the ultimate goal of improving data interpretation. When…

Machine Learning · Statistics 2020-11-19 J. Camacho , A. K. Smilde , E. Saccenti , J. A. Westerhuis

The taxing computational effort that is involved in solving some high-dimensional statistical problems, in particular problems involving non-convex optimization, has popularized the development and analysis of algorithms that run…

Statistics Theory · Mathematics 2020-02-13 Guy Holtzman , Adam Soffer , Dan Vilenchik

The Statistical Finite Element Method (statFEM) offers a Bayesian framework for integrating computational models with observational data, thus providing improved predictions for structural health monitoring and digital twinning. This paper…

Computational Engineering, Finance, and Science · Computer Science 2025-03-26 Vahab Narouie , Henning Wessels , Fehmi Cirak , Ulrich Römer

Dimensionality reduction, cluster analysis, and sparse representation are basic components in machine learning. However, their relationships have not yet been fully investigated. In this paper, we find that the spectral graph theory…

Computer Vision and Pattern Recognition · Computer Science 2017-05-22 Zhenfang Hu , Gang Pan , Yueming Wang , Zhaohui Wu

This paper proposes an Adaptive Stochastic Model Predictive Control (MPC) strategy for stable linear time-invariant systems in the presence of bounded disturbances. We consider multi-input, multi-output systems that can be expressed by a…

Systems and Control · Electrical Eng. & Systems 2019-12-11 Monimoy Bujarbaruah , Charlott Vallon