English
Related papers

Related papers: Non-linear Dimensionality Regularizer for Solving …

200 papers

We study the basic problem of robust subspace recovery. That is, we assume a data set that some of its points are sampled around a fixed subspace and the rest of them are spread in the whole ambient space, and we aim to recover the fixed…

Machine Learning · Statistics 2015-03-19 Teng Zhang , Gilad Lerman

Principal component analysis (PCA) is widely used for feature extraction and dimensionality reduction, with documented merits in diverse tasks involving high-dimensional data. Standard PCA copes with one dataset at a time, but it is…

Machine Learning · Computer Science 2019-01-30 Jia Chen , Gang Wang , Georgios B. Giannakis

Regularization plays a pivotal role when facing the challenge of solving ill-posed inverse problems, where the number of observations is smaller than the ambient dimension of the object to be estimated. A line of recent work has studied…

Optimization and Control · Mathematics 2014-07-03 Samuel Vaiter , Mohammad Golbabaee , Jalal M. Fadili , Gabriel Peyré

Principal component analysis (PCA) is widely used for dimensionality reduction, with well-documented merits in various applications involving high-dimensional data, including computer vision, preference measurement, and bioinformatics. In…

Machine Learning · Statistics 2013-10-01 Gonzalo Mateos , Georgios B. Giannakis

Principal component analysis (PCA) is known to be sensitive to outliers, so that various robust PCA variants were proposed in the literature. A recent model, called REAPER, aims to find the principal components by solving a convex…

Numerical Analysis · Mathematics 2021-03-19 Robert Beinert , Gabriele Steidl

To do dimensionality reduction on the datasets with outliers, the $\ell_1$-norm principal component analysis (L1-PCA) as a typical robust alternative of the conventional PCA has enjoyed great popularity over the past years. In this work, we…

Optimization and Control · Mathematics 2022-10-27 Taoli Zheng , Peng Wang , Anthony Man-Cho So

Sparse principal component analysis (PCA) is a well-established dimensionality reduction technique that is often used for unsupervised feature selection (UFS). However, determining the regularization parameters is rather challenging, and…

Machine Learning · Computer Science 2025-04-07 Long Chen , Xianchao Xiu

Dimensionality reduction algorithms like principal component analysis (PCA) are workhorses of machine learning and neuroscience, but each has well-known limitations. Variants of PCA are simple and interpretable, but not flexible enough to…

Machine Learning · Computer Science 2025-12-01 John J. Vastola , Samuel J. Gershman , Kanaka Rajan

Physics-based models often involve large systems of parametrized partial differential equations, where design parameters control various properties. However, high-fidelity simulations of such systems on large domains or with high grid…

Computational Physics · Physics 2025-05-15 Diba Behnoudfar

This paper introduces a computational framework to identify nonlinear input-output operators that fit a set of system trajectories while satisfying incremental integral quadratic constraints. The data fitting algorithm is thus regularized…

Optimization and Control · Mathematics 2021-10-25 Henk J. van Waarde , Rodolphe Sepulchre

Mining useful clusters from high dimensional data has received significant attention of the computer vision and pattern recognition community in the recent years. Linear and non-linear dimensionality reduction has played an important role…

Computer Vision and Pattern Recognition · Computer Science 2016-05-25 Nauman Shahid , Nathanael Perraudin , Vassilis Kalofolias , Gilles Puy , Pierre Vandergheynst

Dimensionality reduction is a fundamental technique in machine learning and data analysis, enabling efficient representation and visualization of high-dimensional data. This paper explores five key methods: Principal Component Analysis…

Other Statistics · Statistics 2025-02-19 Yuan-chin Ivan Chang

Identifying low-dimensional latent structures within high-dimensional data has long been a central topic in the machine learning community, driven by the need for data compression, storage, transmission, and deeper data understanding.…

Machine Learning · Statistics 2025-03-28 Ye Tian , Sanyou Wu , Long Feng

Multi-dimensional data completion is a critical problem in computational sciences, particularly in domains such as computer vision, signal processing, and scientific computing. Existing methods typically leverage either global low-rank…

Machine Learning · Computer Science 2025-08-07 Wenwu Gong , Lili Yang

We consider the reconstruction of a diffusion coefficient in a quasilinear elliptic problem from a single measurement of overspecified Neumann and Dirichlet data. The uniqueness for this parameter identification problem has been established…

Numerical Analysis · Mathematics 2015-06-17 Herbert Egger , Jan-Frederik Pietschmann , Matthias Schlottbom

This paper introduces a new unsupervised method for dimensionality reduction via regression (DRR). The algorithm belongs to the family of invertible transforms that generalize Principal Component Analysis (PCA) by using curvilinear instead…

Machine Learning · Statistics 2016-02-02 Valero Laparra , Jesus Malo , Gustau Camps-Valls

An emerging new paradigm for solving inverse problems is via the use of deep learning to learn a regularizer from data. This leads to high-quality results, but often at the cost of provable guarantees. In this work, we show how…

Machine Learning · Computer Science 2023-11-06 Zakhar Shumaylov , Jeremy Budd , Subhadip Mukherjee , Carola-Bibiane Schönlieb

We consider parameter identification problems in parametrized partial differential equations (PDE). This leads to nonlinear ill-posed inverse problems. One way to solve them are iterative regularization methods, which typically require…

Numerical Analysis · Mathematics 2018-05-07 Dominik Garmatter , Bernard Haasdonk , Bastian Harrach

The focus of this book is on the analysis of regularization methods for solving \emph{nonlinear inverse problems}. Specifically, we place a strong emphasis on techniques that incorporate supervised or unsupervised data derived from prior…

Optimization and Control · Mathematics 2025-06-24 Clemens Kirisits , Bochra Mejri , Sergei Pereverzev , Otmar Scherzer , Cong Shi

One aim of dimensionality reduction is to discover the main factors that explain the data, and as such is paramount to many applications. When working with high dimensional data, autoencoders offer a simple yet effective approach to learn…

Machine Learning · Computer Science 2025-08-29 Benjamin Couéraud , Vikram Sunkara , Christof Schütte