English
Related papers

Related papers: Optimal whitening and decorrelation

200 papers

Our main objective is to develop a denoising strategy to increase the signal to noise ratio of individual spectral lines of stellar spectropolarimetric observations. We use a multivariate statistics technique called Principal Component…

The implementation of conventional sparse principal component analysis (SPCA) on high-dimensional data sets has become a time consuming work. In this paper, a series of subspace projections are constructed efficiently by using Household QR…

Machine Learning · Statistics 2019-12-09 Cong Xu , Min Yang , Jin Zhang

Random features approach has been widely used for kernel approximation in large-scale machine learning. A number of recent studies have explored data-dependent sampling of features, modifying the stochastic oracle from which random features…

Machine Learning · Computer Science 2021-11-03 Yinsong Wang , Shahin Shahrampour

Image forensics, aiming to ensure the authenticity of the image, has made great progress in dealing with common image manipulation such as copy-move, splicing, and inpainting in the past decades. However, only a few researchers pay…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Yushu Zhang , Nuo Chen , Shuren Qi , Mingfu Xue , Xiaochun Cao

Convolutional precoding in polarization-adjusted convolutional (PAC) codes can reduce the number of minimum weight codewords (a.k.a error coefficient) of polar codes. This can result in improving the error correction performance of (near)…

Information Theory · Computer Science 2022-12-02 Xinyi Gu , Mohammad Rowshan , Jinhong Yuan

We consider the problem of maximizing the variance explained from a data matrix using orthogonal sparse principal components that have a support of fixed cardinality. While most existing methods focus on building principal components (PCs)…

Optimization and Control · Mathematics 2022-10-14 Dimitris Bertsimas , Driss Lahlou Kitane

Given a sample covariance matrix, we examine the problem of maximizing the variance explained by a linear combination of the input variables while constraining the number of nonzero coefficients in this combination. This is known as sparse…

Optimization and Control · Mathematics 2010-12-24 Youwei Zhang , Alexandre d'Aspremont , Laurent El Ghaoui

The aim of this paper is to introduce and study a two-step debiasing method for variational regularization. After solving the standard variational problem, the key idea is to add a consecutive debiasing step minimizing the data fidelity on…

Numerical Analysis · Mathematics 2017-06-23 Eva-Maria Brinkmann , Martin Burger , Julian Rasch , Camille Sutour

Previous versions of sparse principal component analysis (PCA) have presumed that the eigen-basis (a $p \times k$ matrix) is approximately sparse. We propose a method that presumes the $p \times k$ matrix becomes approximately sparse after…

Machine Learning · Statistics 2023-08-07 Fan Chen , Karl Rohe

In this paper, we propose novel strategies for neutral vector variable decorrelation. Two fundamental invertible transformations, namely serial nonlinear transformation and parallel nonlinear transformation, are proposed to carry out the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Zhanyu Ma , Jing-Hao Xue , Arne Leijon , Zheng-Hua Tan , Zhen Yang , Jun Guo

Recently, the prediction-correction method has been developed to solve nonlinear convex optimization problems. However, its convergence rate is often poor since large regularization parameters are set to ensure convergence conditions. In…

Optimization and Control · Mathematics 2024-11-05 Sai Wang

There are a multitude of methods to perform multi-set correlated component analysis (MCCA), including some that require iterative solutions. The methods differ on the criterion they optimize and the constraints placed on the solutions. This…

Machine Learning · Statistics 2018-02-13 Lucas C Parra

Existing methods for rotation estimation between two spherical ($\mathbb{S}^2$) patterns typically rely on spherical cross-correlation maximization between two spherical function. However, these approaches exhibit computational complexities…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Anik Sarker , Alan T. Asbeck

A new technique is presented for producing images from interferometric data. The method, ``smear fitting'', makes the constraints necessary for interferometric imaging double as a model, with uncertainties, of the sky brightness…

Astrophysics · Physics 2009-11-11 Robert I. Reid

A study of general properties of the narrow-width approximation (NWA) with polarization/spin decorrelation is presented. We prove for total rates of arbitrary resonant decay or scattering processes with an on-shell intermediate state…

High Energy Physics - Phenomenology · Physics 2009-03-24 C. F. Uhlemann , N. Kauer

Sparse Filtering is a popular feature learning algorithm for image classification pipelines. In this paper, we connect the performance of Sparse Filtering with spectral properties of the corresponding feature matrices. This connection…

Computer Vision and Pattern Recognition · Computer Science 2015-05-26 Johannes Lederer , Sergio Guadarrama

A statistical learning/inference framework for color demosaicing is presented. We start with simplistic assumptions about color constancy, and recast color demosaicing as a blind linear inverse problem: color parameterizes the unknown…

Computer Vision and Pattern Recognition · Computer Science 2010-02-12 J. H. Oaknin

Feature whitening is a known technique for speeding up training of DNN. Under certain assumptions, whitening the activations reduces the Fisher information matrix to a simple identity matrix, in which case stochastic gradient descent is…

Machine Learning · Computer Science 2020-11-10 Shmulik Markovich-Golan , Barak Battash , Amit Bleiweiss

We investigate discrete spin transformations, a geometric framework to manipulate surface meshes by controlling mean curvature. Applications include surface fairing -- flowing a mesh onto say, a reference sphere -- and mesh extrusion --…

Computational Geometry · Computer Science 2019-06-11 Loic Le Folgoc , Daniel C. Castro , Jeremy Tan , Bishesh Khanal , Konstantinos Kamnitsas , Ian Walker , Amir Alansary , Ben Glocker

This paper studies the related problems of prediction, covariance estimation, and principal component analysis for the spiked covariance model with heteroscedastic noise. We consider an estimator of the principal components based on…

Other Statistics · Statistics 2021-09-21 William Leeb , Elad Romanov