English
Related papers

Related papers: Modelling multimodal photometric redshift regressi…

200 papers

The cosmological exploitation of modern photometric galaxy surveys requires both accurate (unbiased) and precise (narrow) redshift probability distributions derived from broadband photometry. Existing methodologies do not meet those…

Cosmology and Nongalactic Astrophysics · Physics 2019-08-21 Boris Leistedt , David W. Hogg , Risa H. Wechsler , Joe DeRose

This work presents a novel approach for robust PCA with total variation regularization for foreground-background separation and denoising on noisy, moving camera video. Our proposed algorithm registers the raw (possibly corrupted) frames of…

Machine Learning · Statistics 2017-09-28 Chen Gao , Brian E. Moore , Raj Rao Nadakuditi

Interpretability and uncertainty quantification in machine learning can provide justification for decisions, promote scientific discovery and lead to a better understanding of model behavior. Symbolic regression provides inherently…

Neural and Evolutionary Computing · Computer Science 2022-11-23 G. F. Bomarito , P. E. Leser , N. C. M Strauss , K. M. Garbrecht , J. D. Hochhalter

Principal component analysis (PCA) is a well-known tool in multivariate statistics. One significant challenge in using PCA is the choice of the number of components. In order to address this challenge, we propose an exact distribution-based…

Methodology · Statistics 2015-06-02 Yunjin Choi , Jonathan Taylor , Robert Tibshirani

In datasets where the number of parameters is fixed and the number of samples is large, principal component analysis (PCA) is a powerful dimension reduction tool. However, in many contemporary datasets, when the number of parameters is…

Probability · Mathematics 2019-02-14 Enrico Au-Yeung , Greg Zanotti

Our main objective is to develop a denoising strategy to increase the signal to noise ratio of individual spectral lines of stellar spectropolarimetric observations. We use a multivariate statistics technique called Principal Component…

Random pulse sequences are a powerful method for qubit noise spectroscopy, enabling efficient reconstruction of sparse noise spectra. Here, we advance this method in two complementary directions. First, we extend the method using a…

Quantum Physics · Physics 2026-01-07 Kaixin Huang , Demitry Farfurnik , Dror Baron , Yi-Kai Liu

Dynamic factor models are often estimated by point-estimation methods, disregarding parameter uncertainty. We propose a method accounting for parameter uncertainty by means of posterior approximation, using variational inference. Our…

Methodology · Statistics 2022-10-14 Erik Spånberg

Weak lensing convergence maps - upon which higher order statistics can be calculated - can be recovered from observations of the shear field by solving the lensing inverse problem. For typical surveys this inverse problem is ill-posed…

Cosmology and Nongalactic Astrophysics · Physics 2021-02-08 Matthew A. Price , Xiaohao Cai , Jason D. McEwen , Thomas D. Kitching

This paper introduces a lightweight uncertainty estimator capable of predicting multimodal (disjoint) uncertainty bounds by integrating conformal prediction with a deep-learning regressor. We specifically discuss its application for visual…

Machine Learning · Computer Science 2023-09-21 Domenico Parente , Nastaran Darabi , Alex C. Stutts , Theja Tulabandhula , Amit Ranjan Trivedi

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer

This paper presents a unified geometric framework for the statistical analysis of a general ill-posed linear inverse model which includes as special cases noisy compressed sensing, sign vector recovery, trace regression, orthogonal matrix…

Statistics Theory · Mathematics 2020-07-27 T. Tony Cai , Tengyuan Liang , Alexander Rakhlin

Peak counts have been shown to be an excellent tool to extract the non-Gaussian part of the weak lensing signal. Recently, we developped a fast stochastic forward model to predict weak-lensing peak counts. Our model is able to reconstruct…

Cosmology and Nongalactic Astrophysics · Physics 2015-11-16 Chieh-An Lin , Martin Kilbinger

We propose a robust principal component analysis (RPCA) framework to recover low-rank and sparse matrices from temporal observations. We develop an online version of the batch temporal algorithm in order to process larger datasets or…

Machine Learning · Statistics 2022-08-04 Hong-Lan Botterman , Julien Roussel , Thomas Morzadec , Ali Jabbari , Nicolas Brunel

PCA is one of the most widely used dimension reduction techniques. A related easier problem is "subspace learning" or "subspace estimation". Given relatively clean data, both are easily solved via singular value decomposition (SVD). The…

Information Theory · Computer Science 2020-06-25 Namrata Vaswani , Thierry Bouwmans , Sajid Javed , Praneeth Narayanamurthy

Weak lensing is a potentially robust and model-independent cosmological probe, but its accuracy is dependent on knowledge of the redshift distribution of the source galaxies used. The most robust way to determine the redshift distribution…

Astrophysics · Physics 2009-11-10 Mustapha Ishak , Christopher M. Hirata

Random projection is widely used as a method of dimension reduction. In recent years, its combination with standard techniques of regression and classification has been explored. Here we examine its use with principal component analysis…

Methodology · Statistics 2012-04-13 Qi Ding , Eric D. Kolaczyk

Independent component analysis (ICA) is popular in many applications, including cognitive neuroscience and signal processing. Due to computational constraints, principal component analysis is used for dimension reduction prior to ICA…

Methodology · Statistics 2017-10-03 Benjamin B. Risk , David S. Matteson , David Ruppert

We consider the problem of linear fitting of noisy data in the case of broad (say $\alpha$-stable) distributions of random impacts ("noise"), which can lack even the first moment. This situation, common in statistical physics of small…

Data Analysis, Statistics and Probability · Physics 2015-05-27 Eugene B. Postnikov , Igor M. Sokolov