English
Related papers

Related papers: Exploiting Low-Dimensional Structure in Astronomic…

200 papers

Estimating redshifts from broadband photometry is often limited by how accurately we can map the colors of galaxies to an underlying spectral template. Current techniques utilize spectrophotometric samples of galaxies or spectra derived…

Instrumentation and Methods for Astrophysics · Physics 2025-03-11 John Franklin Crenshaw , Andrew J. Connolly

Previous versions of sparse principal component analysis (PCA) have presumed that the eigen-basis (a $p \times k$ matrix) is approximately sparse. We propose a method that presumes the $p \times k$ matrix becomes approximately sparse after…

Machine Learning · Statistics 2023-08-07 Fan Chen , Karl Rohe

Principal component analysis (PCA) for binary data, known as logistic PCA, has become a popular alternative to dimensionality reduction of binary data. It is motivated as an extension of ordinary PCA by means of a matrix factorization, akin…

Machine Learning · Statistics 2020-09-08 Andrew J. Landgraf , Yoonkyung Lee

When performing classification tasks, raw high dimensional features often contain redundant information, and lead to increased computational complexity and overfitting. In this paper, we assume the data samples lie on a single underlying…

Image and Video Processing · Electrical Eng. & Systems 2020-08-11 Bowen Jiang , Maohao Shen

Real-time or near real-time hyperspectral detection and identification are extremely useful and needed in many fields. These data sets can be quite large, and the algorithms can require numerous computations that slow the process down. A…

Image and Video Processing · Electrical Eng. & Systems 2023-11-27 Abigail Basener , Meagan Herald

We apply a combination of a Genetic Algorithms (GA) and Support Vector Machines (SVM) machine learning algorithm to solve two important problems faced by the astronomical community: star/galaxy separation, and photometric redshift…

Instrumentation and Methods for Astrophysics · Physics 2016-04-27 S. Heinis , S. Kumar , S. Gezari , W. S. Burgett , K. C. Chambers , P. W. Draper , H. Flewelling , N. Kaiser , E. A. Magnier , N. Metcalfe , C. Waters

This paper introduces the Class-wise Principal Component Analysis, a supervised feature extraction method for hyperspectral data. Hyperspectral Imaging (HSI) has appeared in various fields in recent years, including Remote Sensing.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Dimitra Koumoutsou , Eleni Charou , Georgios Siolas , Giorgos Stamou

In the course of the last century, Principal Component Analysis (PCA) have become one of the pillars of modern scientific methods. Although PCA is normally addressed as a statistical tool aiming at finding orthogonal directions on which the…

Statistics Theory · Mathematics 2019-07-30 Yariv Aizenbud , Barak Sober

Principal Component Analysis (PCA) is a classical method for reducing the dimensionality of data by projecting them onto a subspace that captures most of their variation. Effective use of PCA in modern applications requires understanding…

Statistics Theory · Mathematics 2019-06-14 David Hong , Laura Balzano , Jeffrey A. Fessler

Resolving fine details of astronomical objects provides critical insights into their underlying physical processes. This drives in part the desire to construct ever-larger telescopes and interferometer arrays and to observe at shorter…

Principal Component Analysis (PCA) is a fundamental data preprocessing tool in the world of machine learning. While PCA is often thought of as a dimensionality reduction method, the purpose of PCA is actually two-fold: dimension reduction…

Machine Learning · Computer Science 2023-01-25 Arpita Gang , Waheed U. Bajwa

Principal component analysis (PCA) is a popular dimension reduction technique often used to visualize high-dimensional data structures. In genomics, this can involve millions of variables, but only tens to hundreds of observations.…

Statistics Theory · Mathematics 2020-06-11 Kristoffer Hellton , Magne Thoresen

Measuring the physical properties of galaxies such as redshift frequently requires the use of Spectral Energy Distributions (SEDs). SED template sets are, however, often small in number and cover limited portions of photometric color space.…

Instrumentation and Methods for Astrophysics · Physics 2017-12-13 J. Bryce Kalmbach , Andrew J. Connolly

Diffusion maps (DMAP) are often used as a dimensionality-reduction tool, but more precisely they provide a spectral representation of the intrinsic geometry rather than a complete charting method. To illustrate this distinction, we study a…

Machine Learning · Computer Science 2026-03-31 Julio Candanedo , Alejandro Patiño

Principal component analysis (PCA) is widely used for dimensionality reduction, with well-documented merits in various applications involving high-dimensional data, including computer vision, preference measurement, and bioinformatics. In…

Machine Learning · Statistics 2013-10-01 Gonzalo Mateos , Georgios B. Giannakis

Mapping human genetic variation is fundamentally interesting in fields such as anthropology and forensic inference. At the same time patterns of genetic diversity confound efforts to determine the genetic basis of complex disease. Due to…

Applications · Statistics 2010-07-13 Ann B. Lee , Diana Luca , Kathryn Roeder

Ptychography is a data-intensive computational imaging technique that achieves high spatial resolution over large fields of view. The technique involves scanning a coherent beam across overlapping regions and recording diffraction patterns.…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Refik Mert Cam , Junjing Deng , Rajkumar Kettimuthu , Mathew J. Cherukara , Tekin Bicer

We demonstrate the use of a variant of Principal Component Analysis (PCA) for discrimination problems in astronomy. This variant of PCA is shown to provide the best linear discrimination between data classes. As a test case, we present the…

Astrophysics · Physics 2009-10-30 Rodrigo Ibata , Michael Irwin

Principal Component Analysis (PCA) is a powerful and popular dimensionality reduction technique. However, due to its linear nature, it often fails to capture the complex underlying structure of real-world data. While Kernel PCA (kPCA)…

Machine Learning · Computer Science 2026-02-05 Thomas Uriot , Elise Chung

We present a novel approach to photometric redshifts, one that merges the advantages of both the template fitting and empirical fitting algorithms, without any of their disadvantages. This technique derives a set of templates, describing…

Astrophysics · Physics 2009-10-31 I. Csabai , A. J. Connolly , A. S. Szalay , T. Budavari