English
Related papers

Related papers: Benchmarking Dimensionality Reduction Methods for …

200 papers

Atomic-resolution imaging with scanning transmission electron microscopy is a powerful tool for characterizing the nanoscale structure of materials, in particular features such as defects, local strains, and symmetry-breaking distortions.…

The ability to collect and analyze large amounts of data is a growing problem within the scientific community. The growing gap between data and users calls for innovative tools that address the challenges faced by big data volume, velocity…

Databases · Computer Science 2016-08-01 Vijay Gadepally , Jeremy Kepner

Clustering is an effective tool for astronomical spectral analysis, to mine clustering patterns among data. With the implementation of large sky surveys, many clustering methods have been applied to tackle spectroscopic and photometric data…

Instrumentation and Methods for Astrophysics · Physics 2022-12-19 Haifeng Yang , Chenhui Shi , Jianghui Cai , Lichan Zhou , Yuqing Yang , Xujun Zhao , Yanting He , Jing Hao

Dimension reduction is often the first step in statistical modeling or prediction of multivariate spatial data. However, most existing dimension reduction techniques do not account for the spatial correlation between observations and do not…

Methodology · Statistics 2025-05-27 Si Cheng , Magali N. Blanco , Timothy V. Larson , Lianne Sheppard , Adam Szpiro , Ali Shojaie

The advent of modern technology, permitting the measurement of thousands of characteristics simultaneously, has given rise to floods of data characterized by many large or even huge datasets. This new paradigm presents extraordinary…

Methodology · Statistics 2019-02-14 A. M. Pires , J. A. Branco

Recent and forthcoming advances in instrumentation, and giant new surveys, are creating astronomical data sets that are not amenable to the methods of analysis familiar to astronomers. Traditional methods are often inadequate not merely…

Instrumentation and Methods for Astrophysics · Physics 2024-01-30 Meyer Z. Pesenson , Isaac Z. Pesenson , Bruce McCollum

Dimension-reduction techniques can greatly improve statistical inference in astronomy. A standard approach is to use Principal Components Analysis (PCA). In this work we apply a recently-developed technique, diffusion maps, to astronomical…

Astrophysics · Physics 2011-02-11 Joseph W. Richards , Peter E. Freeman , Ann B. Lee , Chad M. Schafer

Astrophysics and cosmology are rich with data. The advent of wide-area digital cameras on large aperture telescopes has led to ever more ambitious surveys of the sky. Data volumes of entire surveys a decade ago can now be acquired in a…

Instrumentation and Methods for Astrophysics · Physics 2017-04-18 Jan Kremer , Kristoffer Stensbo-Smidt , Fabian Gieseke , Kim Steenstrup Pedersen , Christian Igel

The site conditions that make astronomical observatories in space and on the ground so desirable -- cold and dark -- demand a physical remoteness that leads to limited data transmission capabilities. Such transmission limitations directly…

Artificial Intelligence · Computer Science 2025-06-11 Tuan Truong , Rithwik Sudharsan , Yibo Yang , Peter Xiangyuan Ma , Ruihan Yang , Stephan Mandt , Joshua S. Bloom

We consider the problem of analyzing the structure of spectroscopic cubes using unsupervised machine learning techniques. We propose representing the target's signal as a homogeneous set of volumes through an iterative algorithm that…

Instrumentation and Methods for Astrophysics · Physics 2018-06-15 Mauricio Araya , Marcelo Mendoza , Mauricio Solar , Diego Mardones , Amelia Bayo

Dimensionality reduction algorithms are standard tools in a researcher's toolbox. Dimensionality reduction algorithms are frequently used to augment downstream tasks such as machine learning, data science, and also are exploratory methods…

Machine Learning · Computer Science 2022-02-24 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Meredith Wolf , Hongjun Suh , Weiyu Zong , Peter Chin

We present a two-component Machine Learning (ML) based approach for classifying astronomical images by data-quality via an examination of sources detected in the images and image pixel values from representative sources within those images.…

Instrumentation and Methods for Astrophysics · Physics 2020-04-01 Hossen Teimoorinia , J. J. Kavelaars , Stephen Gwyn , Daniel Durand , Kennedy Rolston , Alexander Ouellette

ALMA (Atacama Large Millimeter/submillimeter Array) is the world's largest ground-based facility for observations in the millimeter/submillimeter regime. One of ALMA's outstanding characteristics is the large effort dedicated to the quality…

Instrumentation and Methods for Astrophysics · Physics 2021-01-12 Theodoros Nakos , Harold Francke , Kouichiro Nakanishi , Dirk Petry , Thomas Stanke , Catarina Ubach , Luciano Cerrigone , Erica Keller , Alfonso Trejo , Junko Ueda

High-resolution stellar spectra offer valuable insights into atmospheric parameters and chemical compositions. However, their inherent complexity and high-dimensionality present challenges in fully utilizing the information they contain. In…

Instrumentation and Methods for Astrophysics · Physics 2024-09-20 Qianyu Fan

The Atacama Large mm and sub-mm Array (ALMA) radio observatory is one of the world's largest astronomical projects. After the very successful conclusion of the first observation cycles Early Science Cycles 0 and 1, the ALMA project can…

Instrumentation and Methods for Astrophysics · Physics 2020-12-17 Dirk Petry , Baltasar Vila-Vilaro , Eric Villard , Shinya Komugi , Scott Schnee

Astronomical images are of crucial importance for astronomers since they contain a lot of information about celestial bodies that can not be directly accessible. Most of the information available for the analysis of these objects starts…

Numerical Analysis · Mathematics 2019-04-10 Silvia Tozza , Maurizio Falcone

Visualizing high dimensional data by projecting them into two or three dimensional space is one of the most effective ways to intuitively understand the data's underlying characteristics, for example their class neighborhood structure.…

Machine Learning · Computer Science 2020-04-06 Pitoyo Hartono

Upcoming and future astronomy research facilities will systematically generate terabyte-sized data sets moving astronomy into the Petascale data era. While such facilities will provide astronomers with unprecedented levels of accuracy and…

Instrumentation and Methods for Astrophysics · Physics 2011-11-30 A. H. Hassan , C. J. Fluke , D. G. Barnes

With the rapid adoption of machine learning techniques for large-scale applications in science and engineering comes the convergence of two grand challenges in visualization. First, the utilization of black box models (e.g., deep neural…

Spectral dimensionality reduction methods enable linear separations of complex data with high-dimensional features in a reduced space. However, these methods do not always give the desired results due to irregularities or uncertainties of…

Machine Learning · Statistics 2018-05-21 Momo Matsuda , Keiichi Morikuni , Tetsuya Sakurai