English
Related papers

Related papers: Missing Data Imputation for Galaxy Redshift Estima…

200 papers

Missing values in tabular data restrict the use and performance of machine learning, requiring the imputation of missing values. The most popular imputation algorithm is arguably multiple imputations using chains of equations (MICE), which…

Machine Learning · Computer Science 2022-03-01 Manar D Samad , Sakib Abrar , Norou Diawara

Missing data are present in most real world problems and need careful handling to preserve the prediction accuracy and statistical consistency in the downstream analysis. As the gold standard of handling missing data, multiple imputation…

Machine Learning · Computer Science 2021-12-23 Zongyu Dai , Zhiqi Bu , Qi Long

Numerical data imputation algorithms replace missing values by estimates to leverage incomplete data sets. Current imputation methods seek to minimize the error between the unobserved ground truth and the imputed values. But this strategy…

Machine Learning · Statistics 2023-07-11 Florian Lalande , Kenji Doya

We propose a new method to estimate the photometric redshift of galaxies by using the full galaxy image in each measured band. This method draws from the latest techniques and advances in machine learning, in particular Deep Neural…

Instrumentation and Methods for Astrophysics · Physics 2016-06-16 Ben Hoyle

Data acquisition and recording in the form of databases are routine operations. The process of collecting data, however, may experience irregularities, resulting in databases with missing data. Missing entries might alter analysis…

Databases · Computer Science 2021-08-24 Paul Dixneuf , Fausto Errico , Mathias Glaus

Remotely sensed data are sparse, which means that data have missing values, for instance due to cloud cover. This is problematic for applications and signal processing algorithms that require complete data sets. To address the sparse data…

Missing data imputation can help improve the performance of prediction models in situations where missing data hide useful information. This paper compares methods for imputing missing categorical data for supervised classification tasks.…

Machine Learning · Statistics 2020-08-11 Jason Poulos , Rafael Valle

Based on the Sloan Digital Sky Survey Data Release 5 Galaxy Sample, we explore photometric morphology classification and redshift estimation of galaxies using photometric data and known spectroscopic redshifts. An unsupervised method,…

Astrophysics · Physics 2009-11-13 Yanxia Zhang , Lili Li , Yongheng Zhao

We propose Conditional Imputation GAN, an extended missing data imputation method based on Generative Adversarial Networks (GANs). The motivating use case is learning-to-rank, the cornerstone of modern search, recommendation system, and…

Machine Learning · Statistics 2021-11-11 Grace Deng , Cuize Han , David S. Matteson

Gaussian Mixture models (GMMs) are a powerful tool for clustering, classification and density estimation when clustering structures are embedded in the data. The presence of missing values can largely impact the GMMs estimation process,…

Machine Learning · Statistics 2020-06-05 Alessio Serafini , Thomas Brendan Murphy , Luca Scrucca

Minimizing the Mean Squared Error (MSE) is a key objective in machine learning and is commonly used for imputing missing values. While this approach provides accurate point estimates, it introduces systematic biases in downstream analyses.…

Machine Learning · Statistics 2026-05-06 Stef van Buuren

Time series data are ubiquitous in real-world applications. However, one of the most common problems is that the time series data could have missing values by the inherent nature of the data collection process. So imputing missing values…

Machine Learning · Computer Science 2022-09-23 Eunkyu Oh , Taehun Kim , Yunhu Ji , Sushil Khyalia

Many techniques for handling missing data have been proposed in the literature. Most of these techniques are overly complex. This paper explores an imputation technique based on rough set computations. In this paper, characteristic…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Fulufhelo Vincent Nelwamondo , Tshilidzi Marwala

We investigate the potential and accuracy of clustering-based redshift estimation using the method proposed by M\'enard et al. (2013). This technique enables the inference of redshift distributions from measurements of the spatial…

Astrophysics of Galaxies · Physics 2015-06-22 Mubdi Rahman , Brice Ménard , Ryan Scranton , Samuel J. Schmidt , Christopher B. Morrison

All-sky radio surveys are set to revolutionise the field with new discoveries. However, the vast majority of the tens of millions of radio galaxies won't have the spectroscopic redshift measurements required for a large number of science…

Instrumentation and Methods for Astrophysics · Physics 2022-03-01 Kieran J. Luken , Ray P. Norris , Laurence A. F. Park , X. Rosalind Wang , Miroslav D. Filipovic

Handling big data has largely been a major bottleneck in traditional statistical models. Consequently, when accurate point prediction is the primary target, machine learning models are often preferred over their statistical counterparts for…

Methodology · Statistics 2021-04-02 Arindam Fadikar , Stefan M. Wild , Jonas Chaves-Montero

Missing data arises when certain values are not recorded or observed for variables of interest. However, most of the statistical theory assume complete data availability. To address incomplete databases, one approach is to fill the gaps…

Missing values pose a persistent challenge in modern data science. Consequently, there is an ever-growing number of publications introducing new imputation methods in various fields. While many studies compare imputation approaches, they…

Computation · Statistics 2025-11-10 Krystyna Grzesiak , Christophe Muller , Julie Josse , Jeffrey Näf

Missing data frequently occurs in datasets across various domains, such as medicine, sports, and finance. In many cases, to enable proper and reliable analyses of such data, the missing values are often imputed, and it is necessary that the…

Recent galaxy redshift surveys have brought in a large amount of accurate cosmological data out to redshift 0.3, and future surveys are expected to achieve a high degree of completeness out to a redshift exceeding 1. Consequently, a…

General Relativity and Quantum Cosmology · Physics 2008-11-26 Teresa Hui-Ching Lu , Charles Hellaby