English
Related papers

Related papers: Data augmentation for machine learning redshifts a…

200 papers

Data augmentation is widely used as a part of the training process applied to deep learning models, especially in the computer vision domain. Currently, common data augmentation techniques are designed manually. Therefore they require…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Irynei Baran , Orest Kupyn , Arseny Kravchenko

Data augmentation is an essential part of the training process applied to deep learning models. The motivation is that a robust training process for deep learning models depends on large annotated datasets, which are expensive to be…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Toan Tran , Trung Pham , Gustavo Carneiro , Lyle Palmer , Ian Reid

Data augmentation is a widely used trick when training deep neural networks: in addition to the original data, properly transformed data are also added to the training set. However, to the best of our knowledge, a clear mathematical…

Machine Learning · Statistics 2020-11-10 Shuxiao Chen , Edgar Dobriban , Jane H Lee

We propose a new method to estimate the photometric redshift of galaxies by using the full galaxy image in each measured band. This method draws from the latest techniques and advances in machine learning, in particular Deep Neural…

Instrumentation and Methods for Astrophysics · Physics 2016-06-16 Ben Hoyle

Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation schemes to expand the amount of training data available for…

Machine Learning · Computer Science 2021-06-23 Renkun Ni , Micah Goldblum , Amr Sharaf , Kezhi Kong , Tom Goldstein

Data augmentation refers to the process of applying a series of transformations or expansions to original data to generate new samples, thereby increasing the diversity and quantity of the data, effectively improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Hao Zhang , Shuaijie Zhang , Renbin Zou

Forthcoming astronomical surveys are expected to detect new sources in such large numbers that measuring their spectroscopic redshift measurements will be not be practical. Thus, there is much interest in using machine learning to yield the…

Cosmology and Nongalactic Astrophysics · Physics 2022-03-14 S. J. Curran

We conduct a detailed analysis of the photometric redshift requirements for the proposed Dark Energy Survey (DES) using two sets of mock galaxy simulations and an artificial neural network code - ANNz. In particular, we examine how optical…

Astrophysics · Physics 2010-03-26 Manda Banerji , Filipe B. Abdalla , Ofer Lahav , Huan Lin

Data augmentation is often used to enlarge datasets with synthetic samples generated in accordance with the underlying data distribution. To enable a wider range of augmentations, we explore negative data augmentation strategies (NDA)that…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Abhishek Sinha , Kumar Ayush , Jiaming Song , Burak Uzkent , Hongxia Jin , Stefano Ermon

Data augmentation is a powerful tool for improving deep learning-based image classifiers for plant stress identification and classification. However, selecting an effective set of augmentations from a large pool of candidates remains a key…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Nasla Saleem , Aditya Balu , Talukder Zaki Jubery , Arti Singh , Asheesh K. Singh , Soumik Sarkar , Baskar Ganapathysubramanian

Filament finders are limited, among other things, by the abundance of spectroscopic redshift data. As there are proportionally more photometric redshift data than spectroscopic, we aim to use photometric data to improve and expand the areas…

Cosmology and Nongalactic Astrophysics · Physics 2023-02-15 Moorits Mihkel Muru , Elmo Tempel

We apply instance-based machine learning in the form of a k-nearest neighbor algorithm to the task of estimating photometric redshifts for 55,746 objects spectroscopically classified as quasars in the Fifth Data Release of the Sloan Digital…

We present a machine-learning photometric redshift analysis of the Kilo-Degree Survey Data Release 3, using two neural-network based techniques: ANNz2 and MLPQNA. Despite limited coverage of spectroscopic training sets, these ML codes…

Wide-field slitless spectroscopic galaxy surveys, such as the one performed by the upcoming Chinese Space Station Survey Telescope (CSST), are crucial for precision cosmology but present formidable data analysis challenges. Because spectra…

Instrumentation and Methods for Astrophysics · Physics 2026-05-19 Xingchen Zhou , Yan Gong , Xin Zhang , Xian-Min Meng , Haitao Miao , Run Wen , Nan Li

This paper follows series of our works on the applicability of various machine learning methods to the morphological galaxy classification (Vavilova et al., 2021, 2022). We exploited the sample of 315776 SDSS DR9 galaxies with absolute…

Current data augmentation techniques and transformations are well suited for improving the size and quality of natural image datasets but are not yet optimized for medical imaging. We hypothesize that sub-optimal data augmentations can…

Image and Video Processing · Electrical Eng. & Systems 2023-01-06 Tara M. Pattilachan , Ugur Demir , Elif Keles , Debesh Jha , Derk Klatte , Megan Engels , Sanne Hoogenboom , Candice Bolan , Michael Wallace , Ulas Bagci

Dynamic data selection aims to accelerate training with lossless performance. However, reducing training data inherently limits data diversity, potentially hindering generalization. While data augmentation is widely used to enhance…

Machine Learning · Computer Science 2025-05-13 Suorong Yang , Peng Ye , Furao Shen , Dongzhan Zhou

Though data augmentation has rapidly emerged as a key tool for optimization in modern machine learning, a clear picture of how augmentation schedules affect optimization and interact with optimization hyperparameters such as learning rate…

Machine Learning · Computer Science 2021-10-28 Boris Hanin , Yi Sun

We study the impact of lensing magnification on the observed three-dimensional galaxy clustering in redshift space. We used the RayGal suite of N-body simulations, from which we extracted samples of dark matter particles and haloes in the…

Cosmology and Nongalactic Astrophysics · Physics 2022-05-25 Michel-Andrès Breton , Sylvain de la Torre , Jade Piat

Data augmentation (DA) has been widely investigated to facilitate model optimization in many tasks. However, in most cases, data augmentation is randomly performed for each training sample with a certain probability, which might incur…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Shiqi Lin , Zhizheng Zhang , Xin Li , Wenjun Zeng , Zhibo Chen