English
Related papers

Related papers: Data augmentation for machine learning redshifts a…

200 papers

Data augmentation in deep neural networks is the process of generating artificial data in order to reduce the variance of the classifier with the goal to reduce the number of errors. This idea has been shown to improve deep neural network's…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Hassan Ismail Fawaz , Germain Forestier , Jonathan Weber , Lhassane Idoumghar , Pierre-Alain Muller

Data augmentation is a widely used training trick in deep learning to improve the network generalization ability. Despite many encouraging results, several recent studies did point out limitations of the conventional data augmentation…

Machine Learning · Computer Science 2020-10-06 Yi Xu , Asaf Noy , Ming Lin , Qi Qian , Hao Li , Rong Jin

Supervised deep learning methods for segmentation require large amounts of labelled training data, without which they are prone to overfitting, not generalizing well to unseen images. In practice, obtaining a large number of annotations…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Krishna Chaitanya , Neerav Karani , Christian Baumgartner , Olivio Donati , Anton Becker , Ender Konukoglu

In the era of huge astronomical surveys, machine learning offers promising solutions for the efficient estimation of galaxy properties. The traditional, `supervised' paradigm for the application of machine learning involves training a model…

Astrophysics of Galaxies · Physics 2022-12-21 A. Humphrey , P. A. C. Cunha , A. Paulino-Afonso , S. Amarantidis , R. Carvajal , J. M. Gomes , I. Matute , P. Papaderos

In order to reduce overfitting, neural networks are typically trained with data augmentation, the practice of artificially generating additional training data via label-preserving transformations of existing training examples. While these…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Cecilia Summers , Michael J. Dinneen

We present a method for automatic detection and classification of galaxies which includes a novel data-augmentation procedure to make trained models more robust against the data taken from different instruments and contrast-stretching…

Instrumentation and Methods for Astrophysics · Physics 2018-09-07 Roberto E. González , Roberto P. Muñoz , Cristian A. Hernández

Data augmentation is a powerful technique to improve performance in applications such as image and text classification tasks. Yet, there is little rigorous understanding of why and how various augmentations work. In this work, we consider a…

Machine Learning · Computer Science 2023-07-28 Sen Wu , Hongyang R. Zhang , Gregory Valiant , Christopher Ré

We have applied ClassX, an oblique decision tree classifier optimized for astronomical analysis, to the homogeneous multicolor imaging data base of the Sloan Digital Sky Survey (SDSS), training the software on subsets of SDSS objects whose…

Astrophysics · Physics 2008-11-26 A. A. Suchkov , R. J. Hanisch , Bruce Margon

Accurate redshift estimates are a vital component in understanding galaxy evolution and precision cosmology. In this paper, we explore approaches to increase the applicability of machine learning models for photometric redshift estimation…

Instrumentation and Methods for Astrophysics · Physics 2026-01-27 Jonathan Soriano , Tuan Do , Srinath Saikrishnan , Vikram Seenivasan , Bernie Boscoe , Jack Singal , Evan Jones

A recurring problem faced when training neural networks is that there is typically not enough data to maximize the generalization capability of deep neural networks(DNN). There are many techniques to address this, including data…

Artificial Intelligence · Computer Science 2017-04-26 Joseph Lemley , Shabab Bazrafkan , Peter Corcoran

We extend the real-space mapping method developed in Shi et at. (2016) so that it can be applied to flux-limited galaxy samples. We use an ensemble of mock catalogs to demonstrate the reliability of this extension, showing that it allows…

Cosmology and Nongalactic Astrophysics · Physics 2018-07-25 Feng Shi , Xiaohu Yang , Huiyuan Wang , Youcai Zhang , H. J. Mo , Frank C. van den Bosch , Wentao Luo , Dylan Tweed , Shijie Li , Chengze Liu , Yi Lu , Lei Yang

With the increasing utilization of deep learning in outdoor settings, its robustness needs to be enhanced to preserve accuracy in the face of distribution shifts, such as compression artifacts. Data augmentation is a widely used technique…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Shohei Enomoto , Monikka Roslianna Busto , Takeharu Eda

We use a contrastive self-supervised learning framework to estimate distances to galaxies from their photometric images. We incorporate data augmentations from computer vision as well as an application-specific augmentation accounting for…

Instrumentation and Methods for Astrophysics · Physics 2021-01-13 Md Abul Hayat , Peter Harrington , George Stein , Zarija Lukić , Mustafa Mustafa

Conventional data augmentation realized by performing simple pre-processing operations (\eg, rotation, crop, \etc) has been validated for its advantage in enhancing the performance for medical image segmentation. However, the data generated…

Image and Video Processing · Electrical Eng. & Systems 2020-02-25 Tiexin Qin , Ziyuan Wang , Kelei He , Yinghuan Shi , Yang Gao , Dinggang Shen

Data augmentation is a crucial technique in deep learning, particularly for tasks with limited dataset diversity, such as skeleton-based datasets. This paper proposes a comprehensive data augmentation framework that integrates geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Nada Aboudeshish , Dmitry Ignatov , Radu Timofte

In this work, we explore methods to improve galaxy redshift predictions by combining different ground truths. Traditional machine learning models rely on training sets with known spectroscopic redshifts, which are precise but only represent…

Instrumentation and Methods for Astrophysics · Physics 2024-11-28 Jonathan Soriano , Srinath Saikrishnan , Vikram Seenivasan , Bernie Boscoe , Jack Singal , Tuan Do

Deep learning (DL) algorithms have shown significant performance in various computer vision tasks. However, having limited labelled data lead to a network overfitting problem, where network performance is bad on unseen data as compared to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Teerath Kumar , Alessandra Mileo , Rob Brennan , Malika Bendechache

Recent studies have demonstrated remarkable advancements in source code learning, which applies deep neural networks (DNNs) to tackle various software engineering tasks. Similar to other DNN-based domains, source code learning also requires…

Software Engineering · Computer Science 2025-02-07 Zeming Dong , Qiang Hu , Yuejun Guo , Zhenya Zhang , Maxime Cordy , Mike Papadakis , Yves Le Traon , Jianjun Zhao

Data augmentation has been an indispensable tool to improve the performance of deep neural networks, however the augmentation can hardly transfer among different tasks and datasets. Consequently, a recent trend is to adopt AutoML technique…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Aoming Liu , Zehao Huang , Zhiwu Huang , Naiyan Wang

Data augmentation is commonly used to encode invariances in learning methods. However, this process is often performed in an inefficient manner, as artificial examples are created by applying a number of transformations to all points in the…

Machine Learning · Computer Science 2019-03-04 Michael Kuchnik , Virginia Smith