English

Pushing the Technical Frontier: From Overwhelmingly Large Data Sets to Machine Learning

Instrumentation and Methods for Astrophysics 2020-06-17 v1
Authors: Viviana Acquaviva
View on arXiv ↗ PDF ↗ DOI ↗

Abstract

This paper summarizes my thoughts, given in an invited review at the IAU symposium 341 "Challenges in Panchromatic Galaxy Modelling with Next Generation Facilities", about how machine learning methods can help us solve some of the big data problems associated with current and upcoming large galaxy surveys.

Keywords

machine learning in materials science machine learning in astronomy astrophysics and stellar phenomena

Cite

@article{arxiv.1901.05978,
  title  = {Pushing the Technical Frontier: From Overwhelmingly Large Data Sets to Machine Learning},
  author = {Viviana Acquaviva},
  journal= {arXiv preprint arXiv:1901.05978},
  year   = {2020}
}

Comments

Submitted for publication in Proceedings of the IAU symposium 341, Osaka, Japan, 2018. Comments welcome!

Related papers

View all related →
Instrumentation and Methods for Astrophysics · Physics
Machine Learning and the future of Supernova Cosmology
Emille E. O. Ishida
2019-08-08
Cosmology and Nongalactic Astrophysics · Physics
Machine Learning applications to Galaxy Clusters
Gustavo Yepes, Daniel de Andrés
2026-05-22
Instrumentation and Methods for Astrophysics · Physics
Machine Learning Frameworks for Large-Scale Radio Surveys: A Summary of Recent Studies
Nikhel Gupta
2025-10-14
Instrumentation and Methods for Astrophysics · Physics
Machine Learning for Observational Cosmology
Kana Moriwaki, Takahiro Nishimichi, Naoki Yoshida
2023-05-26
Machine Learning · Computer Science
A Survey on Large-scale Machine Learning
Meng Wang, Weijie Fu, Xiangnan He, Shijie Hao +1
2020-08-11
Instrumentation and Methods for Astrophysics · Physics
Integrating Machine Learning for Planetary Science: Perspectives for the Next Decade
Abigail R. Azari, John B. Biersteker, Ryan M. Dewey, Gary Doran +12
2023-07-17
Astrophysics of Galaxies · Physics
Closing remarks and Outlook
F. Combes
2018-08-22
Instrumentation and Methods for Astrophysics · Physics
Panel Discussion: Practical Problem Solving for Machine Learning
Guillermo Cabrera, Sungwook E. Hong, Lilianne Nakazono, David Parkinson +1
2025-08-06
Earth and Planetary Astrophysics · Physics
Machine Learning as a Transformative Tool for (Exo-)Planetary Science
J. Davoult, V. T. Bickel, C. Haslebacher, Y. Alibert +10
2026-04-13
Instrumentation and Methods for Astrophysics · Physics
An Astronomers Guide to Machine Learning
Sara A. Webb, Simon R. Goode
2025-08-06
Instrumentation and Methods for Astrophysics · Physics
Foreword to the Focus Issue on Machine Learning in Astronomy and Astrophysics
Giuseppe Longo, Erzsébet Merényi, Peter Tino
2019-10-09
Instrumentation and Methods for Astrophysics · Physics
The Role of Machine Learning in the Next Decade of Cosmology
Michelle Ntampaka, Camille Avestruz, Steven Boada, Joao Caldeira +26
2021-01-15
Instrumentation and Methods for Astrophysics · Physics
From stellar light to astrophysical insight: automating variable star research with machine learning
Jeroen Audenaert
2025-07-08
Instrumentation and Methods for Astrophysics · Physics
Deep Learning for Multi-Messenger Astrophysics: A Gateway for Discovery in the Big Data Era
Gabrielle Allen, Igor Andreoni, Etienne Bachelet, G. Bruce Berriman +44
2019-02-05
Cosmology and Nongalactic Astrophysics · Physics
A Systematic Literature Review of Machine Learning Techniques for Observational Constraints in Cosmology
Luis Rojas, Sebastián Espinoza, Esteban González, Carlos Maldonado +1
2025-10-14
Instrumentation and Methods for Astrophysics · Physics
Machine Learning in Astronomy: a practical overview
Dalya Baron
2019-04-17
Machine Learning · Computer Science
Machine Unlearning in Generative AI: A Survey
Zheyuan Liu, Guangyao Dou, Zhaoxuan Tan, Yijun Tian +1
2024-07-31
Instrumentation and Methods for Astrophysics · Physics
Data Deluge in Astrophysics: Photometric Redshifts as a Template Use Case
Massimo Brescia, Stefano Cavuoti, Valeria Amaro, Giuseppe Riccio +3
2018-07-17
Instrumentation and Methods for Astrophysics · Physics
Big Universe, Big Data: Machine Learning and Image Analysis for Astronomy
Jan Kremer, Kristoffer Stensbo-Smidt, Fabian Gieseke, Kim Steenstrup Pedersen +1
2017-04-18
Astrophysics of Galaxies · Physics
Realising the potential of large spectroscopic surveys with machine-learning
G. Guiglion
2025-03-12
Cosmology and Nongalactic Astrophysics · Physics
Machine learning uncovers new cosmological information
Zoltán Haiman
2018-10-30
Instrumentation and Methods for Astrophysics · Physics
Combining human and machine learning for morphological analysis of galaxy images
Evan Kuminski, Joe George, John Wallin, Lior Shamir
2015-06-23
High Energy Physics - Phenomenology · Physics
Machine Learning and Cosmology
Cora Dvorkin, Siddharth Mishra-Sharma, Brian Nord, V. Ashley Villar +7
2022-03-16
Instrumentation and Methods for Astrophysics · Physics
Machine and Deep Learning Applied to Galaxy Morphology -- A Comparative Study
P. H. Barchi, R. R. de Carvalho, R. R. Rosa, R. Sautter +6
2019-11-05
Instrumentation and Methods for Astrophysics · Physics
The Overlooked Potential of Generalized Linear Models in Astronomy-II: Gamma regression and photometric redshifts
J. Elliott, R. S. de Souza, A. Krone-Martins, E. Cameron +2
2019-01-01
R2 v1 2026-06-23T07:15:02.907Z