English
Related papers

Related papers: From Data to Software to Science with the Rubin Ob…

200 papers

The exponential growth of astronomical datasets provides an unprecedented opportunity for humans to gain insight into the Universe. However, effectively analyzing this vast amount of data poses a significant challenge. Astronomers are…

Instrumentation and Methods for Astrophysics · Physics 2024-05-20 Mingxiang Fu , Yu Song , Jiameng Lv , Liang Cao , Peng Jia , Nan Li , Xiangru Li , Jifeng Liu , A-Li Luo , Bo Qiu , Shiyin Shen , Liangping Tu , Lili Wang , Shoulin Wei , Haifeng Yang , Zhenping Yi , Zhiqiang Zou

We have developed an end-to-end photometric data processing pipeline to compare current photometric algorithms commonly used on ground-based imaging data. This testbed is exceedingly adaptable, and enables us to perform many research and…

As we are fast approaching the beginning of a paradigm shift in the field of science, Data driven science (the so called fourth science paradigm) is going to be the driving force in research and innovation. From medicine to biodiversity and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Hrishav Bakul Barua

The sky images captured nightly by the camera on the Vera C. Rubin Observatory's telescope will be processed across facilities on three continents. Data acquisition will occur at the observatory's location on Cerro Pach\'{o}n in the Andes…

Instrumentation and Methods for Astrophysics · Physics 2025-07-18 Fabio Hernandez , Mark G. Beckett , Andrew Hanushevsky , Tim Jenness , Kian-Tat Lim , Peter Love , Timothy Noble , Stephen R. Pietrowicz , Wei Yang

In the last decades, scientific software has graduated from a hidden side-product to a first-class member of the astrophysics literature. We aim to quantify the activity and impact of software development for astronomy, using a systematic…

Instrumentation and Methods for Astrophysics · Physics 2025-12-12 Johannes Buchner

Software plays a central role in scientific discovery. Improving how we develop and use software for research can have both broad and deep impacts on a spectrum of challenges and opportunities society faces today. The emergence of Research…

Software Engineering · Computer Science 2022-11-17 Michael A. Heroux

In 2021, the Coordinated Science Laboratory CSL, an Interdisciplinary Research Unit at the University of Illinois Urbana-Champaign, hosted the Future of Computing Symposium to celebrate its 70th anniversary. CSL's research covers the full…

We explore synergies between the space-based Wide-Field Infrared Survey Telescope (WFIRST) and the ground-based Rubin Observatory Legacy Survey of Space and Time (LSST). In particular, we consider a scenario where the currently envisioned…

Rucio is an open-source software framework that provides scientific collaborations with the functionality to organize, manage, and access their data at scale. The data can be distributed across heterogeneous data centers at widely…

Everybody wants to analyse their data, but only few posses the data science expertise to to this. Motivated by this observation we introduce a novel framework and system \textsc{VisualSynth} for human-machine collaboration in data science.…

Artificial Intelligence · Computer Science 2020-04-24 Clément Gautrais , Yann Dauxais , Stefano Teso , Samuel Kolb , Gust Verbruggen , Luc De Raedt

The Large Synoptic Survey Telescope (LSST) project will conduct a ten year multi-band survey starting in 2022. Observing strategies for this survey are being actively investigated, and the science capabilities can be best forecasted on the…

Instrumentation and Methods for Astrophysics · Physics 2020-04-08 Rahul Biswas , Scott F. Daniel , R. Hložek , A. G. Kim , Peter Yoachim

The era of data-intensive astronomy is being ushered in with the increasing size and complexity of observational data across wavelength and time domains, the development of algorithms to extract information from this complexity, and the…

Instrumentation and Methods for Astrophysics · Physics 2020-05-20 Mubdi Rahman , Dustin Lang , Renée Hložek , Jo Bovy , Laurence Perreault-Levasseur

Time-domain Astrophysics (TDA), a foundation of Astronomy, has become a major part of current and projected (2020s) astrophysics. While much has been derived from temporal measures of flux and color, the real physics comes from…

Extragalactic science and cosmology with Stage IV galaxy surveys will rely almost exclusively on redshift measurements derived solely from photometry, which are subject to systematic and statistical uncertainties with numerous analysis…

Cosmology and Nongalactic Astrophysics · Physics 2024-10-01 Bryan R Scott , Alex I Malz , Robert Sorba

Astronomy produces extremely large data sets from ground-based telescopes, space missions, and simulation. The volume and complexity of these rich data sets require new approaches and advanced tools to understand the information contained…

Instrumentation and Methods for Astrophysics · Physics 2014-02-25 Demitri Muna , Eric Huff

Rosetta is a science platform for resource-intensive, interactive data analysis which runs user tasks as software containers. It is built on top of a novel architecture based on framing user tasks as microservices - independent and…

Instrumentation and Methods for Astrophysics · Physics 2022-09-07 Stefano Alberto Russo , Sara Bertocco , Claudio Gheller , Giuliano Taffoni

A new golden age in astronomy is upon us, dominated by data. Large astronomical surveys are broadcasting unprecedented rates of information, demanding machine learning as a critical component in modern scientific pipelines to handle the…

Instrumentation and Methods for Astrophysics · Physics 2023-03-17 Tarek Allam , Julien Peloton , Jason D. McEwen

Reproducibility remains a central challenge in machine learning (ML), especially in collaborative eScience projects where teams iterate over data, features, and models. Current ML workflows are often dynamic yet fragmented, relying on…

Machine Learning · Computer Science 2025-06-23 Zhiwei Li , Carl Kesselman , Tran Huy Nguyen , Benjamin Yixing Xu , Kyle Bolo , Kimberley Yu