English
Related papers

Related papers: Scalable Cosmic AI Inference using Cloud Serverles…

200 papers

Astronomy is well recognized as big data driven science. As the novel observation infrastructures are developed, the sky survey cycles have been shortened from a few days to a few seconds, causing data processing pressure to shift from…

Databases · Computer Science 2018-11-28 Chen Yang , Xiaofeng Meng , Zhihui Du

Cloud Computing is becoming the leading paradigm for executing scientific and engineering workflows. The large-scale nature of the experiments they model and their variable workloads make clouds the ideal execution environment due to prompt…

Neural and Evolutionary Computing · Computer Science 2018-11-05 David A. Monge , Elina Pacini , Cristian Mateos , Enrique Alba , Carlos García Garino

Serverless computing has emerged as a compelling solution for cloud-based model inference. However, as modern large language models (LLMs) continue to grow in size, existing serverless platforms often face substantial model startup…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-09 Minchen Yu , Rui Yang , Chaobo Jia , Zhaoyuan Su , Sheng Yao , Tingfeng Lan , Yuchen Yang , Zirui Wang , Yue Cheng , Wei Wang , Ao Wang , Ruichuan Chen

The cosmological redshift of a galaxy's light is inferable from its observable properties in images. Because imaging is much easier to acquire than spectroscopic observations that would allow the identification of distinct line features,…

Instrumentation and Methods for Astrophysics · Physics 2026-05-11 Luca Tortorelli , Daniel Grün

At the Canadian Astronomy Data Centre, we have combined our cloud computing system, CANFAR, with the world's most advanced machine learning software, Skytree, to create the world's first cloud computing system for data mining in astronomy.…

Instrumentation and Methods for Astrophysics · Physics 2013-12-17 Nicholas M. Ball

Accurate and efficient global ocean state estimation remains a grand challenge for Earth system science, hindered by the dual bottlenecks of computational scalability and degraded data fidelity in traditional data assimilation (DA) and deep…

Machine Learning · Computer Science 2025-11-11 Yanfei Xiang , Yuan Gao , Hao Wu , Quan Zhang , Ruiqi Shu , Xiao Zhou , Xi Wu , Xiaomeng Huang

Redshift prediction is a fundamental task in astronomy, essential for understanding the expansion of the universe and determining the distances of astronomical objects. Accurate redshift prediction plays a crucial role in advancing our…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Amirreza Dolatpour Fathkouhi , Geoffrey Charles Fox

Traversability prediction is a fundamental perception capability for autonomous navigation. The diversity of data in different domains imposes significant gaps to the prediction performance of the perception model. In this work, we make…

Robotics · Computer Science 2022-04-21 Zheng Chen , Durgakant Pushp , Lantao Liu

Understanding the properties of transient gravitational waves and their sources is of broad interest in physics and astronomy. Bayesian inference is the standard framework for astro-physical measurement in transient gravitational-wave…

General Relativity and Quantum Cosmology · Physics 2020-10-07 Rory Smith , Gregory Ashton , Avi Vajpeyi , Colm Talbot

We present a case study of a cloud-based computational workflow for processing large astronomical data sets from the Murchison Widefield Array (MWA) cosmology experiment. Cloud computing is well-suited to large-scale, episodic computation…

Instrumentation and Methods for Astrophysics · Physics 2021-03-04 Ruby Byrne , Daniel Jacobs

With continued advances in Geographic Information Systems and related computational technologies, statisticians are often required to analyze very large spatial datasets. This has generated substantial interest over the last decade, already…

Methodology · Statistics 2019-05-14 Lu Zhang , Abhirup Datta , Sudipto Banerjee

Deep learning is a promising tool to determine the physical model that describes our universe. To handle the considerable computational cost of this problem, we present CosmoFlow: a highly scalable deep learning application built on top of…

Computer-Assisted Intervention (CAI) has the potential to revolutionize modern surgery, with surgical scene understanding serving as a critical component in supporting decision-making, improving procedural efficacy, and ensuring…

We are in the era of the Big Data. In Astronomy and Astrophysics, the massive amounts of data generated are, as of today, in the Peta-scale if not already in the Exa-scale. In the near future, we will see the data collected size and…

Instrumentation and Methods for Astrophysics · Physics 2023-02-23 S. Bertocco

Astrophysics and cosmology are rich with data. The advent of wide-area digital cameras on large aperture telescopes has led to ever more ambitious surveys of the sky. Data volumes of entire surveys a decade ago can now be acquired in a…

Instrumentation and Methods for Astrophysics · Physics 2017-04-18 Jan Kremer , Kristoffer Stensbo-Smidt , Fabian Gieseke , Kim Steenstrup Pedersen , Christian Igel

Clouds play a critical role in the Earth's energy budget and their potential changes are one of the largest uncertainties in future climate projections. However, the use of satellite observations to understand cloud feedbacks in a warming…

Atmospheric and Oceanic Physics · Physics 2022-11-22 Takuya Kurihana , James Franke , Ian Foster , Ziwei Wang , Elisabeth Moyer

Noninvasive optical imaging modalities can probe patient's tissue in 3D and over time generate gigabytes of clinically relevant data per sample. There is a need for AI models to analyze this data and assist clinical workflow. The lack of…

We utilize techniques from deep learning to identify signatures of stellar feedback in simulated molecular clouds. Specifically, we implement a deep neural network with an architecture similar to U-Net and apply it to the problem of…

Instrumentation and Methods for Astrophysics · Physics 2019-08-07 Colin M. Van Oort , Duo Xu , Stella S. R. Offner , Robert A. Gutermuth

We present GalSBI, a phenomenological model of the galaxy population for cosmological applications using simulation-based inference. The model is based on analytical parametrizations of galaxy luminosity functions, morphologies and spectral…

Cosmology and Nongalactic Astrophysics · Physics 2025-06-09 Silvan Fischbacher , Tomasz Kacprzak , Luca Tortorelli , Beatrice Moser , Alexandre Refregier , Patrick Gebhardt , Daniel Gruen

Astronomy is experiencing a rapid growth in data size and complexity. This change fosters the development of data-driven science as a useful companion to the common model-driven data analysis paradigm, where astronomers develop automatic…

Instrumentation and Methods for Astrophysics · Physics 2019-04-17 Dalya Baron