English
Related papers

Related papers: Data-Space Validation of High-Dimensional Models b…

200 papers

We perform the first direct cosmological and astrophysical parameter inference from the combination of galaxy luminosity functions and colours using a simulation based inference approach. Using the Synthesizer code we simulate the dust…

Assessing whether a sample survey credibly represents the population is a critical question for ensuring the validity of downstream research. Generally, this problem reduces to estimating the distance between two high-dimensional…

Machine Learning · Computer Science 2025-08-29 Debabrota Basu , Sourav Chakraborty , Debarshi Chanda , Buddha Dev Das , Arijit Ghosh , Arnab Ray

Wide-area imaging surveys are one of the key ways of advancing our understanding of cosmology, galaxy formation physics, and the large-scale structure of the Universe in the coming years. These surveys typically require calculating…

Astrophysics of Galaxies · Physics 2020-10-07 P. W. Hatfield , I. A. Almosallam , M. J. Jarvis , N. Adams , R. A. A. Bowler , Z. Gomes , S. J. Roberts , C. Schreiber

We demonstrate that generative deep learning can translate galaxy observations across ultraviolet, visible, and infrared photometric bands. Leveraging mock observations from the Illustris simulations, we develop and validate a supervised…

Instrumentation and Methods for Astrophysics · Physics 2025-01-28 Youssef Zaazou , Alex Bihlo , Terrence S. Tricco

We study the effects of applying observational techniques to derive the properties of simulated galaxies, with the aim of making an unbiased comparison between observations and simulations. For our study, we used fifteen galaxies simulated…

Astrophysics of Galaxies · Physics 2016-07-25 Giovanni Guidi , Cecilia Scannapieco , C. Jakob Walcher , Anna Gallazzi

We show that a Denoising Diffusion Probabalistic Model (DDPM), a class of score-based generative model, can be used to produce realistic mock images that mimic observations of galaxies. Our method is tested with Dark Energy Spectroscopic…

Instrumentation and Methods for Astrophysics · Physics 2022-02-01 Michael J. Smith , James E. Geach , Ryan A. Jackson , Nikhil Arora , Connor Stone , Stéphane Courteau

Generative models producing images have enormous potential to advance discoveries across scientific fields and require metrics capable of quantifying the high dimensional output. We propose that astrophysics data, such as galaxy images, can…

Instrumentation and Methods for Astrophysics · Physics 2024-07-11 Yun Qi Li , Tuan Do , Evan Jones , Bernie Boscoe , Kevin Alfaro , Zooey Nguyen

In this manuscript we consider the problem of jointly estimating multiple graphical models in high dimensions. We assume that the data are collected from n subjects, each of which consists of T possibly dependent observations. The graphical…

Machine Learning · Statistics 2014-10-09 Huitong Qiu , Fang Han , Han Liu , Brian Caffo

Measurements of the peculiar velocities of large samples of galaxies enable new tests of the standard cosmological model, including determination of the growth rate of cosmic structure that encodes gravitational physics. With the size of…

Cosmology and Nongalactic Astrophysics · Physics 2023-10-19 Chris Blake , Ryan J. Turner

The goal of this presentation is to build an efficient non-parametric Bayes classifier in the presence of large numbers of predictors. When analyzing such data, parametric models are often too inflexible while non-parametric procedures tend…

Methodology · Statistics 2013-01-07 Abhishek Bhattacharya

This paper develops a novel change point identification method for high-dimensional data using random projections. By projecting high-dimensional time series into a one-dimensional space, we are able to leverage the rich literature for…

Methodology · Statistics 2026-03-04 Yi Xu , Yeonwoo Rho

Selectivity estimation aims at estimating the number of database objects that satisfy a selection criterion. Answering this problem accurately and efficiently is essential to many applications, such as density estimation, outlier detection,…

Databases · Computer Science 2021-05-28 Yaoshu Wang , Chuan Xiao , Jianbin Qin , Rui Mao , Onizuka Makoto , Wei Wang , Rui Zhang , Yoshiharu Ishikawa

When can reliable inference be drawn in the "Big Data" context? This paper presents a framework for answering this fundamental question in the context of correlation mining, with implications for general large scale inference. In large…

Statistics Theory · Mathematics 2015-05-19 Alfred O. Hero , Bala Rajaratnam

Advances in multimodal characterization methods fuel a generation of increasing immense hyper-dimensional datasets. Color mapping is employed for conveying higher dimensional data in two-dimensional (2D) representations for human…

Human-Computer Interaction · Computer Science 2020-02-28 M. J. Waters , J. M. Walker , C. T. Nelson , D. Joester , J. M. Rondinelli

Predictive modeling uncovers knowledge and insights regarding a hypothesized data generating mechanism (DGM). Results from different studies on a complex DGM, derived from different data sets, and using complicated models and algorithms,…

Methodology · Statistics 2022-11-21 Anna L. Smith , Tian Zheng , Andrew Gelman

The study of strong-lensing systems conventionally involves constructing a mass distribution that can reproduce the observed multiply-imaging properties. Such mass reconstructions are generically non-unique. Here, we present an alternative…

Astrophysics of Galaxies · Physics 2021-06-30 Philipp Denzel , Sampath Mukherjee , Prasenjit Saha

Curse of Dimensionality is an unavoidable challenge in statistical probability models, yet diffusion models seem to overcome this limitation, achieving impressive results in high-dimensional data generation. Diffusion models assume that…

Machine Learning · Statistics 2025-10-01 Zhenxin Zheng , Zhenjie Zheng

A grand challenge of the 21st century cosmology is to accurately estimate the cosmological parameters of our Universe. A major approach to estimating the cosmological parameters is to use the large-scale matter distribution of the Universe.…

Cosmology and Nongalactic Astrophysics · Physics 2017-11-07 Siamak Ravanbakhsh , Junier Oliva , Sebastien Fromenteau , Layne C. Price , Shirley Ho , Jeff Schneider , Barnabas Poczos

In scientific inference problems, the underlying statistical modeling assumptions have a crucial impact on the end results. There exist, however, only a few automatic means for validating these fundamental modelling assumptions. The…

Methodology · Statistics 2019-05-21 Andreas Svensson , Dave Zachariah , Petre Stoica , Thomas B. Schön

Machine learning has been widely applied to clearly defined problems of astronomy and astrophysics. However, deep learning and its conceptual differences to classical machine learning have been largely overlooked in these fields. The broad…

Instrumentation and Methods for Astrophysics · Physics 2024-10-15 Nima Sedaghat , Martino Romaniello , Jonathan E. Carrick , François-Xavier Pineau