English
Related papers

Related papers: Data-Space Validation of High-Dimensional Models b…

200 papers

We introduce a deep generative framework for high-dimensional Bayesian inference that enables efficient posterior sampling. As telescopes and simulations rapidly expand the volume and resolution of astrophysical data, fast simulation-based…

Instrumentation and Methods for Astrophysics · Physics 2026-03-06 Hadi Sotoudeh , Pablo Lemos , Laurence Perreault-Levasseur

To understand the universe and to interpret the cosmological parameters governing its evolution it is necessary to contrast the data from galaxy surveys with simulation. Typically it entails using computationally expensive N -body…

Cosmology and Nongalactic Astrophysics · Physics 2019-05-02 Tolga Yapici , Zachery Brown , Regina Demina , Segev BenZvi

The standard paired-sample testing approach in the multidimensional setting applies multiple univariate tests on the individual features, followed by p-value adjustments. Such an approach suffers when the data carry numerous features. A…

Machine Learning · Statistics 2023-09-29 Ioannis Bargiotas , Argyris Kalogeratos , Nicolas Vayatis

We consider the problem of variable selection in high-dimensional sparse additive models. We focus on the case that the components belong to nonparametric classes of functions. The proposed method is motivated by geometric considerations in…

Statistics Theory · Mathematics 2015-02-03 Martin Wahl

In this paper, we develop a systematic theory for high dimensional analysis of variance in multivariate linear regression, where the dimension and the number of coefficients can both grow with the sample size. We propose a new \emph{U}~type…

Methodology · Statistics 2023-01-12 Zhipeng Lou , Xianyang Zhang , Wei Biao Wu

We consider a problem of data integration. Consider determining which genes affect a disease. The genes, which we call predictor objects, can be measured in different experiments on the same individual. We address the question of finding…

Machine Learning · Statistics 2016-10-04 Xin Gao , Raymond J. Carroll

In order to use a gravitational lens to measure the Hubble constant accurately, it is necessary to derive a reliable model of the lens surface potential. If the analysis is restricted to the locations and magnifications of point images, the…

Astrophysics · Physics 2007-05-23 Roger Blandford , Gabriela Surpi , Tomislav Kundic

Feature selection of high-dimensional labeled data with limited observations is critical for making powerful predictive modeling accessible, scalable, and interpretable for domain experts. Spectroscopy data, which records the interaction…

Machine Learning · Computer Science 2022-02-10 Frantishek Akulich , Hadis Anahideh , Manaf Sheyyab , Dhananjay Ambre

Calibration of expensive computer models with high-dimensional output fields can be approached via history matching. If the entire output field is matched, with patterns or correlations between locations or time points represented,…

Methodology · Statistics 2022-10-03 James M Salter , Daniel B Williamson

An analysis of high-dimensional data can offer a detailed description of a system but is often challenged by the curse of dimensionality. General dimensionality reduction techniques can alleviate such difficulty by extracting a few…

Methodology · Statistics 2021-09-28 Di Bo , Hoon Hwangbo , Vinit Sharma , Corey Arndt , Stephanie C. TerMaath

Computer model calibration involves using partial and imperfect observations of the real world to learn which values of a model's input parameters lead to outputs that are consistent with real-world observations. When calibrating models…

Methodology · Statistics 2023-10-31 Wenzhe Xu , Daniel B. Williamson , Frederic Hourdin , Romain Roehrig

This paper explores the following question: what kind of statistical guarantees can be given when doing variable selection in high-dimensional models? In particular, we look at the error rates and power of some multi-stage regression…

Statistics Theory · Mathematics 2009-08-20 Larry Wasserman , Kathryn Roeder

In astronomy, there is an opportunity to enhance the practice of validating models through statistical techniques, specifically to account for measurement error uncertainties. While models are commonly used to describe observations, there…

Instrumentation and Methods for Astrophysics · Physics 2023-08-09 Fiorenzo Stoppa , Eric Cator , Gijs Nelemans

Much effort has been put into developing samplers with specific properties, such as producing blue noise, low-discrepancy, lattice or Poisson disk samples. These samplers can be slow if they rely on optimization processes, may rely on a…

Interpretable classification of time series presents significant challenges in high dimensions. Traditional feature selection methods in the frequency domain often assume sparsity in spectral density matrices (SDMs) or their inverses, which…

Machine Learning · Statistics 2024-08-19 Sarbojit Roy , Malik Shahid Sultan , Hernando Ombao

Establishing accurate morphological measurements of galaxies in a reasonable amount of time for future big-data surveys such as EUCLID, the Large Synoptic Survey Telescope or the Wide Field Infrared Survey Telescope is a challenge. Because…

Instrumentation and Methods for Astrophysics · Physics 2017-06-14 D. Tuccillo , M. Huertas-Company , E. Decenciere , S. Velasco-Forero

Galaxies are complex objects, yet the number of independent parameters to describe them remains unknown. We present here a non-parametric method to estimate the intrinsic dimensionality of large datasets. We apply it to wide-band…

Astrophysics of Galaxies · Physics 2025-01-23 Corentin Cadiou , Clotilde Laigle , Oscar Agertz

Diffusion models have had a profound impact on many application areas, including those where data are intrinsically infinite-dimensional, such as images or time series. The standard approach is first to discretize and then to apply…

Machine Learning · Statistics 2025-06-09 Jakiw Pidstrigach , Youssef Marzouk , Sebastian Reich , Sven Wang

We show that density models describing multiple observables with (i) hard boundaries and (ii) dependence on external parameters may be created using an auto-regressive Gaussian mixture model. The model is designed to capture how observable…

Data Analysis, Statistics and Probability · Physics 2022-02-01 Stephen B. Menary , Darren D. Price

We present a new non-parametric method to quantify morphologies of galaxies based on a particular family of learning machines called support vector machines. The method, that can be seen as a generalization of the classical CAS…

Astrophysics · Physics 2009-11-13 M. Huertas-Company , D. Rouan , L. Tasca , G. Soucail , O. Le Fevre