English
Related papers

Related papers: Advanced Statistical Methods for Large-Scale Struc…

200 papers

Measurements of the peculiar velocities of large samples of galaxies enable new tests of the standard cosmological model, including determination of the growth rate of cosmic structure that encodes gravitational physics. With the size of…

Cosmology and Nongalactic Astrophysics · Physics 2023-10-19 Chris Blake , Ryan J. Turner

In statistics, series of ordinary least squares problems (OLS) are used to study the linear correlation among sets of variables of interest; in many studies, the number of such variables is at least in the millions, and the corresponding…

Computational Engineering, Finance, and Science · Computer Science 2015-04-30 Alvaro Frank , Diego Fabregat-Traver , Paolo Bientinesi

The operating status of power systems is influenced by growing varieties of factors, resulting from the developing sizes and complexity of power systems; in this situation, the modelbased methods need be revisited. A data-driven method, as…

Methodology · Statistics 2016-07-07 Xinyi Xu , Xing He , Qian Ai , Robert C. Qiu

Diffusions are a successful technique to sample from high-dimensional distributions. The target distribution can be either explicitly given or learnt from a collection of samples. They implement a diffusion process whose endpoint is a…

Machine Learning · Computer Science 2025-09-03 Andrea Montanari

This paper studies high-dimensional regression models with lasso when data is sampled under multi-way clustering. First, we establish convergence rates for the lasso and post-lasso estimators. Second, we propose a novel inference method…

Econometrics · Economics 2019-08-22 Harold D. Chiang , Yuya Sasaki

I review the standard paradigm for understanding the formation and evolution of cosmic structure, based on the gravitational instability of dark matter, but many variations on this basic theme are viable. Despite the great progress that has…

Astrophysics · Physics 2007-05-23 Peter Coles

The rapid advancement of Large Language Models (LLMs) has significantly influenced various domains, leveraging their exceptional few-shot and zero-shot learning capabilities. In this work, we aim to explore and understand the LLMs-based…

Artificial Intelligence · Computer Science 2024-10-24 Dawei Li , Zhen Tan , Huan Liu

These lectures deal with our current knowledge of the matter distribution in the universe, focusing on how this is studied via the large-scale structure seen in galaxy surveys. We first assemble the necessary basics needed to understand the…

Astrophysics · Physics 2007-05-23 J. A. Peacock

Generative models are invaluable in many fields of science because of their ability to capture high-dimensional and complicated distributions, such as photo-realistic images, protein structures, and connectomes. How do we evaluate the…

These notes aim at presenting an overview of Bayesian statistics, the underlying concepts and application methodology that will be useful to astronomers seeking to analyse and interpret a wide variety of data about the Universe. The level…

Cosmology and Nongalactic Astrophysics · Physics 2017-01-09 Roberto Trotta

Temporal data, notably time series and spatio-temporal data, are prevalent in real-world applications. They capture dynamic system measurements and are produced in vast quantities by both physical and virtual sensors. Analyzing these data…

Studies of disordered heterogeneous media and galaxy cosmology share a common goal: analyzing the distribution of particles at `microscales' to predict physical properties at `macroscales', whether for a liquid, composite material, or…

Cosmology and Nongalactic Astrophysics · Physics 2023-01-11 Oliver H. E. Philcox , Salvatore Torquato

We provide a formal introduction into the classic theorems of general topology and its axiomatic foundations in set theory. In this second part we introduce the fundamental concepts of topological spaces, convergence, and continuity, as…

History and Overview · Mathematics 2013-07-01 Felix Nagel

These lecture notes give an introduction to the theory of interacting particle systems. The main subjects are the construction using generators and graphical representations, the mean field limit, stochastic order, duality, and the relation…

Probability · Mathematics 2025-11-10 Jan M. Swart

We investigate properties of the correlation function of clusters of galaxies using geometrical models. On small scales the correlation function depends on the shape and the size of superclusters. On large scales it describes the geometry…

Astrophysics · Physics 2015-06-24 J. Einasto , M. Einasto , P. Frisch , S. Gottlöber , V. Müller , V. Saar , A. A. Starobinsky , D. Tucker

A brief introduction is given to some aspects of the statistical description of the luminous matter distribution. I review the features of the redshift surveys that arise in the statistical analysis of the galaxy clustering. Special topics…

Astrophysics · Physics 2007-05-23 Vicent J. Martinez

The field of computational statistics refers to statistical methods or tools that are computationally intensive. Due to the recent advances in computing power some of these methods have become prominent and central to modern data analysis.…

Methodology · Statistics 2020-04-27 Suneel Babu Chatla , Chun-houh Chen , Galit Shmueli

Statistical inferences for sample correlation matrices are important in high dimensional data analysis. Motivated by this, this paper establishes a new central limit theorem (CLT) for a linear spectral statistic (LSS) of high dimensional…

Statistics Theory · Mathematics 2014-11-04 Jiti Gao , Xiao Han , Guangming Pan , Yanrong Yang

Many networks contain correlations and often conventional analysis is incapable of incorporating this often essential feature. In arXiv:0708.2176, we introduced the link-space formalism for analysing degree-degree correlations in evolving…

Physics and Society · Physics 2008-02-06 David M. D. Smith , Chiu Fan Lee , Neil F. Johnson , Jukka-Pekka Onnela

We present a review of data types and statistical methods often encountered in astronomy. The aim is to provide an introduction to statistical applications in astronomy for statisticians and computer scientists. We highlight the complex,…

Physics Education · Physics 2017-10-23 James P. Long , Rafael S. de Souza