English
Related papers

Related papers: Large-scale Environmental Data Science with ExaGeo…

200 papers

The growing field of large-scale time domain astronomy requires methods for probabilistic data analysis that are computationally tractable, even with large datasets. Gaussian Processes are a popular class of models used for this purpose…

Instrumentation and Methods for Astrophysics · Physics 2017-11-15 Daniel Foreman-Mackey , Eric Agol , Sivaram Ambikasaran , Ruth Angus

Addressing the statistical challenge of computing the multivariate normal (MVN) probability in high dimensions holds significant potential for enhancing various applications. One common way to compute high-dimensional MVN probabilities is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-27 Xiran Zhang , Sameh Abdulah , Jian Cao , Hatem Ltaief , Ying Sun , Marc G. Genton , David E. Keyes

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

Gaussian processes are a class of flexible nonparametric Bayesian tools that are widely used across the sciences, and in industry, to model complex data sources. Key to applying Gaussian process models is the availability of well-developed…

Computation · Statistics 2019-07-02 Jamie Fairbrother , Christopher Nemeth , Maxime Rischard , Johanni Brea , Thomas Pinder

Spatial process models for analyzing geostatistical data entail computations that become prohibitive as the number of spatial locations become large. This manuscript develops a class of highly scalable Nearest Neighbor Gaussian Process…

Methodology · Statistics 2016-01-05 Abhirup Datta , Sudipto Banerjee , Andrew O. Finley , Alan E. Gelfand

Regularized empirical risk minimization (R-ERM) is an important branch of machine learning, since it constrains the capacity of the hypothesis space and guarantees the generalization ability of the learning algorithm. Two classic proximal…

Machine Learning · Computer Science 2016-09-28 Qi Meng , Wei Chen , Jingcheng Yu , Taifeng Wang , Zhi-Ming Ma , Tie-Yan Liu

Flexible random scale-mixture models provide a framework for capturing a broad range of extremal dependence structures. However, likelihood-based inference under the peaks-over-threshold setting is often computationally infeasible, due to…

Methodology · Statistics 2026-04-10 Muyang Shi , Likun Zhang , Benjamin A. Shaby

Euler-Lagrange (EL) simulations provide a direct and robust framework for modeling disperse multiphase flows. However, they are computationally expensive. While various approaches have attempted to leverage heterogeneous computing…

Computational Engineering, Finance, and Science · Computer Science 2026-03-31 Silvio Schmalfuß , Sergey Lesnik , Henrik Rusche , Dennis Niedermeier

The Expectation-Maximization (EM) algorithm has been predominantly used to approximate the maximum likelihood estimation of the location-scale Gaussian mixtures. However, when the models are over-specified, namely, the chosen number of…

Machine Learning · Statistics 2022-05-24 Tongzheng Ren , Fuheng Cui , Sujay Sanghavi , Nhat Ho

With the growing capabilities of Geographic Information Systems (GIS) and user-friendly software, statisticians today routinely encounter geographically referenced data containing observations from a large number of spatial locations and…

Methodology · Statistics 2017-05-23 Sudipto Banerjee

The deployment of the next generation computing platform at ExaFlops scale requires to solve new technological challenges mainly related to the impressive number (up to 10^6) of compute elements required. This impacts on system power…

We study Spatial Logistic Gaussian Process (SLGP) models for non-parametric estimation of probability density fields using scattered samples of heterogeneous sizes. SLGPs are examined from the perspective of random measures and their…

Statistics Theory · Mathematics 2025-02-20 Athénaïs Gautier , David Ginsbourger

Reservoir Computing (RC) has established itself as an efficient paradigm for temporal processing. However, its scalability remains severely constrained by (i) the necessity of processing temporal data sequentially and (ii) the prohibitive…

Machine Learning · Computer Science 2026-02-02 Matteo Pinna , Giacomo Lagomarsini , Andrea Ceni , Claudio Gallicchio

Cloud computing offers an opportunity to run compute-resource intensive climate models at scale by parallelising model runs such that datasets useful to the exoplanet community can be produced efficiently. To better understand the…

Several classic problems in graph processing and computational geometry are solved via incremental algorithms, which split computation into a series of small tasks acting on shared state, which gets updated progressively. While the…

Data Structures and Algorithms · Computer Science 2020-03-24 Dan Alistarh , Nikita Koval , Giorgi Nadiradze

We consider the challenges that arise when fitting complex ecological models to 'large' data sets. In particular, we focus on random effect models which are commonly used to describe individual heterogeneity, often present in ecological…

Methodology · Statistics 2022-05-17 Ruth King , Blanca Sarzo , Víctor Elvira

A Gaussian Process (GP) is a prominent mathematical framework for stochastic function approximation in science and engineering applications. This success is largely attributed to the GP's analytical tractability, robustness, non-parametric…

Machine Learning · Statistics 2022-05-19 Marcus M. Noack , Harinarayan Krishnan , Mark D. Risser , Kristofer G. Reyes

Lightning is a destructive and highly visible product of severe storms, yet there is still much to be learned about the conditions under which lightning is most likely to occur. The GOES-16 and GOES-17 satellites, launched in 2016 and 2018…

Applications · Statistics 2021-12-01 Megan L. Gelsinger , Maryclare Griffin , David S. Matteson , Joseph Guinness

We explore how the big-three computing paradigms -- symmetric multi-processor (SMC), graphical processing units (GPUs), and cluster computing -- can together be brought to bare on large-data Gaussian processes (GP) regression problems via a…

Computation · Statistics 2014-06-05 Robert B. Gramacy , Jarad Niemi , Robin M. Weiss

We study maximum likelihood estimation for spatial generalized linear mixed models with Gaussian process approximations using a stochastic Newton-Raphson algorithm. We consider two Gaussian Process approximations in this context: spectral…

Methodology · Statistics 2026-05-19 Samuel I. Watson , Yixin Wang , Emanuele Giorgi