English
Related papers

Related papers: Grid-based exploration of cosmological parameter s…

200 papers

The posterior probability distribution for a set of model parameters encodes all that the data have to tell us in the context of a given model; it is the fundamental quantity for Bayesian parameter estimation. In order to infer the…

Instrumentation and Methods for Astrophysics · Physics 2015-06-16 Rupert Allison , Joanna Dunkley

In the last two decades, the linear model of coregionalization (LMC) has been widely used to model multivariate spatial processes. However, it can be a challenging task to conduct likelihood-based inference for such models because of the…

Methodology · Statistics 2024-12-04 Renaud Alie , David A. Stephens , Alexandra M. Schmidt

Most popular dimension reduction (DR) methods like t-SNE and UMAP are based on minimizing a cost between input and latent pairwise similarities. Though widely used, these approaches lack clear probabilistic foundations to enable a full…

Probability · Mathematics 2023-10-06 Hugues Van Assel , Thibault Espinasse , Julien Chiquet , Franck Picard

As it has become common to use many computer cores in routine applications, finding good ways to parallelize popular algorithms has become increasingly important. In this paper, we present a parallelization scheme for Markov chain Monte…

Methodology · Statistics 2016-06-01 Guillaume W. Basse , Natesh S. Pillai , Aaron Smith

The t-Distributed Stochastic Neighbor Embedding (t-SNE) has emerged as a popular dimensionality reduction technique for visualizing high-dimensional data. It computes pairwise similarities between data points by default using an RBF kernel…

Machine Learning · Computer Science 2024-10-22 Sarwan Ali , Prakash Chourasia , Haris Mansoor , Bipin koirala , Murray Patterson

Link prediction is a key aspect of graph machine learning, with applications as diverse as disease prediction, social network recommendations, and drug discovery. It involves predicting new links that may form between network nodes. Despite…

Machine Learning · Computer Science 2023-09-12 Haohui Lu , Shahadat Uddin

We examine the problem of optimizing classification tree evaluation for on-line and real-time applications by using GPUs. Looking at trees with continuous attributes often used in image segmentation, we first put the existing algorithms for…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-11-08 Jason Spencer

SSD-offloaded training offers a practical and promising approach to making LLM training cost-effective. Building on gradient accumulation with micro-batches, this paper introduces GreedySnake, a new SSD-offloaded training system that…

Machine Learning · Computer Science 2026-01-27 Yishu Yin , Xuehai Qian

In the realm of big data and machine learning, data-parallel, distributed stochastic algorithms have drawn significant attention in the present days.~While the synchronous versions of these algorithms are well understood in terms of their…

Optimization and Control · Mathematics 2020-04-07 Atal Narayan Sahu , Aritra Dutta , Aashutosh Tiwari , Peter Richtárik

Physical parameters are often constrained from the data likelihoods using sampling methods. Changing some parameters can be much more computationally expensive (`slow') than changing other parameters (`fast parameters'). I describe a method…

Cosmology and Nongalactic Astrophysics · Physics 2013-06-19 Antony Lewis

Markov Chain Monte Carlo (MCMC) is a well-established family of algorithms which are primarily used in Bayesian statistics to sample from a target distribution when direct sampling is challenging. Single instances of MCMC methods are widely…

Computation · Statistics 2019-05-27 Alessandro Varsi , Lykourgos Kekempanos , Jeyarajan Thiyagalingam , Simon Maskell

Running machine learning analytics over geographically distributed datasets is a rapidly arising problem in the world of data management policies ensuring privacy and data security. Visualizing high dimensional data using tools such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-13 Viska Wei , Nikita Ivkin , Vladimir Braverman , Alexander Szalay

Markov chain Monte Carlo (MCMC) is the predominant tool used in Bayesian parameter estimation for hierarchical models. When the model expands due to an increasing number of hierarchical levels, number of groups at a particular level, or…

Computation · Statistics 2016-06-22 Will Landau , Jarad Niemi

Markov chain Monte Carlo (MCMC) methods are foundational algorithms for Bayesian inference and probabilistic modeling. However, most MCMC algorithms are inherently sequential and their time complexity scales linearly with the sequence…

Computation · Statistics 2025-12-03 David M. Zoltowski , Skyler Wu , Xavier Gonzalez , Leo Kozachkov , Scott W. Linderman

We present an original simulation-based method to estimate likelihood ratios efficiently for general state-space models. Our method relies on a novel use of the conditional Sequential Monte Carlo (cSMC) algorithm introduced in…

Methodology · Statistics 2018-09-10 Sinan Yıldırım , Christophe Andrieu , Arnaud Doucet

We present a novel Bayesian inference tool that uses a neural network to parameterise efficient Markov Chain Monte-Carlo (MCMC) proposals. The target distribution is first transformed into a diagonal, unit variance Gaussian by a series of…

Cosmology and Nongalactic Astrophysics · Physics 2020-06-03 Adam Moss

We describe algorithms for two-stage stochastic linear programming with recourse and their implementation on a grid computing platform. In particular, we examine serial and asynchronous versions of the L-shaped method and a trust-region…

Optimization and Control · Mathematics 2007-05-23 Jeff Linderoth , Stephen Wright

We develop an algorithm to solve tridiagonal systems of linear equations, which appear in implicit finite-difference schemes of partial differential equations (PDEs), being the time-dependent Schr\"{o}dinger equation (TDSE) an ideal…

Computational Physics · Physics 2023-03-14 Yaroslav Lutsyshyn , Francisco Navarrete , Dieter Bauer

To understand the universe and to interpret the cosmological parameters governing its evolution it is necessary to contrast the data from galaxy surveys with simulation. Typically it entails using computationally expensive N -body…

Cosmology and Nongalactic Astrophysics · Physics 2019-05-02 Tolga Yapici , Zachery Brown , Regina Demina , Segev BenZvi

Approximate Nearest Neighbor Search (ANNS) in high dimensional space is essential in database and information retrieval. Recently, there has been a surge of interest in exploring efficient graph-based indices for the ANNS problem. Among…

Information Retrieval · Computer Science 2021-03-19 Cong Fu , Changxu Wang , Deng Cai