Related papers: Methodological and computational aspects of parall…
We propose new sequential sorting operations by adapting techniques and methods used for designing parallel sorting algorithms. Although the norm is to parallelize a sequential algorithm to improve performance, we adapt a contrarian…
Variational inference (VI) combined with data subsampling enables approximate posterior inference over large data sets, but suffers from poor local optima. We first formulate a deterministic annealing approach for the generic class of…
Temporal point processes are powerful generative models for event sequences that capture complex dependencies in time-series data. They are commonly specified using autoregressive models that learn the distribution of the next event from…
We report on an experimental investigation into opportunities for parallelism in beliefnet inference. Specifically, we report on a study performed of the available parallelism, on hypercube style machines, of a set of randomly generated…
Distributed model fitting refers to the process of fitting a mathematical or statistical model to the data using distributed computing resources, such that computing tasks are divided among multiple interconnected computers or nodes, often…
Simulated tempering (ST) is an established Markov chain Monte Carlo (MCMC) method for sampling from a multimodal density $\pi(\theta)$. Typically, ST involves introducing an auxiliary variable $k$ taking values in a finite subset of $[0,1]$…
We use a combination of perturbation theory and numerical techniques to study the equilibration of two interacting fields which are initially at thermal equilibrium at different temperatures. Using standard rules of quantum field theory, we…
Bayesian data analysis is widely used across many disciplines, and representative examples in materials science include spectral analysis and sparse modeling. In such applications, the underlying models often become complex and yield…
The Ising model describes collective behaviors such as phase transitions and critical phenomena in various physical, biological, economical, and social systems. It is well-known that spontaneous phase transition at finite temperature does…
Symmetry restoration in a theory of a self-interacting charged scalar field at finite temperature and in the presence of an external magnetic field is examined. The effective potential is evaluated nonperturbatively in the context of the…
Optimal (reversible) processes in thermodynamics can be modelled as step-by-step processes, where the system is successively thermalized with respect to different Hamiltonians by an external thermal bath. However, in practice interactions…
The half filled Hubbard model is studied in the pair approximation of the Cluster Variation Method. The use of the $SO(4)$ symmetry of the model makes possible to give a complete analytical characterization of the ground state, by means of…
On modern parallel architectures, the cost of synchronization among processors can often dominate the cost of floating-point computation. Several modifications of the existing methods have been proposed in order to keep the communication…
We explain the fundamental challenges of sampling from multimodal distributions, particularly for high-dimensional problems. We present the major types of MCMC algorithms that are designed for this purpose, including parallel tempering,…
The linear response to temperature changes is derived for systems with overdamped stochastic dynamics. Holding both in transient and steady state conditions, the results allow to compute nonequilibrium thermal susceptibilities from…
The technique of periodic homogenization with two-scale convergence is applied to the analysis of a two-phase Stefan-type problem that arises in the study of a periodic array of melting ice bars. For this "reduced model" we prove results on…
Supercomputing systems today often come in the form of large numbers of commodity systems linked together into a computing cluster. These systems, like any distributed system, can have large numbers of independent hardware components…
Autocorrelations in MCMC chains increase the variance of the estimators they produce. We propose the occlusion process to mitigate this problem. It is a process that sits upon an existing MCMC sampler, and occasionally replaces its samples…
We consider a thermodynamic framework to quantify instrument incompatibility via a resource theory subject to thermodynamic constraints. We use the minimal thermalisation time needed to erase incompatibility's signature to measure…
Parallel algorithms designed for simulation and performance evaluation of single-server tandem queueing systems with both infinite and finite buffers are presented. The algorithms exploit a simple computational procedure based on recursive…