English
Related papers

Related papers: Large scale in transit computation of quantiles fo…

200 papers

Very large datasets are often encountered in climatology, either from a multiplicity of observations over time and space or outputs from deterministic models (sometimes in petabytes= 1 million gigabytes). Loading a large data vector and…

Computation · Statistics 2010-07-08 Reza Hosseini

For incremental quantile estimators the step size and possibly other tuning parameters must be carefully set. However, little attention has been given on how to set these values in an online manner. In this article we suggest two novel…

Methodology · Statistics 2020-04-28 Hugo L. Hammer , Anis Yazidi , Michael A. Riegler , Håvard Rue

Recent advances in random-walk particle-tracking have enabled direct simulation of mixing and reactions on particles by allowing the particles to interact with each other using a multi-point mass transfer scheme. The mass transfer scheme…

Computational Physics · Physics 2019-04-22 Nicholas B. Engdahl , Michael J. Schmidt , David A. Benson

Multiscale correlation functions in high Reynolds number experimental turbulence, numerical simulations and synthetic signals are investigated. Fusion Rules predictions as they arise from multiplicative, almost uncorrelated, random…

chao-dyn · Physics 2009-10-31 R. Benzi , L. Biferale , G. Ruiz-Chavarria , S. Ciliberto , F. Toschi

Modern training and inference pipelines in statistical learning and deep learning repeatedly invoke linear-system solves as inner loops, yet high-accuracy deterministic solvers can be prohibitively expensive when solves must be repeated…

Computation · Statistics 2026-02-06 Sarah Polson , Vadim Sokolov

Modelling has become a third distinct line of scientific enquiry, alongside experiments and theory. Molecular dynamics (MD) simulations serve to interpret, predict and guide experiments and to test and develop theories. A major limiting…

Algorithms to determine transition probabilities in Monte Carlo simulations are tested using a system of classical particles with effective interactions which reproduce Bose-Einstein statistics. The system is appropriate for testing…

Statistical Mechanics · Physics 2021-01-11 Marisel Di Pietro Martínez , Martín Giuliano , Miguel Hoyuelos

Classically simulating quantum systems is challenging, as even noiseless $n$-qubit quantum states scale as $2^n$. The complexity of noisy quantum systems is even greater, requiring $2^n \times 2^n$-dimensional density matrices. Various…

Quantum Physics · Physics 2025-04-24 Taylor L. Patti , Thien Nguyen , Justin G. Lietz , Alexander J. McCaskey , Brucek Khailany

Curating, processing, and combining large-scale medical imaging datasets from national studies is a non-trivial task due to the intense computation and data throughput required, variability of acquired data, and associated financial…

Continuous-time quantum Monte Carlo refers to a class of algorithms designed to sample the thermal distribution of a quantum Hamiltonian through exact expansions of the Boltzmann exponential in terms of stochastic trajectories which are…

Statistical Mechanics · Physics 2024-07-17 Luke Causer , Konstantinos Sfairopoulos , Jamie F. Mair , Juan P. Garrahan

A Monte Carlo method to sample the classical configurational canonical ensemble is introduced. In contrast to the Metropolis algorithm, where trial moves can be rejected, in this approach collisions take place. The implementation is…

Statistical Mechanics · Physics 2015-03-19 E. A. J. F. Peters , G. de With

Multiscale correlation functions in high Reynolds number experimental turbulence and synthetic signals are investigated. Fusion Rules predictions as they arise from multiplicative, almost uncorrelated, random processes for the energy…

chao-dyn · Physics 2009-10-31 R. Benzi , L. Biferale , F. Toschi

A powerful way to improve performance in machine learning is to construct an ensemble that combines the predictions of multiple models. Ensemble methods are often much more accurate and lower variance than the individual classifiers that…

Machine Learning · Computer Science 2024-12-03 Antonio Macaluso , Luca Clissa , Stefano Lodi , Claudio Sartori

On their roller coaster ride through turbulence, tracer particles sample the fluctuations of the underlying fields in space and time. Quantitatively relating particle and field statistics remains a fundamental challenge in a large variety…

Fluid Dynamics · Physics 2018-01-10 Cristian C. Lalescu , Michael Wilczek

In complex systems with many degrees of freedom such as spin glass and biomolecular systems, conventional simulations in canonical ensemble suffer from the quasi-ergodicity problem. A simulation in generalized ensemble performs a random…

Statistical Mechanics · Physics 2008-06-24 Y. Okamoto

The need to estimate a particular quantile of a distribution is an important problem which frequently arises in many computer vision and signal processing applications. For example, our work was motivated by the requirements of many…

Computer Vision and Pattern Recognition · Computer Science 2015-04-22 Ognjen Arandjelovic , Duc-Son Pham , Svetha Venkatesh

The computational cost of a Monte Carlo algorithm can only be meaningfully discussed when taking into account the magnitude of the resulting statistical error. Aiming for a fixed error per particle, we study the scaling behavior of the…

Computational Physics · Physics 2010-02-11 Norbert Nemec

Approximate Bayes Computations (ABC) are used for parameter inference when the likelihood function of the model is expensive to evaluate but relatively cheap to sample from. In particle ABC, an ensemble of particles in the product space of…

Computation · Statistics 2016-04-15 Carlo Albert , Hans R. Kuensch , Andreas Scheidegger

We present a novel model for text complexity analysis which can be fitted to ordered categorical data measured on multiple scales, e.g. a corpus with binary responses mixed with a corpus with more than two ordered outcomes. The multiple…

Applications · Statistics 2018-11-13 Johan Falkenjack , Mattias Villani , Arne Jönsson

Computational modeling of assembly is challenging for many systems because their timescales vastly exceed those accessible to simulations. This article describes the MultiMSM, which is a general framework that uses Markov state models…

Soft Condensed Matter · Physics 2024-05-07 Anthony Trubiano , Michael F. Hagan