English
Related papers

Related papers: Superposition Enhanced Nested Sampling

200 papers

We present dynesty, a public, open-source, Python package to estimate Bayesian posteriors and evidences (marginal likelihoods) using Dynamic Nested Sampling. By adaptively allocating samples based on posterior structure, Dynamic Nested…

Instrumentation and Methods for Astrophysics · Physics 2020-02-12 Joshua S Speagle

The montecarlo method, which is quite commonly used to solve maximum entropy problems in statistical physics, can actually be used to solve inverse problems in a much wider context. The probability distribution which maximizes entropy can…

Statistical Mechanics · Physics 2007-05-23 Jan Naudts

We present a performant, general-purpose gradient-guided nested sampling algorithm, ${\tt GGNS}$, combining the state of the art in differentiable programming, Hamiltonian slice sampling, clustering, mode separation, dynamic nested…

Machine Learning · Computer Science 2023-12-08 Pablo Lemos , Nikolay Malkin , Will Handley , Yoshua Bengio , Yashar Hezaveh , Laurence Perreault-Levasseur

Given the inherent class imbalance issue within student performance datasets, samples belonging to the edges of the target class distribution pose a challenge for predictive machine learning algorithms to learn. In this paper, we introduce…

Machine Learning · Computer Science 2021-01-05 Dom Huh

Nested sampling is a powerful approach to Bayesian inference ultimately limited by the computationally demanding task of sampling from a heavily constrained probability distribution. An effective algorithm in its own right, Hamiltonian…

Data Analysis, Statistics and Probability · Physics 2015-03-02 M. J. Betancourt

Based on multiple simulation trajectories, which started from dispersively selected initial conformations, the weighted ensemble dynamics method is designed to robustly and systematically explore the hierarchical structure of complex…

Statistical Mechanics · Physics 2015-05-14 Linchen Gong , Xin Zhou

We develop an Evolutionary Markov Chain Monte Carlo (EMCMC) algorithm for sampling spatial partitions that lie within a large and complex spatial state space. Our algorithm combines the advantages of evolutionary algorithms (EAs) as…

Computation · Statistics 2021-01-19 Wendy K. Tam Cho , Yan Y. Liu

High-dimensional and complex discrete distributions often exhibit multimodal behavior due to inherent discontinuities, posing significant challenges for sampling. Gradient-based discrete samplers, while effective, frequently become trapped…

Machine Learning · Computer Science 2026-04-14 Pinaki Mohanty , Ruqi Zhang

This paper studies the \emph{subset sampling} problem. The input is a set $\mathcal{S}$ of $n$ records together with a function $\textbf{p}$ that assigns each record $v\in\mathcal{S}$ a probability $\textbf{p}(v)$. A query returns a random…

Data Structures and Algorithms · Computer Science 2023-07-24 Jinchao Huang , Sibo Wang

Subset Simulation is a Markov chain Monte Carlo method used to compute small failure probabilities in structural reliability problems. This is done by iteratively sampling from nested subsets in the input space of a performance function,…

Computation · Statistics 2024-10-03 Hugh J. Kinnear , F. A. DiazDelaO

With the abundance of industrial datasets, imbalanced classification has become a common problem in several application domains. Oversampling is an effective method to solve imbalanced classification. One of the main challenges of the…

Machine Learning · Computer Science 2022-07-18 Min Qian , Yan-Fu Li

Sequential sampling occurs when the entire population is not known in advance and data are obtained one at a time or in groups of units. This manuscript proposes a new algorithm to sequentially select a balanced sample. The algorithm…

Methodology · Statistics 2023-01-04 Raphaël Jauslin , Bardia Panahbehagh , Yves Tillé

Competing phases or interactions in complex many-particle systems can result in free energy barriers that strongly suppress thermal equilibration. Here we discuss how extended ensemble Monte Carlo simulations can be used to study the…

Statistical Mechanics · Physics 2007-05-23 S. Trebst , D. A. Huse , E. Gull , H. G. Katzgraber , U. H. E. Hansmann , M. Troyer

Modern data-driven and distributed learning frameworks deal with diverse massive data generated by clients spread across heterogeneous environments. Indeed, data heterogeneity is a major bottleneck in scaling up many distributed learning…

Machine Learning · Computer Science 2023-08-23 Amirhossein Reisizadeh , Khashayar Gatmiry , Asuman Ozdaglar

The abundance of new cosmological data becoming available means that a wider range of cosmological models are testable than ever before. However, an important distinction must be made between parameter fitting and model selection. While…

Astrophysics · Physics 2009-11-13 Pia Mukherjee , David Parkinson , Andrew R. Liddle

Jointing visual-semantic embeddings (VSE) have become a research hotpot for the task of image annotation, which suffers from the issue of semantic gap, i.e., the gap between images' visual features (low-level) and labels' semantic features…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Guibing Guo , Songlin Zhai , Fajie Yuan , Yuan Liu , Xingwei Wang

Identifying the underlying models in a set of data points contaminated by noise and outliers, leads to a highly complex multi-model fitting problem. This problem can be posed as a clustering problem by the projection of higher order…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Ruwan Tennakoon , Alireza Sadri , Reza Hoseinnezhad , Alireza Bab-Hadiashar

In the last decade, sequential Monte-Carlo methods (SMC) emerged as a key tool in computational statistics. These algorithms approximate a sequence of distributions by a sequence of weighted empirical measures associated to a weighted…

Statistics Theory · Mathematics 2007-06-13 R. Douc , France E. Moulines

In biomolecular systems (especially all-atom models) with many degrees of freedom such as proteins and nucleic acids, there exist an astronomically large number of local-minimum-energy states. Conventional simulations in the canonical…

Statistical Mechanics · Physics 2010-12-30 Ayori Mitsutake , Yoshiharu Mori , Yuko Okamoto

Understanding complex phenomena often requires analyzing high-dimensional data to uncover emergent properties that arise from multifactorial interactions. Here, we present EMUSES (Emerging-properties Mapping Using Spatial Embedding…

Emerging Technologies · Computer Science 2024-06-21 Chris Foulon , Marcela Ovando-Tellez , Lia Talozzi , Maurizio Corbetta , Anna Matsulevits , Michel Thiebaut de Schotten