English
Related papers

Related papers: PolytopeWalk: Sparse MCMC Sampling over Polytopes

200 papers

We propose Subsampling MCMC, a Markov Chain Monte Carlo (MCMC) framework where the likelihood function for $n$ observations is estimated from a random subset of $m$ observations. We introduce a highly efficient unbiased estimator of the…

Methodology · Statistics 2018-12-31 Matias Quiroz , Robert Kohn , Mattias Villani , Minh-Ngoc Tran

The modern scale of data has brought new challenges to Bayesian inference. In particular, conventional MCMC algorithms are computationally very expensive for large data sets. A promising approach to solve this problem is embarrassingly…

Machine Learning · Statistics 2015-10-27 Xiangyu Wang , Fangjian Guo , Katherine A. Heller , David B. Dunson

Sequential optimization methods are often confronted with the curse of dimensionality in high-dimensional spaces. Current approaches under the Gaussian process framework are still burdened by the computational complexity of tracking…

Machine Learning · Computer Science 2024-01-08 Zeji Yi , Yunyue Wei , Chu Xin Cheng , Kaibo He , Yanan Sui

The hard-disk problem, the statics and the dynamics of equal two-dimensional hard spheres in a periodic box, has had a profound influence on statistical and computational physics. Markov-chain Monte Carlo and molecular dynamics were first…

Statistical Mechanics · Physics 2014-02-10 Sebastian C. Kapfer , Werner Krauth

Wideband wireless channel is a time dispersive channel and becomes strongly frequency-selective. However, in most cases, the channel is composed of a few dominant taps and a large part of taps is approximately zero or zero. To exploit the…

Information Theory · Computer Science 2010-05-14 Guan Gui , Qun Wan , Wei Peng , Fumiyuki Adachi

Sequential Monte Carlo Squared (SMC$^2$) is a Bayesian method which can infer the states and parameters of non-linear, non-Gaussian state-space models. The standard random-walk proposal in SMC$^2$ faces challenges, particularly with…

Machine Learning · Statistics 2024-07-25 Conor Rosato , Joshua Murphy , Alessandro Varsi , Paul Horridge , Simon Maskell

Increasingly complex datasets pose a number of challenges for Bayesian inference. Conventional posterior sampling based on Markov chain Monte Carlo can be too computationally intensive, is serial in nature and mixes poorly between posterior…

Machine Learning · Statistics 2019-08-27 Edwin Fong , Simon Lyddon , Chris Holmes

Random sampling of graph partitions under constraints has become a popular tool for evaluating legislative redistricting plans. Analysts detect partisan gerrymandering by comparing a proposed redistricting plan with an ensemble of sampled…

Applications · Statistics 2023-11-09 Cory McCartan , Kosuke Imai

In this paper we propose an algorithm for recovering sparse orthogonal polynomials using stochastic collocation. Our approach is motivated by the desire to use generalized polynomial chaos expansions (PCE) to quantify uncertainty in models…

Numerical Analysis · Mathematics 2021-05-04 John D. Jakeman , Akil Narayan , Tao Zhou

Feature selection is a crucial step in machine learning, especially for high-dimensional datasets, where irrelevant and redundant features can degrade model performance and increase computational costs. This paper proposes a novel…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Azam Asilian Bidgoli , Shahryar Rahnamayan

Nonuniform subsampling methods are effective to reduce computational burden and maintain estimation efficiency for massive data. Existing methods mostly focus on subsampling with replacement due to its high computational efficiency. If the…

Methodology · Statistics 2021-07-06 Jun Yu , HaiYing Wang , Mingyao Ai , Huiming Zhang

Dimension reduction algorithms aim to discover latent variables which describe underlying structures in high-dimensional data. Methods such as factor analysis and principal component analysis have the downside of not offering much…

Applications · Statistics 2021-12-23 Yong See Foo , Heejung Shim

The Hiperwalk package is designed to facilitate the simulation of quantum walks using heterogeneous high-performance computing, taking advantage of the parallel processing power of diverse processors such as CPUs, GPUs, and acceleration…

Quantum Physics · Physics 2024-06-13 Paulo Motta , Gustavo A. Bezerra , Anderson F. P. Santos , Renato Portugal

We study classes of Dynamic Programming (DP) algorithms which, due to their algebraic definitions, are closely related to coefficient extraction methods. DP algorithms can easily be modified to exploit sparseness in the DP table through…

Computational Complexity · Computer Science 2012-03-20 Petteri Kaski , Mikko Koivisto , Jesper Nederlof

We propose a homotopy sampling procedure, loosely based on importance sampling. Starting from a known probability distribution, the homotopy procedure generates the unknown normalization of a target distribution. In the context of…

Computation · Statistics 2021-05-05 Juan M. Restrepo , Jorge M. Ramirez

We study the $(\varepsilon, \delta)$-PAC policy identification problem in finite-horizon episodic Markov Decision Processes. Existing approaches provide finite-time guarantees for approximate settings ($\varepsilon>0$) but suffer from high…

Machine Learning · Computer Science 2026-05-06 Cyrille Kone , Kevin Jamieson

Biclustering algorithms play a central role in the biotechnological and biomedical domains. The knowledge extracted supports the extraction of putative regulatory modules, essential to understanding diseases, aiding therapy research, and…

Databases · Computer Science 2022-12-13 Leonardo Alexandre , Rafael S. Costa , Rui Henriques

This paper proposes a hierarchical Bayesian multitask learning model that is applicable to the general multi-task binary classification learning problem where the model assumes a shared sparsity structure across different tasks. We derive a…

Feature selection with specific multivariate performance measures is the key to the success of many applications, such as image retrieval and text classification. The existing feature selection methods are usually designed for…

Machine Learning · Computer Science 2015-03-19 Qi Mao , Ivor W. Tsang

Quite generally, constraint-based metabolic flux analysis describes the space of viable flux configurations for a metabolic network as a high-dimensional polytope defined by the linear constraints that enforce the balancing of production…

Molecular Networks · Quantitative Biology 2013-09-24 Francesco Alessandro Massucci , Francesc Font-Clos , Andrea De Martino , Isaac Pérez Castillo