English
Related papers

Related papers: Metropolized Knockoff Sampling

200 papers

The Metropolis-Hastings algorithm is a fundamental Markov chain Monte Carlo (MCMC) method for sampling and inference. With the advent of Big Data, distributed and parallel variants of MCMC methods are attracting increased attention. In this…

Data Structures and Algorithms · Computer Science 2019-07-16 Weiming Feng , Thomas P. Hayes , Yitong Yin

Conditional testing via the knockoff framework allows one to identify -- among large number of possible explanatory variables -- those that carry unique information about an outcome of interest, and also provides a false discovery rate…

Methodology · Statistics 2024-03-05 Benjamin B Chu , Jiaqi Gu , Zhaomeng Chen , Tim Morrison , Emmanuel Candes , Zihuai He , Chiara Sabatti

Variable selection, also known as feature selection in machine learning, plays an important role in modeling high dimensional data and is key to data-driven scientific discoveries. We consider here the problem of detecting influential…

Methodology · Statistics 2014-09-24 Bo Jiang , Jun S. Liu

This work develops a powerful and versatile framework for determining acceptance ratios in Metropolis-Hastings type Markov kernels widely used in statistical sampling problems. Our approach allows us to derive new classes of kernels which…

Statistics Theory · Mathematics 2021-07-21 Nathan E. Glatt-Holtz , Justin A. Krometis , Cecilia F. Mondaini

Monte Carlo methods represent the "de facto" standard for approximating complicated integrals involving multidimensional target distributions. In order to generate random realizations from the target distribution, Monte Carlo techniques use…

Computation · Statistics 2022-01-21 L. Martino , V. Elvira , D. Luengo , J. Corander

Sampling from distributions of implicitly defined shapes enables analysis of various energy functionals used for image segmentation. Recent work describes a computationally efficient Metropolis-Hastings method for accomplishing this task.…

Computer Vision and Pattern Recognition · Computer Science 2012-05-17 Jason Chang , John W. Fisher

Sequential Monte Carlo Samplers are a class of stochastic algorithms for Monte Carlo integral estimation w.r.t. probability distributions, which combine elements of Markov chain Monte Carlo methods and importance sampling/resampling…

Probability · Mathematics 2007-05-23 Andreas Eberle , Carlo Marinelli

We describe a general strategy for sampling configurations from a given (Gibbs-Boltzmann or other) distribution. It is {\it not} based on the Metropolis concept of establishing a Markov process whose stationary state is the wanted…

Statistical Mechanics · Physics 2007-05-23 P. Grassberger , W. Nadler

This short note is a self-contained and basic introduction to the Metropolis-Hastings algorithm, this ubiquitous tool used for producing dependent simulations from an arbitrary distribution. The document illustrates the principles of the…

Computation · Statistics 2016-01-28 Christian P. Robert

In real-world applications of reinforcement learning, it is often challenging to obtain a state representation that is parsimonious and satisfies the Markov property without prior knowledge. Consequently, it is common practice to construct…

Machine Learning · Statistics 2024-07-31 Tao Ma , Jin Zhu , Hengrui Cai , Zhengling Qi , Yunxiao Chen , Chengchun Shi , Eric B. Laber

One of the most widely used samplers in practice is the component-wise Metropolis-Hastings (CMH) sampler that updates in turn the components of a vector valued Markov chain using accept-reject moves generated from a proposal distribution.…

Computation · Statistics 2017-03-22 Jinyoung Yang , Evgeny Levi , Radu V. Craiu , Jeffrey S. Rosenthal

In this paper we address the problem of the uniform random generation of non deterministic automata (NFA) up to isomorphism. First, we show how to use a Monte-Carlo approach to uniformly sample a NFA. Secondly, we show how to use the…

Formal Languages and Automata Theory · Computer Science 2015-12-10 Pierre-Cyrille Heam , Jean-Luc Joly

Real-world time series data are often generated from several sources of variation. Learning representations that capture the factors contributing to this variability enables a better understanding of the data via its underlying generative…

Machine Learning · Computer Science 2022-02-14 Sana Tonekaboni , Chun-Liang Li , Sercan Arik , Anna Goldenberg , Tomas Pfister

Constraints can be interpreted in a broad sense as any kind of explicit restriction over the parameters. While some constraints are defined directly on the parameter space, when they are instead defined by known behaviour on the model,…

Methodology · Statistics 2015-02-27 Shirin Golchi , David A. Campbell

This paper proposes niching importance sampling, a framework that combines concepts from reliability analysis, e.g. Markov chains, importance sampling, and relative cross entropy minimisation, with niching techniques from evolutionary…

Computation · Statistics 2026-04-09 Hugh J. Kinnear , F. A. DiazDelaO

This paper develops a Bayesian computational platform at the interface between posterior sampling and optimization in models whose marginal likelihoods are difficult to evaluate. Inspired by adversarial optimization, namely Generative…

Statistics Theory · Mathematics 2021-12-01 Tetsuya Kaji , Veronika Rockova

This paper develops a model-free sequential test for conditional independence. The proposed test allows researchers to analyze an incoming i.i.d. data stream with any arbitrary dependency structure, and safely conclude whether a feature is…

Methodology · Statistics 2023-02-21 Shalev Shaer , Gal Maman , Yaniv Romano

We discuss several algorithms for sampling from unnormalized probability distributions in statistical physics, but using the language of statistics and machine learning. We provide a self-contained introduction to some key ideas and…

Computation · Statistics 2025-05-05 Michael F. Faulkner , Samuel Livingstone

Sampling random graphs is essential in many applications, and often algorithms use Markov chain Monte Carlo methods to sample uniformly from the space of graphs. However, often there is a need to sample graphs with some property that we are…

Social and Information Networks · Computer Science 2018-10-29 Caitlin Gray , Lewis Mitchell , Matthew Roughan

While recent work has shown that scores from models trained by the ubiquitous masked language modeling (MLM) objective effectively discriminate probable from improbable sequences, it is still an open question if these MLMs specify a…

Machine Learning · Computer Science 2022-03-16 Kartik Goyal , Chris Dyer , Taylor Berg-Kirkpatrick