English
Related papers

Related papers: Semigroups and sequential importance sampling for …

200 papers

Given a set of possible models (e.g., Bayesian network structures) and a data sample, in the unsupervised model selection problem the task is to choose the most accurate model with respect to the domain joint probability distribution. In…

Machine Learning · Computer Science 2013-01-18 Sanjoy Dasgupta , Leonard Schulman

Many experiments can be interpreted in terms of random processes operating according to some internal protocols. When experiments are costly or cannot be repeated only one or a few finite samples are available. In this paper we study data…

Data Analysis, Statistics and Probability · Physics 2016-02-02 Marian Kupczynski , Hans De Raedt

We consider the asymptotic distribution of a cell in a 2 x ... x 2 contingency table as the fixed marginal totals tend to infinity. The asymptotic order of the cell variance is derived and a useful diagnostic is given for determining…

Statistics Theory · Mathematics 2018-04-17 Quan Zhou

Importance Sampling methods are broadly used to approximate posterior distributions or some of their moments. In its standard approach, samples are drawn from a single proposal distribution and weighted properly. However, since the…

Computation · Statistics 2019-11-05 Víctor Elvira , Luca Martino , David Luengo , Mónica F. Bugallo

Confounding is a significant obstacle to unbiased estimation of causal effects from observational data. For settings with high-dimensional covariates -- such as text data, genomics, or the behavioral social sciences -- researchers have…

Artificial Intelligence · Computer Science 2024-02-01 Katherine A. Keith , Sergey Feldman , David Jurgens , Jonathan Bragg , Rohit Bhattacharya

Inference for high-dimensional logistic regression models using penalized methods has been a challenging research problem. As an illustration, a major difficulty is the significant bias of the Lasso estimator, which limits its direct…

Methodology · Statistics 2024-10-29 Yuming Zhang , Stéphane Guerrier , Runze Li

Confidence intervals (CIs) are instrumental in statistical analysis, providing a range estimate of the parameters. In modern statistics, selective inference is common, where only certain parameters are highlighted. However, this selective…

Methodology · Statistics 2025-09-17 Tzviel Frostig , Yoav Benjamini , Ruth Heller

Multiple Importance Sampling (MIS) methods approximate moments of complicated distributions by drawing samples from a set of proposal distributions. Several ways to compute the importance weights assigned to each sample have been recently…

Computation · Statistics 2016-09-16 Víctor Elvira , Luca Martino , David Luengo , Mónica F. Bugallo

In multiple importance sampling we combine samples from a finite list of proposal distributions. When those proposal distributions are used to create control variates, it is possible (Owen and Zhou, 2000) to bound the ratio of the resulting…

Computation · Statistics 2014-11-18 Hera Y. He , Art B. Owen

To derive recommendations on how to analyze longitudinal data, we examined Type I error rates of Multilevel Linear Models (MLM) and repeated measures Analysis of Variance (rANOVA) using SAS and SPSS.We performed a simulation with the…

Applications · Statistics 2018-11-06 Nicolas Haverkamp , André Beauducel

Data-driven risk analysis involves the inference of probability distributions from measured or simulated data. In the case of a highly reliable system, such as the electricity grid, the amount of relevant data is often exceedingly limited,…

Methodology · Statistics 2017-07-11 Simon H. Tindemans , Goran Strbac

Markov chain Monte Carlo (MCMC) methods asymptotically sample from complex probability distributions. The pseudo-marginal MCMC framework only requires an unbiased estimator of the unnormalized probability distribution function to construct…

Computation · Statistics 2016-05-25 Iain Murray , Matthew M. Graham

Computing the marginal likelihood (ML) of a model requires marginalizing out all of the parameters and latent variables, a difficult high-dimensional summation or integration problem. To make matters worse, it is often hard to measure the…

Machine Learning · Statistics 2015-11-10 Roger B. Grosse , Zoubin Ghahramani , Ryan P. Adams

In this paper we develop a continuous-time sequential importance sampling (CIS) algorithm which eliminates time-discretisation errors and provides online unbiased estimation for continuous time Markov processes, in particular for…

Methodology · Statistics 2017-12-19 Paul Fearnhead , Krzystof Latuszynski , Gareth O. Roberts , Giorgos Sermaidis

Support vector machine (SVM) has attracted great attentions for the last two decades due to its extensive applications, and thus numerous optimization models have been proposed. To distinguish all of them, in this paper, we introduce a new…

Optimization and Control · Mathematics 2021-04-06 Huajun Wang , Yuanhai Shao , Shenglong Zhou , Ce Zhang , Naihua Xiu

Monitoring the performance of classification models in production is critical yet challenging due to strict labeling budgets, one-shot batch acquisition of labels and extremely low error rates. We propose a general framework based on…

Machine Learning · Computer Science 2026-02-02 Lupo Marsigli , Angel Lopez de Haro

The SIS (susceptible-infected-susceptible) epidemic model on an arbitrary network, without making approximations, is a $2^n$-state Markov chain with a unique absorbing state (the all-healthy state). This makes analysis of the SIS model and,…

Social and Information Networks · Computer Science 2019-01-21 Navid Azizan Ruhi , Christos Thrampoulidis , Babak Hassibi

Given a large data matrix $A\in\mathbb{R}^{n\times n}$, we consider the problem of determining whether its entries are i.i.d. with some known marginal distribution $A_{ij}\sim P_0$, or instead $A$ contains a principal submatrix $A_{{\sf…

Computational Complexity · Computer Science 2015-02-24 Yash Deshpande , Andrea Montanari

Comparative meta-analyses of groups of subjects by integrating multiple observational studies rely on estimated propensity scores (PSs) to mitigate covariate imbalances. However, PS estimation grapples with the theoretical and practical…

Methodology · Statistics 2024-05-09 Subharup Guha , Yi Li

This article considers the sequential Monte Carlo (SMC) approximation of ratios of normalizing constants associated to posterior distributions which in principle rely on continuum models. Therefore, the Monte Carlo estimation error and the…

Computation · Statistics 2016-03-04 Pierre Del Moral , Ajay Jasra , Kody Law , Yan Zhou