English
Related papers

Related papers: Negative Examples for Sequential Importance Sampli…

200 papers

How to sample high quality negative instances from unlabeled data, i.e., negative sampling, is important for training implicit collaborative filtering and contrastive learning models. Although previous studies have proposed some approaches…

Information Retrieval · Computer Science 2022-07-12 Bin Liu , Bang Wang

We present a randomized approximation algorithm for counting contingency tables, mxn non-negative integer matrices with given row sums R=(r_1, ..., r_m) and column sums C=(c_1, ..., c_n). We define smooth margins (R,C) in terms of the…

Combinatorics · Mathematics 2010-11-29 Alexander Barvinok , Zur Luria , Alex Samorodnitsky , Alexander Yong

This paper addresses how to improve the computational efficiency and estimation reliability in cascading outage analysis. We first formulate a cascading outage as a Markov chain with specific state space and transition probability by…

Systems and Control · Computer Science 2016-11-03 Jinpeng Guo , Feng Liu , Jianhui Wang , Junhao Lin , Shengwei Mei

High throughput technologies have become the practice of choice for comparative studies in biomedical applications. Limited number of sample points due to sequencing cost or access to organisms of interest necessitates the development of…

Methodology · Statistics 2018-07-17 Ariana Broumand , Siamak Zamani Dadaneh

Importance sampling is a technique that is commonly used to speed up Monte Carlo simulation of rare events. However, little is known regarding the design of efficient importance sampling algorithms in the context of queueing networks. The…

Probability · Mathematics 2009-09-29 Paul Dupuis , Ali Devin Sezer , Hui Wang

In this paper we consider a Bayesian analysis of contingency tables allowing for the possibility that cells may have probability zero. In this sense we depart from standard log-linear modeling that implicitly assumes a positivity…

Statistics Theory · Mathematics 2007-06-13 Guido Consonni , Giovanni Pistone

Importance sampling (IS) is a Monte Carlo technique for the approximation of intractable distributions and integrals with respect to them. The origin of IS dates from the early 1950s. In the last decades, the rise of the Bayesian paradigm…

Computation · Statistics 2024-06-21 Víctor Elvira , Luca Martino

Finding Minimal Unsatisfiable Subsets (MUSes) of binary constraints is a common problem in infeasibility analysis of over-constrained systems. However, because of the exponential search space of the problem, enumerating MUSes is extremely…

Artificial Intelligence · Computer Science 2024-02-27 Panagiotis Lymperopoulos , Liping Liu

In this paper, we propose a sequential directional importance sampling (SDIS) method for rare event estimation. SDIS expresses a small failure probability in terms of a sequence of auxiliary failure probabilities, defined by magnifying the…

Computation · Statistics 2022-02-14 Kai Cheng , Iason Papaioannou , Zhenzhou Lu , Xiaobo Zhang , Yanping Wang

Sequential directional importance sampling (SDIS) is an efficient adaptive simulation method for estimating failure probabilities. It expresses the failure probability as the product of a group of integrals that are easy to estimate,…

Methodology · Statistics 2024-10-31 Kai Chenga , Iason Papaioannou , Daniel Straub

We construct examples of contingency tables on $n$ binary random variables where the gap between the linear programming lower/upper bound and the true integer lower/upper bounds on cell entries is exponentially large. These examples provide…

Optimization and Control · Mathematics 2007-06-13 Seth Sullivant

We give an algorithm that generates a uniformly random contingency table with specified marginals, i.e. a matrix with non-negative integer values and specified row and column sums. Such algorithms are useful in statistics and combinatorics.…

Combinatorics · Mathematics 2021-06-17 Andrii Arman , Pu Gao , Nicholas Wormald

Sequential sampling occurs when the entire population is not known in advance and data are obtained one at a time or in groups of units. This manuscript proposes a new algorithm to sequentially select a balanced sample. The algorithm…

Methodology · Statistics 2023-01-04 Raphaël Jauslin , Bardia Panahbehagh , Yves Tillé

Discovering statistically significant patterns from databases is an important challenging problem. The main obstacle of this problem is in the difficulty of taking into account the selection bias, i.e., the bias arising from the fact that…

Machine Learning · Statistics 2016-03-10 Shinya Suzumura , Kazuya Nakagawa , Mahito Sugiyama , Koji Tsuda , Ichiro Takeuchi

In social and biomedical sciences testing in contingency tables often involves order restrictions on cell-probabilities parameters. We develop objective Bayes methods for order-constrained testing and model comparison when observations…

Methodology · Statistics 2018-10-24 Roberta Paroli , Guido Consonni

The uniform distribution on matrices with specified row and column sums is often a natural choice of null model when testing for structure in two-way tables (binary or nonnegative integer). Due to the difficulty of sampling from this…

Computation · Statistics 2013-08-14 Jeffrey W. Miller , Matthew T. Harrison

In this paper we develop a continuous-time sequential importance sampling (CIS) algorithm which eliminates time-discretisation errors and provides online unbiased estimation for continuous time Markov processes, in particular for…

Methodology · Statistics 2017-12-19 Paul Fearnhead , Krzystof Latuszynski , Gareth O. Roberts , Giorgos Sermaidis

This paper makes three contributions to estimating the number of perfect matching in bipartite graphs. First, we prove that the popular sequential importance sampling algorithm works in polynomial time for dense bipartite graphs. More…

Probability · Mathematics 2022-07-07 Yeganeh Alimohammadi , Persi Diaconis , Mohammad Roghani , Amin Saberi

We present a matrix-factorization algorithm that scales to input matrices with both huge number of rows and columns. Learned factors may be sparse or dense and/or non-negative, which makes our algorithm suitable for dictionary learning,…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gael Varoquaux

Importance sampling (IS) represents a fundamental technique for a large surge of off-policy reinforcement learning approaches. Policy gradient (PG) methods, in particular, significantly benefit from IS, enabling the effective reuse of…

Machine Learning · Computer Science 2024-05-10 Matteo Papini , Giorgio Manganini , Alberto Maria Metelli , Marcello Restelli