English
Related papers

Related papers: Distribution Estimation for Probabilistic Loops

200 papers

The aim of this paper is to introduce a new Monte Carlo method based on importance sampling techniques for the simulation of stochastic differential equations. The main idea is to combine random walk on squares or rectangles methods with…

Probability · Mathematics 2010-10-22 Madalina Deaconu , Antoine Lejay

We study statistical inference and distributionally robust solution methods for stochastic optimization problems, focusing on confidence intervals for optimal values and solutions that achieve exact coverage asymptotically. We develop a…

Machine Learning · Statistics 2018-07-03 John Duchi , Peter Glynn , Hongseok Namkoong

We propose a numerical method to learn Maximum Entropy (MaxEnt) distributions with spatio-temporal constraints from experimental spike trains. This is an extension of two papers [10] and [4] who proposed the estimation of parameters where…

Neurons and Cognition · Quantitative Biology 2015-06-19 Hassan Nasser , Bruno Cessac

Probability models on graphs are becoming increasingly important in many applications, but statistical tools for fitting such models are not yet well developed. Here we propose a general method of moments approach that can be used to fit a…

Statistics Theory · Mathematics 2012-02-24 Peter J. Bickel , Aiyou Chen , Elizaveta Levina

We discuss the probabilistic properties of the variation based third and fourth moments of financial returns as estimators of the actual moments of the return distributions. The moment variations are defined under non-parametric assumptions…

Statistical Finance · Quantitative Finance 2019-08-15 Kyungsub Lee

Maximum entropy models are increasingly being used to describe the collective activity of neural populations with measured mean neural activities and pairwise correlations, but the full space of probability distributions consistent with…

Biological Physics · Physics 2017-08-22 Badr F. Albanna , Christopher Hillar , Jascha Sohl-Dickstein , Michael R. DeWeese

This letter reports two moment extensions of the entropy of a distribution. By understanding the traditional entropy as the average of the original distribution up to a random variable transformation, the traditional moments equation become…

Statistical Mechanics · Physics 2008-03-25 Luciano da Fontoura Costa

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

Sampling is often a necessary evil to reduce the processing and storage costs of distributed tracing. In this work, we describe a scalable and adaptive sampling approach that can preserve events of interest better than the widely used…

Data Structures and Algorithms · Computer Science 2021-07-19 Otmar Ertl

Calibration methods have been widely studied in survey sampling over the last decades. Viewing calibration as an inverse problem, we extend the calibration technique by using a maximum entropy method. Finding the optimal weights is achieved…

Methodology · Statistics 2009-09-23 Fabrice Gamboa , Jean-Michel Loubes , Paul Rochet

A new method called "variational sampling" is proposed to estimate integrals under probability distributions that can be evaluated up to a normalizing constant. The key idea is to fit the target distribution with an exponential family model…

Computation · Statistics 2013-10-15 Alexis Roche

We consider the discrete three dimensional scan statistics. Viewed as the maximum of an 1-dependent stationary r.v.'s sequence, we provide approximations and error bounds for the probability distribution of the three dimensional scan…

Computation · Statistics 2013-03-18 Alexandru Amarioarei , Cristian Preda

In Change point detection task Likelihood Ratio Test (LRT) is sequentially applied in a sliding window procedure. Its high values indicate changes of parametric distribution in the data sequence. Correspondingly LRT values require…

Statistics Theory · Mathematics 2017-10-23 Nazar Buzun , Valeriy Avanesov

Cross-classified data frequently arise in scientific fields such as education, healthcare, and social sciences. A common modeling strategy is to introduce crossed random effects within a regression framework. However, this approach often…

Methodology · Statistics 2025-07-22 Shota Takeishi , Shonosuke Sugasawa

We develop a maximum relative entropy formalism to generate optimal approximations to probability distributions. The central results consist in (a) justifying the use of relative entropy as the uniquely natural criterion to select a…

Statistical Mechanics · Physics 2008-10-17 Chih-Yuan Tseng , Ariel Caticha

Maximization of the entropy rate is an important issue to design diffusion processes aiming at a well-mixed state. We demonstrate that it is possible to construct maximal-entropy random walks with only local information on the graph…

Statistical Mechanics · Physics 2011-03-14 Roberta Sinatra , Jesús Gómez-Gardeñes , Renaud Lambiotte , Vincenzo Nicosia , Vito Latora

A weighted likelihood technique for robust estimation of a multivariate Wrapped Normal distribution for data points scattered on a p-dimensional torus is proposed. The occurrence of outliers in the sample at hand can badly compromise…

Methodology · Statistics 2021-07-01 Giovanni Saraceno , Claudio Agostinelli , Luca Greco

An algorithm is described that enables efficient deterministic approximate computation of the bootstrap distribution for any linear bootstrap method $T_n^*$, alleviating the need for repeated resampling from observations (resp.…

Methodology · Statistics 2019-04-10 Thomas Pitschel

Quantization for probability distributions concerns the best approximation of a $d$-dimensional probability distribution $P$ by a discrete probability with a given number $n$ of supporting points. In this paper, we have considered a…

Dynamical Systems · Mathematics 2022-05-17 Lakshmi Roychowdhury , Mrinal Kanti Roychowdhury

We derive an efficient method to calculate exceedance probabilities (EP) for the Dirichlet distribution when the number of event types is larger than two. Also, we present an intuitive application of Dirichlet EPs and compare our method to…

Applications · Statistics 2016-11-07 Joram Soch , Carsten Allefeld