English
Related papers

Related papers: Pathwise Derivatives for Multivariate Distribution…

200 papers

Reinforcement learning methods for robotics are increasingly successful due to the constant development of better policy gradient techniques. A precise (low variance) and accurate (low bias) gradient estimator is crucial to face…

Machine Learning · Computer Science 2022-03-09 Joao Carvalho , Jan Peters

The unsupervised task of aligning two or more distributions in a shared latent space has many applications including fair representations, batch effect mitigation, and unsupervised domain adaptation. Existing flow-based approaches estimate…

Machine Learning · Computer Science 2022-03-17 Zeyu Zhou , Ziyu Gong , Pradeep Ravikumar , David I. Inouye

In neural networks with binary activations and or binary weights the training by gradient descent is complicated as the model has piecewise constant response. We consider stochastic binary networks, obtained by adding noises in front of…

Machine Learning · Statistics 2020-11-05 Alexander Shekhovtsov , Viktor Yanush , Boris Flach

This paper introduces the path derivatives, in the spirit of Dupire's functional It\^o calculus, for the controlled paths in the rough path theory with possibly non-geometric rough paths. The theory allows us to deal with rough integration…

Probability · Mathematics 2014-12-24 Christian Keller , Jianfeng Zhang

We establish the existence of solutions to path-dependent rough differential equations with non-anticipative coefficients. Regularity assumptions on the coefficients are formulated in terms of horizontal and vertical derivatives.

Probability · Mathematics 2020-01-30 Anna Ananova

Multivariate normal mixtures provide a flexible model for high-dimensional data. They are widely used in statistical genetics, statistical finance, and other disciplines. Due to the unboundedness of the likelihood function, classical…

Statistics Theory · Mathematics 2008-05-27 Jiahua Chen , Xianming Tan

We propose a new method for multivariate response regression and covariance estimation when elements of the response vector are of mixed types, for example some continuous and some discrete. Our method is based on a model which assumes the…

Methodology · Statistics 2022-03-04 Karl Oskar Ekvall , Aaron J. Molstad

A general methodology is introduced for the construction and effective application of control variates to estimation problems involving data from reversible MCMC samplers. We propose the use of a specific class of functions as control…

Computation · Statistics 2010-08-10 Petros Dellaportas , Ioannis Kontoyiannis

Natural gradient methods have been used to optimise the parameters of probability distributions in a variety of settings, often resulting in fast-converging procedures. Unfortunately, for many distributions of interest, computing the…

Machine Learning · Statistics 2024-05-28 Jonathan So , Richard E. Turner

We propose a bivariate quantile regression method for the bivariate varying coefficient model through a directional approach. The varying coefficients are approximated by the B-spline basis and an $L_{2}$ type penalty is imposed to achieve…

Methodology · Statistics 2015-11-10 Linglong Kong , Haoxu Shu , Giseon Heo , Qianchuan Chad He

Inference and prediction of routes have become of interest over the past decade owing to a dramatic increase in package delivery and ride-sharing services. Given the underlying combinatorial structure and the incorporation of probabilities,…

Logic in Computer Science · Computer Science 2023-06-21 Suwei Yang , Victor C. Liang , Kuldeep S. Meel

We propose a general variance reduction strategy for diffusion processes. Our approach does not require the knowledge of the measure that is sampled, which may indeed be unknown as for nonequilibrium dynamics in statistical physics. We show…

Numerical Analysis · Mathematics 2019-01-29 Julien Roussel , Gabriel Stoltz

Our purpose is to obtain gradient estimates for certain nonlinear partial differential equations by coupling methods. First we derive uniform gradient estimates for a certain semi-linear PDEs based on the coupling method introduced in Wang…

Probability · Mathematics 2014-07-22 Yongsheng Song

We introduce some new indexes to measure the departure of any multivariate continuous distribution on non-negative orthant from a given reference one such the uncorrelated exponential model, similar to the relative Fisher dispersion indexes…

Statistics Theory · Mathematics 2019-06-25 Célestin C. Kokonendji , Aboubacar Y. Touré , Amadou Sawadogo

We provide a novel method for sensitivity analysis of parametric robust Markov chains. These models incorporate parameters and sets of probability distributions to alleviate the often unrealistic assumption that precise probabilities are…

Machine Learning · Computer Science 2023-05-03 Thom Badings , Sebastian Junges , Ahmadreza Marandi , Ufuk Topcu , Nils Jansen

The major sources of abundant data are constantly expanding with the available data collection methodologies in various applications - medical, insurance, scientific, bio-informatics and business. These data sets may be distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-24 Aruna Govada , Sanjay K. Sahay

A general class of unidirectional transforms is presented that can be computed in a distributed manner along an arbitrary routing tree. Additionally, we provide a set of conditions under which these transforms are invertible. These…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-14 Godwin Shen , Antonio Ortega

This paper is a broad and accessible survey of the methods we have at our disposal for Monte Carlo gradient estimation in machine learning and across the statistical sciences: the problem of computing the gradient of an expectation of a…

Machine Learning · Statistics 2020-09-30 Shakir Mohamed , Mihaela Rosca , Michael Figurnov , Andriy Mnih

We describe a method for computing transport coefficients from the direct evaluation of large deviation function. This method is general, relying on only equilibrium fluctuations, and is statistically efficient, employing trajectory based…

Statistical Mechanics · Physics 2017-11-22 Chloe Ya Gao , David T. Limmer

We present the fundamentals of a measure transport approach to sampling. The idea is to construct a deterministic coupling---i.e., a transport map---between a complex "target" probability measure of interest and a simpler reference measure.…

Computation · Statistics 2017-12-27 Youssef Marzouk , Tarek Moselhy , Matthew Parno , Alessio Spantini