English
Related papers

Related papers: Pathwise Derivatives for Multivariate Distribution…

200 papers

Sampling is an important tool for estimating large, complex sums and integrals over high dimensional spaces. For instance, important sampling has been used as an alternative to exact methods for inference in belief networks. Ideally, we…

Artificial Intelligence · Computer Science 2013-01-18 Luis E. Ortiz , Leslie Pack Kaelbling

Optimal transport is the problem of designing a joint distribution for two random variables with fixed marginals. In virtually the entire literature on this topic, the objective is to minimize expected cost. This paper is the first to study…

Econometrics · Economics 2026-02-13 Yinchu Zhu , Ilya O. Ryzhov

Given a variety over $\mathbb{Q}$, we study the distribution of the number of primes dividing the coordinates as we vary an integral point. Under suitable assumptions, we show that this has a multivariate normal distribution. We generalise…

Number Theory · Mathematics 2021-08-27 Daniel El-Baz , Daniel Loughran , Efthymios Sofos

Deep learning-based multivariate and multistep-ahead traffic forecasting models are typically trained with the mean squared error (MSE) or mean absolute error (MAE) as the loss function in a sequence-to-sequence setting, simply assuming…

Machine Learning · Computer Science 2026-01-28 Seongjin Choi , Nicolas Saunier , Vincent Zhihao Zheng , Martin Trepanier , Lijun Sun

Discrete choice models are commonly used by applied statisticians in numerous fields, such as marketing, economics, finance, and operations research. When agents in discrete choice models are assumed to have differing preferences, exact…

Methodology · Statistics 2010-06-04 Michael Braun , Jon McAuliffe

Existing results for the estimation of the L\'evy measure are mostly limited to the onedimensional setting. We apply the spectral method to multidimensional L\'evy processes in order to construct a nonparametric estimator for the…

Statistics Theory · Mathematics 2023-05-24 Maximilian F. Steffen

Maximum likelihood estimation of generalized linear mixed models(GLMMs) is difficult due to marginalization of the random effects. Computing derivatives of a fitted GLMM's likelihood (with respect to model parameters) is also difficult,…

Methodology · Statistics 2022-12-12 Ting Wang , Benjamin Graves , Yves Rosseel , Edgar C. Merkle

In this paper we consider bound-constrained mixed-integer optimization problems where the objective function is differentiable w.r.t.\ the continuous variables for every configuration of the integer variables. We mainly suggest to exploit…

Optimization and Control · Mathematics 2026-01-19 Matteo Lapucci , Giampaolo Liuzzi , Stefano Lucidi , Pierluigi Mansueto

Imbalance in covariate distributions leads to biased estimates of causal effects. Weighting methods attempt to correct this imbalance but rely on specifying models for the treatment assignment mechanism, which is unknown in observational…

Methodology · Statistics 2022-05-13 Eric Dunipace

In this paper, we propose a latent-variable generative model called mixture of dynamical variational autoencoders (MixDVAE) to model the dynamics of a system composed of multiple moving sources. A DVAE model is pre-trained on a…

Machine Learning · Computer Science 2023-12-08 Xiaoyu Lin , Laurent Girin , Xavier Alameda-Pineda

A new approach of obtaining stratified random samples from statistically dependent random variables is described. The proposed method can be used to obtain samples from the input space of a computer forward model in estimating expectations…

Methodology · Statistics 2019-11-25 Anirban Mondal , Abhijit Mandal

The Maxwell approach from electrostatics is applied for calculation of transport coefficients in composites. The viscosity of a dilute emulsion is obtained as a function of the volume fraction of dispersed phase. The derived new formula is…

Soft Condensed Matter · Physics 2011-12-19 K. Dimitrov , B. Radoev , R. Tsekov

Stochastic linear combinations of some random vectors are studied where the distribution of the random vectors and the joint distribution of their coefficients are Dirichlet. A method is provided for calculating the distribution of these…

Statistics Theory · Mathematics 2016-03-03 Hazhir Homei

This paper proposes a new equation from continuous adjoint theory to compute the gradient of quantities governed by the Transport Theory of light. Unlike discrete gradients ala autograd, which work at the code level, we first formulate the…

Graphics · Computer Science 2020-06-29 Jos Stam

This work deals with uncertainty quantification for a generic input distribution to some resource-intensive simulation, e.g., requiring the solution of a partial differential equation. While efficient numerical methods exist to compute…

Numerical Analysis · Mathematics 2025-06-16 Oliver G. Ernst , Hanno Gottschalk , Toni Kowalewitz , Patrick Krüger

Optimal transport is widely used to learn distributions, enforce distributional constraints, and model uncertainty. In applications, transport losses are often computed from samples through tractable representations, such as one-dimensional…

Optimization and Control · Mathematics 2026-05-28 Tam Le

We introduce a generalization of the Adaptive Multilevel Splitting algorithm in the discrete time dynamic setting, namely when it is applied to sample rare events associated with paths of Markov chains. By interpreting the algorithm as a…

Integration against, and hence sampling from, high-dimensional probability distributions is of essential importance in many application areas and has been an active research area for decades. One approach that has drawn increasing attention…

Numerical Analysis · Mathematics 2023-08-22 Ilja Klebanov , T. J. Sullivan

We consider the closely related problems of sampling from a distribution known up to a normalizing constant, and estimating said normalizing constant. We show how variational autoencoders (VAEs) can be applied to this task. In their…

Machine Learning · Computer Science 2022-09-22 George T. Cantwell

Multivariate functions encountered in high-dimensional uncertainty quantification problems often vary most strongly along a few dominant directions in the input parameter space. We propose a gradient-based method for detecting these…

Analysis of PDEs · Mathematics 2019-11-11 Olivier Zahm , Paul Constantine , Clémentine Prieur , Youssef Marzouk