English
Related papers

Related papers: Multivariate rank via entropic optimal transport: …

200 papers

In many statistical and econometric applications, we gather individual samples from various interconnected populations that undeniably exhibit common latent structures. Utilizing a model that incorporates these latent structures for such…

Methodology · Statistics 2023-09-19 Archer Gong Zhang , Jiahua Chen

We study the problem of estimating a function $T$ given independent samples from a distribution $P$ and from the pushforward distribution $T_\sharp P$. This setting is motivated by applications in the sciences, where $T$ represents the…

Statistics Theory · Mathematics 2024-01-04 Vincent Divol , Jonathan Niles-Weed , Aram-Alexandre Pooladian

We introduce a rank-statistic approximation of $f$-divergences that avoids explicit density-ratio estimation by working directly with the distribution of ranks. For a resolution parameter $K$, we map the mismatch between two univariate…

Machine Learning · Statistics 2026-02-02 Viktor Stein , José Manuel de Frutos

We propose a method to optimize the representation and distinguishability of samples from two probability distributions, by maximizing the estimated power of a statistical test based on the maximum mean discrepancy (MMD). This optimized MMD…

Most Relevant Explanation (MRE) is a method for finding multivariate explanations for given evidence in Bayesian networks [12]. This paper studies the theoretical properties of MRE and develops an algorithm for finding multiple top MRE…

Artificial Intelligence · Computer Science 2012-05-14 Changhe Yuan , Xiaolu Liu , Tsai-Ching Lu , Heejin Lim

Two typical fixed-length random number generation problems in information theory are considered for general sources. One is the source resolvability problem and the other is the intrinsic randomness problem. In each of these problems, the…

Information Theory · Computer Science 2024-05-14 Ryo Nomura , Hideki Yagi

We introduce a formulation of optimal transport problem for distributions on function spaces, where the stochastic map between functional domains can be partially represented in terms of an (infinite-dimensional) Hilbert-Schmidt operator…

Machine Learning · Statistics 2023-08-29 Jiacheng Zhu , Aritra Guha , Dat Do , Mengdi Xu , XuanLong Nguyen , Ding Zhao

During recent decades, there has been a substantial development in optimal mass transport theory and methods. In this work, we consider multi-marginal problems wherein only partial information of each marginal is available, which is a setup…

Signal Processing · Electrical Eng. & Systems 2019-05-13 Filip Elvander , Isabel Haasler , Andreas Jakobsson , Johan Karlsson

Exploration is essential for solving complex Reinforcement Learning (RL) tasks. Maximum State-Visitation Entropy (MSVE) formulates the exploration problem as a well-defined policy optimization problem whose solution aims at visiting all…

We propose a class of rank-based procedures for testing that the shape matrix $\mathbf{V}$ of an elliptical distribution (with unspecified center of symmetry, scale and radial density) has some fixed value ${\mathbf{V}}_0$; this includes,…

Statistics Theory · Mathematics 2009-09-29 Marc Hallin , Davy Paindaveine

We introduce a new criterion, the Rank Selection Criterion (RSC), for selecting the optimal reduced rank estimator of the coefficient matrix in multivariate response regression models. The corresponding RSC estimator minimizes the Frobenius…

Statistics Theory · Mathematics 2011-10-18 Florentina Bunea , Yiyuan She , Marten H. Wegkamp

Filtering out unrealistic images from trained generative adversarial networks (GANs) has attracted considerable attention recently. Two density ratio based subsampling methods---Discriminator Rejection Sampling (DRS) and Metropolis-Hastings…

Machine Learning · Computer Science 2020-04-22 Xin Ding , Z. Jane Wang , William J. Welch

The need to reason about uncertainty in large, complex, and multi-modal datasets has become increasingly common across modern scientific environments. The ability to transform samples from one distribution $P$ to another distribution $Q$…

Machine Learning · Statistics 2018-11-30 Diego A. Mesa , Justin Tantiongloc , Marcela Mendoza , Todd P. Coleman

We study single commodity network flows with suitable robustness and efficiency specs. An original use of a maximum entropy problem for distributions on the paths of the graph turns this problem into a steering problem for Markov chains…

Mathematical Physics · Physics 2017-09-28 Yongxin Chen , Tryphon T. Georgiou , Michele Pavon , Allen Tannenbaum

We are deriving optimal rank-based tests for the adequacy of a vector autoregressive-moving average (VARMA) model with elliptically contoured innovation density. These tests are based on the ranks of pseudo-Mahalanobis distances and on…

Statistics Theory · Mathematics 2007-06-13 Marc Hallin , Davy Paindaveine

This paper is concerned with the sample efficiency of reinforcement learning, assuming access to a generative model (or simulator). We first consider $\gamma$-discounted infinite-horizon Markov decision processes (MDPs) with state space…

Machine Learning · Computer Science 2025-03-18 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

Generating synthetic populations from aggregate statistics is a core component of microsimulation, agent-based modeling, policy analysis, and privacy-preserving data release. Beyond classical census marginals, many applications require…

Artificial Intelligence · Computer Science 2026-04-14 François Pachet , Jean-Daniel Zucker

Goal-conditioned reinforcement learning (GCRL) has a wide range of potential real-world applications, including manipulation and navigation problems in robotics. Especially in such robotics tasks, sample efficiency is of the utmost…

Machine Learning · Computer Science 2023-01-23 Bo Liu , Yihao Feng , Qiang Liu , Peter Stone

We consider the Monge problem of optimal transport between a compactly supported source measure and a target probability measure with unbounded support. We consider the convergence of optimal maps and potential functions when the target…

Numerical Analysis · Mathematics 2026-03-03 Axel G. R. Turnquist

Diffusion policies are expressive yet incur high inference latency. Flow Matching (FM) enables one-step generation, but integrating it into Maximum Entropy Reinforcement Learning (MaxEnt RL) is challenging: the optimal policy is an…

Machine Learning · Computer Science 2026-02-03 Zeqiao Li , Yijing Wang , Haoyu Wang , Zheng Li , Zhiqiang Zuo