English
Related papers

Related papers: A Practical Guide to Sample-based Statistical Dist…

200 papers

A valuable step in the modeling of multiscale dynamical systems in fields such as computational chemistry, biology, materials science and more, is the representative sampling of the phase space over long timescales of interest; this task is…

Machine Learning · Computer Science 2023-12-29 Ellis R. Crabtree , Juan M. Bello-Rivas , Ioannis G. Kevrekidis

Heralded by the initial success in speech recognition and image classification, learning-based approaches with neural networks, commonly referred to as deep learning, have spread across various fields. A primitive form of a neural network…

Robotics · Computer Science 2024-09-02 Takuma Yoneda

In image generation, generative models can be evaluated naturally by visually inspecting model outputs. However, this is not always the case for graph generative models (GGMs), making their evaluation challenging. Currently, the standard…

Machine Learning · Computer Science 2022-04-29 Rylee Thompson , Boris Knyazev , Elahe Ghalebi , Jungtaek Kim , Graham W. Taylor

Given two distinct datasets, an important question is if they have arisen from the the same data generating function or alternatively how their data generating functions diverge from one another. In this paper, we introduce an approach for…

Machine Learning · Statistics 2019-09-17 Marco Henrique de Almeida Inácio , Rafael Izbicki , Bálint Gyires-Tóth

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent)…

Machine Learning · Computer Science 2025-04-22 Dimitris G. Giovanis , Ellis Crabtree , Roger G. Ghanem , Ioannis G. Kevrekidis

Many data-driven decision problems are formulated using a nominal distribution estimated from historical data, while performance is ultimately determined by a deployment distribution that may be shifted, context-dependent, partially…

Machine Learning · Computer Science 2026-04-07 Xiuyuan Cheng , Yunqin Zhu , Yao Xie

Quantifying the distance between datasets is a fundamental question in mathematics and machine learning. We propose \textit{magnitude distance}, a novel distance metric defined on finite datasets using the notion of the \emph{magnitude} of…

Machine Learning · Computer Science 2026-02-10 Sahel Torkamani , Henry Gouk , Rik Sarkar

The emergence of generative AI models has dramatically expanded the availability and use of synthetic data across scientific, industrial, and policy domains. While these developments open new possibilities for data analysis, they also raise…

Machine Learning · Statistics 2026-03-06 Ahmad Abdel-Azim , Ruoyu Wang , Xihong Lin

Generative modeling, which learns joint probability distribution from data and generates samples according to it, is an important task in machine learning and artificial intelligence. Inspired by probabilistic interpretation of quantum…

Statistical Mechanics · Physics 2018-07-20 Zhao-Yu Han , Jun Wang , Heng Fan , Lei Wang , Pan Zhang

Intractable generative models are models for which the likelihood is unavailable but sampling is possible. Most approaches to parameter inference in this setting require the computation of some discrepancy between the data and the…

Computation · Statistics 2022-07-05 Ziang Niu , Johanna Meier , François-Xavier Briol

Obtaining high certainty in predictive models is crucial for making informed and trustworthy decisions in many scientific and engineering domains. However, extensive experimentation required for model accuracy can be both costly and…

Machine Learning · Computer Science 2024-12-17 Giorgio Morales , John Sheppard

Generative Adversarial Networks have shown remarkable success in learning a distribution that faithfully recovers a reference distribution in its entirety. However, in some cases, we may want to only learn some aspects (e.g., cluster or…

Machine Learning · Computer Science 2019-05-16 Charlotte Bunne , David Alvarez-Melis , Andreas Krause , Stefanie Jegelka

Advances in generative models increase the need for sample quality assessment. To do so, previous methods rely on a pre-trained feature extractor to embed the generated samples and real samples into a common space for comparison. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jingyi Xu , Hieu Le , Dimitris Samaras

Network data arises through observation of relational information between a collection of entities. Recent work in the literature has independently considered when (i) one observes a sample of networks, connectome data in neuroscience being…

Methodology · Statistics 2022-06-22 George Bolt , Simón Lunagómez , Christopher Nemeth

Neural samplers such as variational autoencoders (VAEs) or generative adversarial networks (GANs) approximate distributions by transforming samples from a simple random source---the latent space---to samples from a more complex distribution…

Machine Learning · Statistics 2018-02-09 Nutan Chen , Alexej Klushyn , Richard Kurle , Xueyan Jiang , Justin Bayer , Patrick van der Smagt

This paper motivates the use of random-bridges -- stochastic processes conditioned to take target distributions at fixed timepoints -- in the realm of generative modelling. Herein, random-bridges can act as stochastic transports between two…

Machine Learning · Computer Science 2026-04-07 Stefano Goria , Levent A. Mengütürk , Murat C. Mengütürk , Berkan Sesen

Learning algorithms for implicit generative models can optimize a variety of criteria that measure how the data distribution differs from the implicit model distribution, including the Wasserstein distance, the Energy distance, and the…

Machine Learning · Statistics 2019-08-23 Leon Bottou , Martin Arjovsky , David Lopez-Paz , Maxime Oquab

Maximum Mean Discrepancy (MMD) has been widely used in the areas of machine learning and statistics to quantify the distance between two distributions in the $p$-dimensional Euclidean space. The asymptotic property of the sample MMD has…

Statistics Theory · Mathematics 2023-08-29 Hanjia Gao , Xiaofeng Shao

Computing the similarity between two probability distributions is a recurring theme across control. We introduce a unified family of distances between the probability distributions of two random variables that is based on the discrepancy…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Alexandros E. Tzikas , Arec Jamgochian , Nazim Kemal Ure , Mykel J. Kochenderfer , Stephen P. Boyd

Generative Artificial Intelligence is emerging as an important technology, promising to be transformative in many areas. At the same time, generative AI techniques are based on sampling from probabilistic models, and by default, they come…

Artificial Intelligence · Computer Science 2025-09-19 Edgar Dobriban