English
Related papers

Related papers: Dataset Dynamics via Gradient Flows in Probability…

200 papers

We formulate and solve a regression problem with time-stamped distributional data. Distributions are considered as points in the Wasserstein space of probability measures, metrized by the 2-Wasserstein metric, and may represent images,…

Systems and Control · Electrical Eng. & Systems 2021-06-30 Amirhossein Karimi , Tryphon T. Georgiou

Domain shifts in the training data are common in practical applications of machine learning; they occur for instance when the data is coming from different sources. Ideally, a ML model should work well independently of these shifts, for…

Dataset Distillation (DD) aims to generate a compact synthetic dataset that enables models to achieve performance comparable to training on the full large dataset, significantly reducing computational costs. Drawing from optimal transport…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Haoyang Liu , Yijiang Li , Tiancheng Xing , Peiran Wang , Vibhu Dalal , Luwei Li , Jingrui He , Haohan Wang

We present a novel method for efficiently computing optimal transport maps and Wasserstein barycenters in high-dimensional spaces. Our approach uses conditional normalizing flows to approximate the input distributions as invertible…

Machine Learning · Statistics 2025-05-29 Gabriele Visentin , Patrick Cheridito

The default Gaussian latent in flow-based generative models poses challenges when learning certain distributions such as heavy-tailed ones. We introduce a general framework for learning data-adaptive latent distributions using…

Machine Learning · Statistics 2026-02-11 Jannis Chemseddine , Gregor Kornhardt , Richard Duong , Gabriele Steidl

Normalizing flows are powerful non-parametric statistical models that function as a hybrid between density estimators and generative models. Current learning algorithms for normalizing flows assume that data points are sampled…

Machine Learning · Computer Science 2023-05-31 Matthias Kirchler , Christoph Lippert , Marius Kloft

We develop a novel clustering method for distributional data, where each data point is regarded as a probability distribution on the real line. For distributional data, it has been challenging to develop a clustering method that utilizes…

Methodology · Statistics 2025-06-24 Ryo Okano , Masaaki Imaizumi

Graphs are playing a crucial role in different fields since they are powerful tools to unveil intrinsic relationships among signals. In many scenarios, an accurate graph structure representing signals is not available at all and that…

Machine Learning · Computer Science 2021-05-14 Xiang Zhang , Yinfei Xu , Qinghe Liu , Zhicheng Liu , Jian Lu , Qiao Wang

Flow matching has recently emerged as a flexible and efficient framework for generative modelling by learning deterministic transport dynamics between probability measures. In this work, we extend flow matching to the space of probability…

Machine Learning · Computer Science 2026-05-12 Moritz Piening , Richard Duong , Gabriele Steidl

Distillation with unlabeled examples is a popular and powerful method for training deep neural networks in settings where the amount of labeled data is limited: A large ''teacher'' neural network is trained on the labeled data available,…

Machine Learning · Computer Science 2022-10-14 Fotis Iliopoulos , Vasilis Kontonis , Cenk Baykal , Gaurav Menghani , Khoa Trinh , Erik Vee

The data distribution commonly evolves over time leading to problems such as concept drift that often decrease classifier performance. Current techniques are not adequate for this problem because they either require detailed knowledge of…

Machine Learning · Computer Science 2022-06-13 Johannes Schneider

Flow-based generative models are composed of invertible transformations between two random variables of the same dimension. Therefore, flow-based models cannot be adequately trained if the dimension of the data distribution does not match…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Hyeongju Kim , Hyeonseung Lee , Woo Hyun Kang , Joun Yeop Lee , Nam Soo Kim

Normalizing Flows are a promising new class of algorithms for unsupervised learning based on maximum likelihood optimization with change of variables. They offer to learn a factorized component representation for complex nonlinear data and,…

Machine Learning · Computer Science 2020-02-17 Reuben Feinman , Nikhil Parthasarathy

Generalizing knowledge to unseen domains, where data and labels are unavailable, is crucial for machine learning models. We tackle the domain generalization problem to learn from multiple source domains and generalize to a target domain…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Fan Zhou , Zhuqing Jiang , Changjian Shui , Boyu Wang , Brahim Chaib-draa

Normalizing flows transform a latent distribution through an invertible neural network for a flexible and pleasingly simple approach to generative modelling, while preserving an exact likelihood. We propose FlowGMM, an end-to-end approach…

Machine Learning · Computer Science 2020-01-01 Pavel Izmailov , Polina Kirichenko , Marc Finzi , Andrew Gordon Wilson

Dataset distillation, a training-aware data compression technique, has recently attracted increasing attention as an effective tool for mitigating costs of optimization and data storage. However, progress remains largely empirical.…

Machine Learning · Computer Science 2026-03-31 Yuri Kinoshita , Naoki Nishikawa , Taro Toyoizumi

The performance of machine learning models relies heavily on the quality of input data, yet real-world applications often face significant data-related challenges. A common issue arises when curating training data or deploying models: two…

Machine Learning · Computer Science 2025-09-24 Varun Babbar , Zhicheng Guo , Cynthia Rudin

Recognising and reacting to change in non-stationary data-streams is a challenging task. The majority of research in this area assumes that the true class label of incoming points are available, either at each time step or intermittently…

Neural and Evolutionary Computing · Computer Science 2023-12-27 Conor Fahy , Shengxiang Yang

The problem of modeling the relationship between univariate distributions and one or more explanatory variables has found increasing interest. Traditional functional data methods cannot be applied directly to distributional data because of…

Methodology · Statistics 2025-02-04 Yidong Zhou , Hans-Georg Müller

Many machine learning problems can be expressed as the optimization of some cost functional over a parametric family of probability distributions. It is often beneficial to solve such optimization problems using natural gradient methods.…

Machine Learning · Statistics 2020-02-14 Michael Arbel , Arthur Gretton , Wuchen Li , Guido Montufar