中文
相关论文

相关论文: Solving Prior Distribution Mismatch in Diffusion M…

200 篇论文

Out-of-distribution (OOD) detection is a crucial task for ensuring the reliability and safety of deep learning. Currently, discriminator models outperform other methods in this regard. However, the feature extraction process used by…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Luping Liu , Yi Ren , Xize Cheng , Rongjie Huang , Chongxuan Li , Zhou Zhao

When deploying a trained machine learning model in the real world, it is inevitable to receive inputs from out-of-distribution (OOD) sources. For instance, in continual learning settings, it is common to encounter OOD samples due to the…

机器学习 · 计算机科学 2024-01-23 Chuanwen Feng , Wenlong Chen , Ao Ke , Yilong Ren , Xike Xie , S. Kevin Zhou

Popular zero-shot models suffer due to artifacts inherited from pretraining. One particularly detrimental issue, caused by unbalanced web-scale pretraining data, is mismatched label distribution. Existing approaches that seek to repair the…

机器学习 · 计算机科学 2024-10-31 Changho Shin , Jitian Zhao , Sonia Cromp , Harit Vishwakarma , Frederic Sala

Missing data is a crucial issue when applying machine learning algorithms to real-world datasets. Starting from the simple assumption that two batches extracted randomly from the same dataset should share the same distribution, we leverage…

机器学习 · 统计学 2020-07-02 Boris Muzellec , Julie Josse , Claire Boyer , Marco Cuturi

Diffusion models (DMs) have proven to be effective in modeling high-dimensional distributions, leading to their widespread adoption for representing complex priors in Bayesian inverse problems (BIPs). However, current DM-based posterior…

机器学习 · 计算机科学 2025-06-06 Haoxuan Chen , Yinuo Ren , Martin Renqiang Min , Lexing Ying , Zachary Izzo

Mass transport problems arise in many areas of machine learning whereby one wants to compute a map transporting one distribution to another. Generative modeling techniques like Generative Adversarial Networks (GANs) and Denoising Diffusion…

机器学习 · 计算机科学 2024-09-17 Valentin De Bortoli , Iryna Korshunova , Andriy Mnih , Arnaud Doucet

Regularized discrete optimal transport (OT) is a powerful tool to measure the distance between two discrete distributions that have been constructed from data samples on two different domains. While it has a wide range of applications in…

机器学习 · 计算机科学 2023-03-15 Yasutoshi Ida , Sekitoshi Kanai , Kazuki Adachi , Atsutoshi Kumagai , Yasuhiro Fujiwara

The traffic matrix estimation (TME) problem has been widely researched for decades of years. Recent progresses in deep generative models offer new opportunities to tackle TME problems in a more advanced way. In this paper, we leverage the…

机器学习 · 计算机科学 2024-10-22 Xinyu Yuan , Yan Qiao , Pei Zhao , Rongyao Hu , Benchu Zhang

Progressively applying Gaussian noise transforms complex data distributions to approximately Gaussian. Reversing this dynamic defines a generative model. When the forward noising process is given by a Stochastic Differential Equation (SDE),…

机器学习 · 统计学 2023-04-06 Valentin De Bortoli , James Thornton , Jeremy Heng , Arnaud Doucet

Deep generative models aim to learn the underlying distribution of data and generate new ones. Despite the diversity of generative models and their high-quality generation performance in practice, most of them lack rigorous theoretical…

数值分析 · 数学 2024-03-26 Yang Jing , Lei Li

Diffusion models have become the de facto framework for generating new datasets. The core of these models lies in the ability to reverse a diffusion process in time. The goal of this manuscript is to explain, from a PDE perspective, how…

概率论 · 数学 2025-01-29 Fei Cao , Kimball Johnston , Thomas Laurent , Justin Le , Sébastien Motsch

The performance of optimization-based robot motion planning algorithms is highly dependent on the initial solutions, commonly obtained by running a sampling-based planner to obtain a collision-free path. However, these methods can be slow…

机器人学 · 计算机科学 2025-08-15 J. Carvalho , A. Le , P. Kicki , D. Koert , J. Peters

Detecting Out-of-Distribution (OOD) inputs is crucial for improving the reliability of deep neural networks in the real-world deployment. In this paper, inspired by the inherent distribution shift between ID and OOD data, we propose a novel…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Ao Ke , Wenlong Chen , Chuanwen Feng , Yukun Cao , Xike Xie , S. Kevin Zhou , Lei Feng

In this work, we propose a novel machine learning approach to compute the optimal transport map between two continuous distributions from their unpaired samples, based on the DeepParticle methods. The proposed method leads to a min-min…

机器学习 · 统计学 2025-07-01 Yingyuan Li , Aokun Wang , Zhongjian Wang

Distributed distribution comparison aims to measure the distance between the distributions whose data are scattered across different agents in a distributed system and cannot even be shared directly among the agents. In this study, we…

机器学习 · 计算机科学 2024-07-23 Xiangfeng Wang , Hongteng Xu , Moyi Yang

Given samples from two joint distributions, we consider the problem of Optimal Transportation (OT) between them when conditioned on a common variable. We focus on the general setting where the conditioned variable may be continuous, and the…

机器学习 · 计算机科学 2024-06-12 Piyushi Manupriya , Rachit Keerti Das , Sayantan Biswas , Saketha Nath Jagarlapudi

We develop an Optimal Transportation Meshfree (OTM) particle method for advection-diffusion in which the concentration or density of the diffusive species is approximated by Dirac measures. We resort to an incremental variational principle…

数值分析 · 数学 2017-03-08 Livio Fedeli , Anna Pandolfi , Michael Ortiz

We develop a fast and reliable method for solving large-scale optimal transport (OT) problems at an unprecedented combination of speed and accuracy. Built on the celebrated Douglas-Rachford splitting technique, our method tackles the…

最优化与控制 · 数学 2021-10-25 Vien V. Mai , Jacob Lindbäck , Mikael Johansson

Optimal Transport (OT) distances are now routinely used as loss functions in ML tasks. Yet, computing OT distances between arbitrary (i.e. not necessarily discrete) probability distributions remains an open problem. This paper introduces a…

最优化与控制 · 数学 2020-07-03 Arthur Mensch , Gabriel Peyré

This paper addresses the spatiotemporal mismatch in multi-agent distribution tracking within time-varying environments. While recent advancements in Density-Driven Optimal Control (D$^2$OC) have enabled finite-time distribution matching…

系统与控制 · 电气工程与系统科学 2026-04-03 Julian Martinez , Kooktae Lee