中文
相关论文

相关论文: Memory-Conditioned Flow-Matching for Stable Autore…

200 篇论文

We introduce a (de)-regularization of the Maximum Mean Discrepancy (DrMMD) and its Wasserstein gradient flow. Existing gradient flows that transport samples from source distribution to target distribution with only target samples, either…

Learning probabilistic surrogates for partial differential equations remains challenging in data-scarce regimes: neural operators require large amounts of high-fidelity data, while generative approaches typically sacrifice resolution…

统计计算 · 统计学 2025-12-18 Sahil Bhola , Karthik Duraisamy

We develop rigorous estimates and provably convergent approximations for the memory integral in the Mori-Zwanzig (MZ) formulation. The new theory is built upon rigorous mathematical foundations and is presented for both state-space and…

数值分析 · 数学 2018-10-17 Yuanran Zhu , Jason M. Dominy , Daniele Venturi

Developing reduced-order models for turbulent flows, which contain dynamics over a wide range of scales, is an extremely challenging problem. In statistical mechanics, the Mori-Zwanzig (MZ) formalism provides a mathematically formal…

流体动力学 · 物理学 2021-12-22 Yifeng Tian , Yen Ting Lin , Marian Anghel , Daniel Livescu

The success of denoising diffusion models raises important questions regarding their generalisation behaviour, particularly in high-dimensional settings. Notably, it has been shown that when training and sampling are performed perfectly,…

机器学习 · 统计学 2025-07-08 Tyler Farghly , Patrick Rebeschini , George Deligiannidis , Arnaud Doucet

Diffusion and flow matching models generate high-fidelity data by simulating paths defined by Ordinary or Stochastic Differential Equations (ODEs/SDEs), starting from a tractable prior distribution. The probability flow ODE formulation…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Liangyu Yuan , Ruoyu Wang , Tong Zhao , Dingwen Fu , Mingkun Lei , Beier Zhu , Chi Zhang

Diffusion models can learn rich representations during data generation, showing potential for Self-Supervised Learning (SSL), but they face a trade-off between generative quality and discriminative performance. Their iterative sampling also…

机器学习 · 计算机科学 2025-12-24 Kosuke Ukita , Tsuyoshi Okita

Generative modeling aims to produce new random examples from an unknown target distribution, given access to a finite collection of examples. Among the leading approaches, denoising diffusion probabilistic models (DDPMs) construct such…

机器学习 · 统计学 2025-06-12 Vahan Arsenyan , Elen Vardanyan , Arnak Dalalyan

Consistency models have been proposed for fast generative modeling, achieving results competitive with diffusion and flow models. However, these methods exhibit inherent instability and limited reproducibility when training from scratch,…

机器学习 · 计算机科学 2026-02-02 Youngjoong Kim , Duhoe Kim , Woosung Kim , Jaesik Park

We propose and analyze a conservative drifting method for one-step generative modeling. The method replaces the original displacement-based drifting velocity by a kernel density estimator (KDE)-gradient velocity, namely the difference of…

机器学习 · 统计学 2026-05-26 Krishnakumar Balasubramanian

Practically, training diffusion models typically requires explicit time conditioning to guide the network through the denoising sampling process. Especially in deterministic methods like DDIM, the absence of time conditioning leads to…

机器学习 · 计算机科学 2026-04-29 Liuzhuozheng Li , Zhiyuan Zhan , Shuhong Liu , Dengyang Jiang , Zanyi Wang , Guang Dai , Jingdong Wang , Mengmeng Wang

Generative models, particularly Diffusion Models (DM), have shown strong potential for Computed Tomography (CT) reconstruction serving as expressive priors for solving ill-posed inverse problems. However, diffusion-based reconstruction…

图像与视频处理 · 电气工程与系统科学 2026-03-03 Jiayang Shi , Lincen Yang , Zhong Li , Tristan Van Leeuwen , Daniel M. Pelt , K. Joost Batenburg

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Johannes Schusterbauer , Ming Gui , Frank Fundel , Björn Ommer

Data-driven emulation of nonlinear dynamics is challenging due to long-range skill decay that often produces physically unrealistic outputs. Recent advances in generative modeling aim to address these issues by providing uncertainty…

机器学习 · 计算机科学 2025-10-28 Juan Nathaniel , Pierre Gentine

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

Neural posterior estimation (NPE), a simulation-based computational approach for Bayesian inference, has shown great success in approximating complex posterior distributions. Existing NPE methods typically rely on normalizing flows, which…

机器学习 · 统计学 2025-03-14 Tianyu Chen , Vansh Bansal , James G. Scott

Diffusion models achieve state-of-the-art image generation but remain computationally costly due to iterative denoising. Latent-space models like Stable Diffusion reduce overhead yet lose fine detail, while retrieval-augmented methods…

机器学习 · 计算机科学 2025-12-23 Bilal Faye , Hanane Azzag , Mustapha Lebbah

We present theoretical convergence guarantees for ODE-based generative models, specifically flow matching. We use a pre-trained autoencoder network to map high-dimensional original inputs to a low-dimensional latent space, where a…

机器学习 · 统计学 2024-04-30 Yuling Jiao , Yanming Lai , Yang Wang , Bokai Yan

Humans excel at discovering regular structures from limited samples and applying inferred rules to novel settings. We investigate whether modern generative models can similarly learn underlying rules from finite samples and perform…

机器学习 · 计算机科学 2024-11-13 Binxu Wang , Jiaqi Shang , Haim Sompolinsky

Autoregressive models (ARMs) are hindered by slow sequential inference. While masked diffusion models (MDMs) offer a parallel alternative, they suffer from critical drawbacks: high computational overhead from precluding Key-Value (KV)…

计算与语言 · 计算机科学 2026-03-06 Jia-Nan Li , Jian Guan , Wei Wu , Chongxuan Li