English
Related papers

Related papers: Euphonium: Steering Video Flow Matching via Proces…

200 papers

Flow matching (FM) learns vector fields by regressing stochastic velocity targets along intermediate distributions $p_t$. We identify a geometric optimization bottleneck in this regression problem: when the covariance $\Sigma_t$ of $p_t$ is…

Machine Learning · Computer Science 2026-05-14 Shadab Ahamed , Eshed Gal , Md Shahriar Rahim Siddiqui , Simon Ghyselincks , Moshe Eliasof , Eldad Haber

Recent advances in text-to-image synthesis largely benefit from sophisticated sampling strategies and classifier-free guidance (CFG) to ensure high-quality generation. However, CFG's reliance on two forward passes, especially when combined…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Minghao Fu , Guo-Hua Wang , Xiaohao Chen , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang

Recent advances in denoising diffusion models have enabled rapid generation of optimized structures for topology optimization. However, these models often rely on surrogate predictors to enforce physical constraints, which may fail to…

Machine Learning · Computer Science 2025-08-05 Euihyun Kim , Keun Park , Yeoneung Kim

Diffusion models have revolutionized generative modeling in continuous domains like image, audio, and video synthesis. However, their iterative sampling process leads to slow generation and inefficient training, challenges that are further…

Machine Learning · Computer Science 2025-03-11 Shivanshu Shekhar , Tong Zhang

Flow matching as a paradigm of generative model achieves notable success across various domains. However, existing methods use either multi-round training or knowledge within minibatches, posing challenges in finding a favorable coupling…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Siyu Xing , Jie Cao , Huaibo Huang , Haichao Shi , Xiao-Yu Zhang

The key to video inpainting is to use correlation information from as many reference frames as possible. Existing flow-based propagation methods split the video synthesis process into multiple steps: flow completion -> pixel propagation ->…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jaeyeon Kang , Seoung Wug Oh , Seon Joo Kim

We propose a gradient preconditioning method that makes reward-guided generation with one-step generative models both efficient and reliable. Test-time noise optimization can unlock substantially better reward-guided generations from…

Machine Learning · Computer Science 2026-05-29 Jisung Hwang , Minhyuk Sung

Generative models for sequential data often struggle with sparsely sampled and high-dimensional trajectories, typically reducing the learning of dynamics to pairwise transitions. We propose Interpolative Multi-Marginal Flow Matching…

Accurate emulation of multi-scale physical systems governed by PDEs demands models that remain stable over long autoregressive rollouts while preserving fine-scale structures. Deterministic emulators produce overly-smoothed predictions,…

Flow Matching (FM) is a simulation-free method for learning a continuous and invertible flow to interpolate between two distributions, and in particular to generate data from noise. Inspired by the variational nature of the diffusion…

Machine Learning · Statistics 2025-07-14 Chen Xu , Xiuyuan Cheng , Yao Xie

Physics-constrained generative modeling aims to produce high-dimensional samples that are both physically consistent and distributionally accurate, a task that remains challenging due to often conflicting optimization objectives. Recent…

Machine Learning · Computer Science 2026-02-24 Giacomo Baldan , Qiang Liu , Alberto Guardone , Nils Thuerey

Simulating trajectories of dynamical systems is a fundamental problem in a wide range of fields such as molecular dynamics, biochemistry, and pedestrian dynamics. Machine learning has become an invaluable tool for scaling physics-based…

Machine Learning · Computer Science 2026-05-28 Kiet Bennema ten Brinke , Koen Minartz , Vlado Menkovski

Data heterogeneity hinders clinical deployment of medical image analysis models, and generative data augmentation helps mitigate this issue. However, recent diffusion-based methods that synthesize image-mask pairs often ignore distribution…

Image and Video Processing · Electrical Eng. & Systems 2026-04-06 Jie Yang , Ziqi Ye , Aihua Ke , Jian Luo , Bo Cai , Xiaosong Wang

This paper introduces a new stochastic optimization method based on the regularized Fisher information matrix (FIM), named SOFIM, which can efficiently utilize the FIM to approximate the Hessian matrix for finding Newton's gradient update…

Machine Learning · Computer Science 2024-05-02 Mrinmay Sen , A. K. Qin , Gayathri C , Raghu Kishore N , Yen-Wei Chen , Balasubramanian Raman

We present Flowception, a novel non-autoregressive and variable-length video generation framework. Flowception learns a probability path that interleaves discrete frame insertions with continuous frame denoising. Compared to autoregressive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Tariq Berrada Ifriqi , John Nguyen , Karteek Alahari , Jakob Verbeek , Ricky T. Q. Chen

Taming the generation outcome of state of the art Diffusion and Flow-Matching (FM) models without having to re-train a task-specific model unlocks a powerful tool for solving inverse problems, conditional generation, and controlled…

Machine Learning · Computer Science 2024-07-23 Heli Ben-Hamu , Omri Puny , Itai Gat , Brian Karrer , Uriel Singer , Yaron Lipman

We present GFlowState, a visual analytics system designed to illuminate the training process of Generative Flow Networks (GFlowNets or GFNs). GFlowNets are a probabilistic framework for generating samples proportionally to a reward…

Machine Learning · Computer Science 2026-04-24 Florian Holeczek , Andreas Hinterreiter , Alex Hernandez-Garcia , Marc Streit , Christina Humer

Diffusion- and flow-based models have emerged as state-of-the-art generative modeling approaches, but they require many sampling steps. Consistency models can distill these models into efficient one-step generators; however, unlike flow-…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis

Classifier-free guidance is a key component for enhancing the performance of conditional generative models across diverse tasks. While it has previously demonstrated remarkable improvements for the sample quality, it has only been…

Machine Learning · Computer Science 2023-12-11 Qinqing Zheng , Matt Le , Neta Shaul , Yaron Lipman , Aditya Grover , Ricky T. Q. Chen

Deep generative models have recently been applied to physical systems governed by partial differential equations (PDEs), offering scalable simulation and uncertainty-aware inference. However, enforcing physical constraints, such as…

Machine Learning · Computer Science 2025-11-27 Utkarsh Utkarsh , Pengfei Cai , Alan Edelman , Rafael Gomez-Bombarelli , Christopher Vincent Rackauckas