English
Related papers

Related papers: Efficient Flow Matching using Latent Variables

200 papers

Latent Diffusion models (LDMs) have achieved remarkable results in synthesizing high-resolution images. However, the iterative sampling process is computationally intensive and leads to slow generation. Inspired by Consistency Models (song…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Simian Luo , Yiqin Tan , Longbo Huang , Jian Li , Hang Zhao

Enhancing the efficiency of high-quality image generation using Diffusion Models (DMs) is a significant challenge due to the iterative nature of the process. Flow Matching (FM) is emerging as a powerful generative modeling paradigm based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Pascal Zwick , Nils Friederich , Maximilian Beichter , Lennart Hilbert , Ralf Mikut , Oliver Bringmann

Conditional image-to-video (cI2V) generation aims to synthesize a new plausible video starting from an image (e.g., a person's face) and a condition (e.g., an action class label like smile). The key challenge of the cI2V task lies in the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Haomiao Ni , Changhao Shi , Kai Li , Sharon X. Huang , Martin Renqiang Min

Generative models have shown robust performance on speech enhancement and restoration tasks, but most prior approaches operate offline with high latency, making them unsuitable for streaming applications. In this work, we investigate the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-21 Tsun-An Hsieh , Sebastian Braun

The goal of this paper is to provide a new perspective on speech modeling by incorporating perceptual invariances such as amplitude scaling and temporal shifts. Conventional generative formulations often treat each dataset sample as a fixed…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-24 Doyeop Kwak , Youngjoon Jang , Joon Son Chung

We introduce a novel generative model for video prediction based on latent flow matching, an efficient alternative to diffusion-based models. In contrast to prior work, we keep the high costs of modeling the past during training and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Aram Davtyan , Sepehr Sameni , Paolo Favaro

Flow-based generative models have highly desirable properties like exact log-likelihood evaluation and exact latent-variable inference, however they are still in their infancy and have not received as much attention as alternative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Albert Pumarola , Stefan Popov , Francesc Moreno-Noguer , Vittorio Ferrari

Recently, Flow Matching models have pushed the boundaries of high-fidelity data generation across a wide range of domains. It typically employs a single large network to learn the entire generative trajectory from noise to data. Despite…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Dogyun Park , Taehoon Lee , Minseok Joo , Hyunwoo J. Kim

This study presents a novel generative modeling approach to rainfall-runoff modeling, focusing on the synthesis of realistic daily catchment runoff time series in response to catchment-averaged climate forcing. Unlike traditional…

Geophysics · Physics 2024-09-11 Yang Yang , Ting Fong May Chui

Accurate emulation of multi-scale physical systems governed by PDEs demands models that remain stable over long autoregressive rollouts while preserving fine-scale structures. Deterministic emulators produce overly-smoothed predictions,…

Deep generative models have recently been applied to physical systems governed by partial differential equations (PDEs), offering scalable simulation and uncertainty-aware inference. However, enforcing physical constraints, such as…

Machine Learning · Computer Science 2025-11-27 Utkarsh Utkarsh , Pengfei Cai , Alan Edelman , Rafael Gomez-Bombarelli , Christopher Vincent Rackauckas

Deep generative models provide state-of-the-art performance across a wide array of applications, with recent studies showing increasing applicability for science and engineering. Despite a growing corpus of literature focused on the…

Machine Learning · Computer Science 2026-05-14 Jacob K. Christopher , James E. Warner , Ferdinando Fioretto

Current auto-regressive (AR) LLMs, diffusion-based text/image generative models, and recent flow matching (FM) algorithms are capable of generating premium quality text/image samples. However, the inference or sample generation in these…

Machine Learning · Computer Science 2026-03-23 Minyoung Kim

Flow matching has recently emerged as a powerful alternative to diffusion models, providing a continuous-time formulation for generative modeling and representation learning. Yet, we show that this framework suffers from a fundamental…

Machine Learning · Computer Science 2025-09-26 Weili Zeng , Yichao Yan

We provide a theoretical analysis for end-to-end training Discrete Flow Matching (DFM) generative models. DFM is a promising discrete generative modeling framework that learns the underlying generative dynamics by training a neural network…

Machine Learning · Computer Science 2025-09-29 Maojiang Su , Mingcheng Lu , Jerry Yao-Chieh Hu , Shang Wu , Zhao Song , Alex Reneau , Han Liu

Flow-based models have proven successful for time-series generation, particularly when defined in lower-dimensional latent spaces that enable efficient sampling. However, how to design latent representations with desirable equivariance…

Machine Learning · Computer Science 2026-02-02 Camilo Carvajal Reyes , Felipe Tobar

Existing generative models for time series forecasting often transform simple priors (typically Gaussian) into complex data distributions. However, their sampling initialization, independent of historical data, hinders the capture of…

Machine Learning · Computer Science 2025-08-12 Huibo Xu , Runlong Yu , Likang Wu , Xianquan Wang , Qi Liu

LiDAR-based world models offer more structured and geometry-aware representations than their image-based counterparts. However, existing LiDAR world models are narrowly trained; each model excels only in the domain for which it was built.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Tianran Liu , Shengwen Zhao , Nicholas Rhinehart

Flow matching as a paradigm of generative model achieves notable success across various domains. However, existing methods use either multi-round training or knowledge within minibatches, posing challenges in finding a favorable coupling…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Siyu Xing , Jie Cao , Huaibo Huang , Haichao Shi , Xiao-Yu Zhang

Flow matching (FM) trains a time-dependent vector field that transports samples from a simple prior to a complex data distribution. However, for high-dimensional images, each training sample supervises only a single trajectory and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 George Stoica , Sayak Paul , Matthew Wallingford , Vivek Ramanujan , Abhay Nori , Winson Han , Ali Farhadi , Ranjay Krishna , Judy Hoffman