English
Related papers

Related papers: Pyramidal Flow Matching for Efficient Video Genera…

200 papers

Current video diffusion models achieve impressive generation quality but struggle in interactive applications due to bidirectional attention dependencies. The generation of a single frame requires the model to process the entire sequence,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Tianwei Yin , Qiang Zhang , Richard Zhang , William T. Freeman , Fredo Durand , Eli Shechtman , Xun Huang

Flow Matching has limited ability in achieving one-step generation due to its reliance on learned curved trajectories. Previous studies have attempted to address this limitation by either modifying the coupling distribution to prevent…

Machine Learning · Computer Science 2025-11-25 Chenrui Ma , Xi Xiao , Tianyang Wang , Xiao Wang , Yanning Shen

Denoising-based models, including diffusion and flow matching, have led to substantial advances in graph generation. Despite this progress, such models remain constrained by two fundamental limitations: a computational cost that scales…

Machine Learning · Computer Science 2026-04-02 Yoann Boget , Pablo Strasser , Alexandros Kalousis

Multimedia generation approaches occupy a prominent place in artificial intelligence research. Text-to-image models achieved high-quality results over the last few years. However, video synthesis methods recently started to develop. This…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Vladimir Arkhipkin , Zein Shaheen , Viacheslav Vasilev , Elizaveta Dakhova , Andrey Kuznetsov , Denis Dimitrov

Video diffusion models have rapidly become the dominant paradigm for high-fidelity generative video synthesis, but their practical deployment remains constrained by severe inference costs. Compared with image generation, video synthesis…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Shitong Shao , Lichen Bai , Pengfei Wan , James Kwok , Zeke Xie

The field of generative models has recently witnessed significant progress, with diffusion models showing remarkable performance in image generation. In light of this success, there is a growing interest in exploring the application of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ariel Lapid , Idan Achituve , Lior Bracha , Ethan Fetaya

This paper considers an efficient video modeling process called Video Latent Flow Matching (VLFM). Unlike prior works, which randomly sampled latent patches for video generation, our method relies on current strong pre-trained image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yang Cao , Zhao Song , Chiwun Yang

In this paper, we focus on designing effective method for fast and accurate scene parsing. A common practice to improve the performance is to attain high resolution feature maps with strong semantic representation. Two strategies are widely…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xiangtai Li , Ansheng You , Zhen Zhu , Houlong Zhao , Maoke Yang , Kuiyuan Yang , Yunhai Tong

Finding a suitable layout represents a crucial task for diverse applications in graphic design. Motivated by simpler and smoother sampling trajectories, we explore the use of Flow Matching as an alternative to current diffusion-based layout…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Julian Jorge Andrade Guerreiro , Naoto Inoue , Kento Masui , Mayu Otani , Hideki Nakayama

Flow Matching has emerged as a powerful framework for learning continuous transformations between distributions, enabling high-fidelity generative modeling. This work introduces Symmetrical Flow Matching (SymmFlow), a new formulation that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Francisco Caetano , Christiaan Viviers , Peter H. N. De With , Fons van der Sommen

Diffusion models have revolutionized image and video generation, achieving unprecedented visual quality. However, their reliance on transformer architectures incurs prohibitively high computational costs, particularly when extending…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Justin Cui , Jie Wu , Ming Li , Tao Yang , Xiaojie Li , Rui Wang , Andrew Bai , Yuanhao Ban , Cho-Jui Hsieh

Understanding and predicting object motion from egocentric video is fundamental to embodied perception and interaction. However, generating physically consistent 6DoF trajectories remains challenging due to occlusions, fast motion, and the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Abhishek Saroha , Huajian Zeng , Xingxing Zuo , Daniel Cremers , Xi Wang

Generative models have emerged as a powerful paradigm for solving physics systems and modeling complex spatiotemporal dynamics. However, achieving high physical accuracy without incurring high computational cost remains a fundamental…

Machine Learning · Computer Science 2026-05-27 Jiahe Huang , Sihan Xu , Sharvaree Vadgama , Rose Yu

Generative models for image generation are now commonly used for a wide variety of applications, ranging from guided image generation for entertainment to solving inverse problems. Nonetheless, training a generator is a non-trivial feat…

Machine Learning · Computer Science 2025-03-07 Eldad Haber , Shadab Ahamed , Md. Shahriar Rahim Siddiqui , Niloufar Zakariaei , Moshe Eliasof

We introduce a class of causal video understanding models that aims to improve efficiency of video processing by maximising throughput, minimising latency, and reducing the number of clock cycles. Leveraging operation pipelining and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Joao Carreira , Viorica Patraucean , Laurent Mazare , Andrew Zisserman , Simon Osindero

We introduce a novel generative model for video prediction based on latent flow matching, an efficient alternative to diffusion-based models. In contrast to prior work, we keep the high costs of modeling the past during training and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Aram Davtyan , Sepehr Sameni , Paolo Favaro

Videos can be created by first outlining a global view of the scene and then adding local details. Inspired by this idea we propose a cascaded model for video generation which follows a coarse to fine approach. First our model generates a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Lluis Castrejon , Nicolas Ballas , Aaron Courville

Long video generation has gained increasing attention due to its widespread applications in fields such as entertainment and simulation. Despite advances, synthesizing temporally coherent and visually compelling long sequences remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Jiahao Chen , Hangjie Yuan , Yichen Qian , Jingyun Liang , Jiazheng Xing , Pengwei Liu , Weihua Chen , Fan Wang , Bing Su

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li

Generating geometrically consistent videos remains an open challenge: text-to-video diffusion models trained on web-scale data treat geometry only implicitly, leading to object deformation, texture drift, and non-rigid backgrounds under…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jan Ackermann , Shengqu Cai , Boyang Deng , Zhengfei Kuang , Songyou Peng , Gordon Wetzstein