English
Related papers

Related papers: Goku: Flow Based Video Generative Foundation Model…

200 papers

Normalizing flows are a class of probabilistic generative models which allow for both fast density computation and efficient sampling and are effective at modelling complex distributions like images. A drawback among current methods is…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Jason J. Yu , Konstantinos G. Derpanis , Marcus A. Brubaker

Flow-based generative models (Dinh et al., 2014) are conceptually attractive due to tractability of the exact log-likelihood, tractability of exact latent-variable inference, and parallelizability of both training and synthesis. In this…

Machine Learning · Statistics 2018-07-11 Diederik P. Kingma , Prafulla Dhariwal

Diffusion models have achieved remarkable success in video generation; however, the high computational cost of the denoising process remains a major bottleneck. Existing approaches have shown promise in reducing the number of diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xiao Liang , Yunzhu Zhang , Linchao Zhu

The multi-step denoising process in diffusion and Flow Matching models causes major efficiency issues, which motivates research on few-step generation. We present Solution Flow Models (SoFlow), a framework for one-step generation from…

Machine Learning · Computer Science 2026-03-03 Tianze Luo , Haotian Yuan , Zhuang Liu

The generative AI revolution has recently expanded to videos. Nevertheless, current state-of-the-art video models are still lagging behind image models in terms of visual quality and user control over the generated content. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Michal Geyer , Omer Bar-Tal , Shai Bagon , Tali Dekel

The foundation models have recently shown excellent performance on a variety of downstream tasks in computer vision. However, most existing vision foundation models simply focus on image-level pretraining and adpation, which are limited for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Yi Wang , Kunchang Li , Yizhuo Li , Yinan He , Bingkun Huang , Zhiyu Zhao , Hongjie Zhang , Jilan Xu , Yi Liu , Zun Wang , Sen Xing , Guo Chen , Junting Pan , Jiashuo Yu , Yali Wang , Limin Wang , Yu Qiao

New technologies such as Rectified Flow and Flow Matching have significantly improved the performance of generative models in the past two years, especially in terms of control accuracy, generation quality, and generation efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Sen Fang , Hongbin Zhong , Yalin Feng , Yanxin Zhang , Dimitris N. Metaxas

Flow-based generative models, conceptually attractive due to tractability of both the exact log-likelihood computation and latent-variable inference, and efficiency of both training and sampling, has led to a number of impressive empirical…

Machine Learning · Computer Science 2019-10-29 Xuezhe Ma , Xiang Kong , Shanghang Zhang , Eduard Hovy

Flow Matching has emerged as a powerful framework for learning continuous transformations between distributions, enabling high-fidelity generative modeling. This work introduces Symmetrical Flow Matching (SymmFlow), a new formulation that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Francisco Caetano , Christiaan Viviers , Peter H. N. De With , Fons van der Sommen

Image generation has advanced rapidly over the past decade, yet the literature seems fragmented across different models and application domains. This paper aims to offer a comprehensive survey of breakthrough image generation models,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Rouzbeh Shirvani

In this paper, we design and train a Generative Image-to-text Transformer, GIT, to unify vision-language tasks such as image/video captioning and question answering. While generative models provide a consistent network architecture between…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Jianfeng Wang , Zhengyuan Yang , Xiaowei Hu , Linjie Li , Kevin Lin , Zhe Gan , Zicheng Liu , Ce Liu , Lijuan Wang

This paper presents a novel method for building scalable 3D generative models utilizing pre-trained video diffusion models. The primary obstacle in developing foundation 3D generative models is the limited availability of 3D data. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Junlin Han , Filippos Kokkinos , Philip Torr

VILA-U is a Unified foundation model that integrates Video, Image, Language understanding and generation. Traditional visual language models (VLMs) use separate modules for understanding and generating visual content, which can lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Yecheng Wu , Zhuoyang Zhang , Junyu Chen , Haotian Tang , Dacheng Li , Yunhao Fang , Ligeng Zhu , Enze Xie , Hongxu Yin , Li Yi , Song Han , Yao Lu

We propose a principled and effective framework for one-step generative modeling. We introduce the notion of average velocity to characterize flow fields, in contrast to instantaneous velocity modeled by Flow Matching methods. A…

Machine Learning · Computer Science 2025-05-20 Zhengyang Geng , Mingyang Deng , Xingjian Bai , J. Zico Kolter , Kaiming He

Building on the success of diffusion models in visual generation, flow-based models reemerge as another prominent family of generative models that have achieved competitive or better performance in terms of both visual quality and inference…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Wenliang Zhao , Minglei Shi , Xumin Yu , Jie Zhou , Jiwen Lu

Recent studies suggest utilizing generative models instead of traditional auto-regressive algorithms for time series forecasting (TSF) tasks. These non-auto-regressive approaches involving different generative methods, including GAN,…

Machine Learning · Computer Science 2025-03-19 Jiangxuan Long , Zhao Song , Chiwun Yang

Diffusion models create data from noise by inverting the forward paths of data towards noise and have emerged as a powerful generative modeling technique for high-dimensional, perceptual data such as images and videos. Rectified flow is a…

With the prosper of video diffusion models, down-stream applications like video editing have been significantly promoted without consuming much computational cost. One particular challenge in this task lies at the motion transfer process…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Ge Wang , Songlin Fan , Hangxu Liu , Quanjian Song , Hewei Wang , Jinfeng Xu

Notable breakthroughs in diffusion modeling have propelled rapid improvements in video generation, yet current foundational model still face critical challenges in simultaneously balancing prompt following, motion plausibility, and visual…

Engineering complex systems (aircraft, buildings, vehicles) requires coordinating geometric and performance couplings across subsystems. As generative models proliferate for specialized domains, a key research gap is how to coordinate…

Computational Engineering, Finance, and Science · Computer Science 2026-04-08 Tim Aebersold , Soheyl Massoudi , Mark D. Fuge