English
Related papers

Related papers: PixelFlow: Pixel-Space Generative Models with Flow

200 papers

Generative models have gained popularity for their potential applications in imaging science, such as image reconstruction, posterior sampling and data sharing. Flow-based generative models are particularly attractive due to their ability…

Machine Learning · Computer Science 2023-12-14 Varun A. Kelkar , Rucha Deshpande , Arindam Banerjee , Mark A. Anastasio

Pixel diffusion generates images directly in pixel space, avoiding the VAE artifacts and representational bottlenecks of two-stage latent diffusion. Recent JiT further simplifies pixel diffusion with x-prediction, where the model predicts…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zehong Ma , Ruihan Xu , Shiliang Zhang

Video generation requires modeling a vast spatiotemporal space, which demands significant computational resources and data usage. To reduce the complexity, the prevailing approaches employ a cascaded architecture to avoid direct training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yang Jin , Zhicheng Sun , Ningyuan Li , Kun Xu , Kun Xu , Hao Jiang , Nan Zhuang , Quzhe Huang , Yang Song , Yadong Mu , Zhouchen Lin

Recent advances in generative machine learning models rekindled research interest in the area of password guessing. Data-driven password guessing approaches based on GANs, language models and deep latent variable models have shown…

Cryptography and Security · Computer Science 2021-12-15 Giulio Pagnotta , Dorjan Hitaj , Fabio De Gaspari , Luigi V. Mancini

Although many deep-learning-based super-resolution approaches have been proposed in recent years, because no ground truth is available in the inference stage, few can quantify the errors and uncertainties of the super-resolved results. For…

Image and Video Processing · Electrical Eng. & Systems 2023-08-10 Jingyi Shen , Han-Wei Shen

Generative models that can model and predict sequences of future events can, in principle, learn to capture complex real-world phenomena, such as physical interactions. However, a central challenge in video prediction is that the future is…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Manoj Kumar , Mohammad Babaeizadeh , Dumitru Erhan , Chelsea Finn , Sergey Levine , Laurent Dinh , Durk Kingma

In this paper, we present Laplacian multiscale flow matching (LapFlow), a novel framework that enhances flow matching by leveraging multi-scale representations for image generative modeling. Our approach decomposes images into Laplacian…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Zelin Zhao , Petr Molodyk , Haotian Xue , Yongxin Chen

Pixel-space generative models are often more difficult to train and generally underperform compared to their latent-space counterparts, leaving a persistent performance and efficiency gap. In this paper, we introduce a novel two-stage…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jiachen Lei , Keli Liu , Julius Berner , Haiming Yu , Hongkai Zheng , Jiahong Wu , Xiangxiang Chu

Designing photonic integrated circuits requires accurate electromagnetic field simulations, which remain computationally expensive even for simple device geometries. We present PIC-Flow, a generative neural surrogate that predicts…

Optics · Physics 2026-05-11 Joseph Quaratiello , Anthony Rizzo

In the field of video compression, the pursuit for better quality at lower bit rates remains a long-lasting goal. Recent developments have demonstrated the potential of Implicit Neural Representation (INR) as a promising alternative to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Daniel Silver , Ron Kimmel

Document understanding and GUI interaction are among the highest-value applications of Vision-Language Models (VLMs), yet they impose exceptionally heavy computational burden: fine-grained text and small UI elements demand high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Nan Wang , Zhiwei Jin , Chen Chen , Haonan Lu

Establishing visual correspondences under large intra-class variations requires analyzing images at different levels, from features linked to semantics and context to local patterns, while being invariant to instance-specific details. To…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Juhong Min , Jongmin Lee , Jean Ponce , Minsu Cho

Flow-based generative models are powerful exact likelihood models with efficient sampling and inference. Despite their computational efficiency, flow-based models generally have much worse density modeling performance compared to…

Machine Learning · Computer Science 2019-05-17 Jonathan Ho , Xi Chen , Aravind Srinivas , Yan Duan , Pieter Abbeel

Rectified flow models have become a de facto standard in image generation due to their stable sampling trajectories and high-fidelity outputs. Despite their strong generative capabilities, they face critical limitations in image editing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Sung-Hoon Yoon , Minghan Li , Gaspard Beaudouin , Congcong Wen , Muhammad Rafay Azhar , Mengyu Wang

Flow-based generative models show great potential in image synthesis due to its reversible pipeline and exact log-likelihood target, yet it suffers from weak ability for conditional image synthesis, especially for multi-label or unaware…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Rui Liu , Yu Liu , Xinyu Gong , Xiaogang Wang , Hongsheng Li

State-of-the-art scene flow algorithms pursue the conflicting targets of accuracy, run time, and robustness. With the successful concept of pixel-wise matching and sparse-to-dense interpolation, we push the limits of scene flow estimation.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 René Schuster , Oliver Wasenmüller , Christian Unger , Georg Kuschk , Didier Stricker

We introduce MusicFlow, a cascaded text-to-music generation model based on flow matching. Based on self-supervised representations to bridge between text descriptions and music audios, we construct two flow matching networks to model the…

Many real-world applications of flow-based generative models desire a diverse set of samples that cover multiple modes of the target distribution. However, the predominant approach for obtaining diverse sets is not sample-efficient, as it…

Machine Learning · Computer Science 2025-04-11 Mashrur M. Morshed , Vishnu Boddeti

We propose a principled and effective framework for one-step generative modeling. We introduce the notion of average velocity to characterize flow fields, in contrast to instantaneous velocity modeled by Flow Matching methods. A…

Machine Learning · Computer Science 2025-05-20 Zhengyang Geng , Mingyang Deng , Xingjian Bai , J. Zico Kolter , Kaiming He

Obtaining the ground truth labels from a video is challenging since the manual annotation of pixel-wise flow labels is prohibitively expensive and laborious. Besides, existing approaches try to adapt the trained model on synthetic datasets…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Yunhui Han , Kunming Luo , Ao Luo , Jiangyu Liu , Haoqiang Fan , Guiming Luo , Shuaicheng Liu