English
Related papers

Related papers: OneFlow: Concurrent Mixed-Modal and Interleaved Ge…

200 papers

Unified models capable of interleaved generation have emerged as a promising paradigm, with the community increasingly converging on autoregressive modeling for text and flow matching for image generation. To advance this direction, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jie Liu , Zilyu Ye , Linxiao Yuan , Shenhan Zhu , Yu Gao , Jie Wu , Kunchang Li , Xionghui Wang , Xiaonan Nie , Weilin Huang , Wanli Ouyang

Text-to-video models have demonstrated impressive capabilities in producing diverse and captivating video content, showcasing a notable advancement in generative AI. However, these models generally lack fine-grained control over motion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Tuna Han Salih Meral , Hidir Yesiltepe , Connor Dunlop , Pinar Yanardag

Language models based on discrete diffusion have attracted widespread interest for their potential to provide faster generation than autoregressive models. Despite their promise, these models typically produce samples whose quality sharply…

Computation and Language · Computer Science 2026-05-21 Chanhyuk Lee , Jaehoon Yoo , Manan Agarwal , Sheel Shah , Jerry Huang , Aditi Raghunathan , Seunghoon Hong , Nicholas M. Boffi , Jinwoo Kim

The recently developed discrete diffusion models perform extraordinarily well in the text-to-image task, showing significant promise for handling the multi-modality signals. In this work, we harness these traits and present a unified…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Minghui Hu , Chuanxia Zheng , Heliang Zheng , Tat-Jen Cham , Chaoyue Wang , Zuopeng Yang , Dacheng Tao , Ponnuthurai N. Suganthan

Existing rectified flow models are based on linear trajectories between data and noise distributions. This linearity enforces zero curvature, which can inadvertently force the image generation process through low-probability regions of the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yan Luo , Drake Du , Hao Huang , Yi Fang , Mengyu Wang

Recent progress in controllable image generation and editing is largely driven by diffusion-based methods. Although diffusion models perform exceptionally well in specific tasks with tailored designs, establishing a unified model is still…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Jiteng Mu , Nuno Vasconcelos , Xiaolong Wang

Normalizing flows are a powerful class of generative models for continuous random variables, showing both strong model flexibility and the potential for non-autoregressive generation. These benefits are also desired when modeling discrete…

Machine Learning · Statistics 2019-06-06 Zachary M. Ziegler , Alexander M. Rush

3D human reaction generation faces three main challenges:(1) high motion fidelity, (2) real-time inference, and (3) autoregressive adaptability for online scenarios. Existing methods fail to meet all three simultaneously. We propose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zichen Geng , Zeeshan Hayder , Wei Liu , Hesheng Wang , Ajmal Mian

Universal style transfer retains styles from reference images in content images. While existing methods have achieved state-of-the-art style transfer performance, they are not aware of the content leak phenomenon that the image content may…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Jie An , Siyu Huang , Yibing Song , Dejing Dou , Wei Liu , Jiebo Luo

We introduce RewardFlow, an inversion-free framework that steers pretrained diffusion and flow-matching models at inference time through multi-reward Langevin dynamics. RewardFlow unifies complementary differentiable rewards for semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Onkar Susladkar , Dong-Hwan Jang , Tushar Prakash , Adheesh Juvekar , Vedant Shah , Ayush Barik , Nabeel Bashir , Muntasir Wahed , Ritish Shrirao , Ismini Lourentzou

Unified multimodal models integrating visual understanding and generation face a fundamental challenge: visual generation incurs substantially higher computational costs than understanding, particularly for video. This imbalance motivates…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Luozheng Qin , Jia Gong , Qian Qiao , Tianjiao Li , Li Xu , Haoyu Pan , Chao Qu , Zhiyu Tan , Hao Li

This work presents DCFlow, a novel unsupervised cross-modal flow estimation framework that integrates a decoupled optimization strategy and a cross-modal consistency constraint. Unlike previous approaches that implicitly learn flow…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Runmin Zhang , Jialiang Wang , Si-Yuan Cao , Zhu Yu , Junchen Yu , Guangyi Zhang , Hui-Liang Shen

Recent diffusion and flow matching models have demonstrated strong capabilities in image generation and editing by progressively removing noise through iterative sampling. While this enables flexible inversion for semantic-preserving edits,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yasong Dai , Zeeshan Hayder , David Ahmedt-Aristizabal , Hongdong Li

We introduce a one-step generative policy for offline reinforcement learning that maps noise directly to actions via a residual reformulation of MeanFlow, making it compatible with Q-learning. While one-step Gaussian policies enable fast…

Machine Learning · Computer Science 2025-11-18 Zeyuan Wang , Da Li , Yulin Chen , Ye Shi , Liang Bai , Tianyuan Yu , Yanwei Fu

Many real-world applications of flow-based generative models desire a diverse set of samples that cover multiple modes of the target distribution. However, the predominant approach for obtaining diverse sets is not sample-efficient, as it…

Machine Learning · Computer Science 2025-04-11 Mashrur M. Morshed , Vishnu Boddeti

In image restoration, single-step discriminative mappings often lack fine details via expectation learning, whereas generative paradigms suffer from inefficient multi-step sampling and noise-residual coupling. To address this dilemma, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Zihao Fan , Xin Lu , Jie Xiao , Dong Li , Jie Huang , Xueyang Fu

We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jinheng Xie , Weijia Mao , Zechen Bai , David Junhao Zhang , Weihao Wang , Kevin Qinghong Lin , Yuchao Gu , Zhijie Chen , Zhenheng Yang , Mike Zheng Shou

Most sequence-to-sequence (seq2seq) models are autoregressive; they generate each token by conditioning on previously generated tokens. In contrast, non-autoregressive seq2seq models generate all tokens in one pass, which leads to increased…

Computation and Language · Computer Science 2019-10-10 Xuezhe Ma , Chunting Zhou , Xian Li , Graham Neubig , Eduard Hovy

One-step generative modeling seeks to generate high-quality data samples in a single function evaluation, significantly improving efficiency over traditional diffusion or flow-based models. In this work, we introduce Modular MeanFlow (MMF),…

Machine Learning · Computer Science 2025-08-26 Haochen You , Baojing Liu , Hongyang He

Although diffusion models in text-to-speech have become a popular choice due to their strong generative ability, the intrinsic complexity of sampling from diffusion models harms their efficiency. Alternatively, we propose VoiceFlow, an…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-04 Yiwei Guo , Chenpeng Du , Ziyang Ma , Xie Chen , Kai Yu