English
Related papers

Related papers: OneFlow: Concurrent Mixed-Modal and Interleaved Ge…

200 papers

MeanFlow (MF) has recently been established as a framework for one-step generative modeling. However, its ``fastforward'' nature introduces key challenges in both the training objective and the guidance mechanism. First, the original MF's…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhengyang Geng , Yiyang Lu , Zongze Wu , Eli Shechtman , J. Zico Kolter , Kaiming He

This paper presents improved native unified multimodal models, \emph{i.e.,} Show-o2, that leverage autoregressive modeling and flow matching. Built upon a 3D causal variational autoencoder space, unified visual representations are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Jinheng Xie , Zhenheng Yang , Mike Zheng Shou

Unified multimodal generative models aim to integrate image understanding and generation abilities, offering significant advantages in harnessing multimodal corpora, particularly interleaved text-image data. However, existing unified models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Hong Zhang , Zhongjie Duan , Xingjun Wang , Yuze Zhao , Weiyi Lu , Zhipeng Di , Yixuan Xu , Yingda Chen , Yu Zhang

Generating realistic, context-aware two-person motion conditioned on diverse modalities remains a fundamental challenge for graphics, animation and embodied AI systems. Real-world applications such as VR/AR companions, social robotics and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Prerit Gupta , Shourya Verma , Ananth Grama , Aniket Bera

Modern text-to-image diffusion models encode rich visual priors, but expose them only through one-way text-conditioned generation. Existing unified vision--language models derived from them recover bidirectional capability through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Eric Tillmann Bill , Enis Simsar , Alessio Tonioni , Thomas Hofmann

Strong semantic representations improve the convergence and generation quality of diffusion and flow models. Existing approaches largely rely on external models, which require separate training, operate on misaligned objectives, and exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hila Chefer , Patrick Esser , Dominik Lorenz , Dustin Podell , Vikash Raja , Vinh Tong , Antonio Torralba , Robin Rombach

This paper presents DetailFlow, a coarse-to-fine 1D autoregressive (AR) image generation method that models images through a novel next-detail prediction strategy. By learning a resolution-aware token sequence supervised with progressively…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yiheng Liu , Liao Qu , Huichao Zhang , Xu Wang , Yi Jiang , Yiming Gao , Hu Ye , Xian Li , Shuai Wang , Daniel K. Du , Fangmin Chen , Zehuan Yuan , Xinglong Wu

Text-driven motion editing and intra-structural retargeting, where source and target share topology but may differ in bone lengths, are traditionally handled by fragmented pipelines with incompatible inputs and representations: editing…

Graphics · Computer Science 2026-04-16 Junlin Li , Xinhao Song , Siqi Wang , Haibin Huang , Yili Zhao

Recent advances in large multi-modal generative models have demonstrated impressive capabilities in multi-modal generation, including image and video generation. These models are typically built upon multi-step frameworks like diffusion and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Zhenglin Cheng , Peng Sun , Jianguo Li , Tao Lin

We present TokenFlow, a novel unified image tokenizer that bridges the long-standing gap between multimodal understanding and generation. Prior research attempt to employ a single reconstruction-targeted Vector Quantization (VQ) encoder for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Liao Qu , Huichao Zhang , Yiheng Liu , Xu Wang , Yi Jiang , Yiming Gao , Hu Ye , Daniel K. Du , Zehuan Yuan , Xinglong Wu

We introduce OneDiffusion, a versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. It enables conditional generation from inputs such as text, depth, pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Duong H. Le , Tuan Pham , Sangho Lee , Christopher Clark , Aniruddha Kembhavi , Stephan Mandt , Ranjay Krishna , Jiasen Lu

Continuous diffusion has been the foundation of high-fidelity, controllable, and few-step generation of many data modalities such as images. However, in language modeling, prior continuous diffusion language models (DLMs) lag behind…

Computation and Language · Computer Science 2026-04-16 Yuxin Chen , Chumeng Liang , Hangke Sui , Ruihan Guo , Chaoran Cheng , Jiaxuan You , Ge Liu

Flow-based generative models (Dinh et al., 2014) are conceptually attractive due to tractability of the exact log-likelihood, tractability of exact latent-variable inference, and parallelizability of both training and synthesis. In this…

Machine Learning · Statistics 2018-07-11 Diederik P. Kingma , Prafulla Dhariwal

Flow-based generative models are a family of exact log-likelihood models with tractable sampling and latent-variable inference, hence conceptually attractive for modeling complex distributions. However, flow-based models are limited by…

Machine Learning · Computer Science 2019-05-09 Huadong Liao , Jiawei He , Kunxian Shu

Finding a suitable layout represents a crucial task for diverse applications in graphic design. Motivated by simpler and smoother sampling trajectories, we explore the use of Flow Matching as an alternative to current diffusion-based layout…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Julian Jorge Andrade Guerreiro , Naoto Inoue , Kento Masui , Mayu Otani , Hideki Nakayama

Flow-based generative models have highly desirable properties like exact log-likelihood evaluation and exact latent-variable inference, however they are still in their infancy and have not received as much attention as alternative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Albert Pumarola , Stefan Popov , Francesc Moreno-Noguer , Vittorio Ferrari

Few-step generation has been a long-standing goal, with recent one-step generation methods exemplified by MeanFlow achieving remarkable results. Existing research on MeanFlow primarily focuses on class-to-image generation. However, an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chenxi Zhao , Chen Zhu , Xiaokun Feng , Aiming Hao , Jiashu Zhu , Jiachen Lei , Jiahong Wu , Xiangxiang Chu , Jufeng Yang

Recent progress in unified models for image understanding and generation has been impressive, yet most approaches remain limited to single-modal generation conditioned on multiple modalities. In this paper, we present Mogao, a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Chao Liao , Liyang Liu , Xun Wang , Zhengxiong Luo , Xinyu Zhang , Wenliang Zhao , Jie Wu , Liang Li , Zhi Tian , Weilin Huang

Generative modeling has recently achieved remarkable success across image, video, and audio domains, demonstrating powerful capabilities for unified representation learning. Yet speech front-end tasks such as speech enhancement (SE), target…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Ziqian Wang , Zikai Liu , Yike Zhu , Xingchen Li , Boyi Kang , Jixun Yao , Xianjun Xia , Chuanzeng Huang , Lei Xie

Recent advances in multimodal foundation models unifying image understanding and generation have opened exciting avenues for tackling a wide range of vision-language tasks within a single framework. Despite progress, existing unified models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ying Shen , Zhiyang Xu , Jiuhai Chen , Shizhe Diao , Jiaxin Zhang , Yuguang Yao , Joy Rimchala , Ismini Lourentzou , Lifu Huang