English
Related papers

Related papers: Lumina-DiMOO: An Omni Diffusion Large Language Mod…

200 papers

While recent multimodal large language models (MLLMs) have made impressive strides, they predominantly employ a conventional autoregressive architecture as their backbone, leaving significant room to explore effective and efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Lijiang Li , Zuwei Long , Yunhang Shen , Heting Gao , Haoyu Cao , Xing Sun , Caifeng Shan , Ran He , Chaoyou Fu

Diffusion models have gained tremendous success in text-to-image generation, yet still lag behind with visual understanding tasks, an area dominated by autoregressive vision-language models. We propose a large-scale and fully end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Zijie Li , Henry Li , Yichun Shi , Amir Barati Farimani , Yuval Kluger , Linjie Yang , Peng Wang

Prior masked modeling motion generation methods predominantly study text-to-motion. We present DiMo, a discrete diffusion-style framework, which extends masked modeling to bidirectional text--motion understanding and generation. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Ning Zhang , Zhengyu Li , Kwong Weng Loh , Mingxi Xu , Qi Wang , Zhengyu Wen , Xiaoyu He , Wei Zhao , Kehong Gong , Mingyuan Zhang

Unified multimodal models aim to integrate understanding and generation within a single framework, yet bridging the gap between discrete semantic reasoning and high-fidelity visual synthesis remains challenging. We present MammothModa2…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Tao Shen , Xin Wan , Taicai Chen , Rui Zhang , Junwen Pan , Dawei Lu , Fanding Lei , Zhilin Lu , Yunfei Yang , Chen Cheng , Qi She , Chang Liu , Zhenbang Sun

We present \textbf{LLaDA-o}, an effective and length-adaptive omni diffusion model for multimodal understanding and generation. LLaDA-o is built on a Mixture of Diffusion (MoD) framework that decouples discrete masked diffusion for text…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zebin You , Xiaolu Zhang , Jun Zhou , Chongxuan Li , Ji-Rong Wen

The recently developed discrete diffusion models perform extraordinarily well in the text-to-image task, showing significant promise for handling the multi-modality signals. In this work, we harness these traits and present a unified…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Minghui Hu , Chuanxia Zheng , Heliang Zheng , Tat-Jen Cham , Chaoyue Wang , Zuopeng Yang , Dacheng Tao , Ponnuthurai N. Suganthan

In this work, we provide a systematic survey of Discrete Diffusion Language Models (dLLMs) and Discrete Diffusion Multimodal Language Models (dMLLMs). Unlike autoregressive (AR) models, dLLMs and dMLLMs adopt a multi-token, parallel…

Machine Learning · Computer Science 2025-09-22 Runpeng Yu , Qi Li , Xinchao Wang

Recent progress in unified models for image understanding and generation has been impressive, yet most approaches remain limited to single-modal generation conditioned on multiple modalities. In this paper, we present Mogao, a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Chao Liao , Liyang Liu , Xun Wang , Zhengxiong Luo , Xinyu Zhang , Wenliang Zhao , Jie Wu , Liang Li , Zhi Tian , Weilin Huang

We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jinheng Xie , Weijia Mao , Zechen Bai , David Junhao Zhang , Weihao Wang , Kevin Qinghong Lin , Yuchao Gu , Zhijie Chen , Zhenheng Yang , Mike Zheng Shou

Diffusion models have made significant strides in language-driven and layout-driven image generation. However, most diffusion models are limited to visible RGB image generation. In fact, human perception of the world is enriched by diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Zeyu Wang , Jingyu Lin , Yifei Qian , Yi Huang , Shicen Tian , Bosong Chai , Juncan Deng , Qu Yang , Lan Du , Cunjian Chen , Kejie Huang

We propose Lavida-O, a unified Masked Diffusion Model (MDM) for multimodal understanding and generation. Unlike existing multimodal MDMs such as MMaDa and Muddit which only support simple image-level understanding tasks and low-resolution…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Shufan Li , Jiuxiang Gu , Kangning Liu , Zhe Lin , Zijun Wei , Aditya Grover , Jason Kuen

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Multimodal generative models that can understand and generate across multiple modalities are dominated by autoregressive (AR) approaches, which process tokens sequentially from left to right, or top to bottom. These models jointly handle…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Alexander Swerdlow , Mihir Prabhudesai , Siddharth Gandhi , Deepak Pathak , Katerina Fragkiadaki

Diffusion models have demonstrated remarkable success in various image generation tasks, but their performance is often limited by the uniform processing of inputs across varying conditions and noise levels. To address this limitation, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Minglei Shi , Ziyang Yuan , Haotian Yang , Xintao Wang , Mingwu Zheng , Xin Tao , Wenliang Zhao , Wenzhao Zheng , Jie Zhou , Jiwen Lu , Pengfei Wan , Di Zhang , Kun Gai

Diffusion-based generative modeling has been achieving state-of-the-art results on various generation tasks. Most diffusion models, however, are limited to a single-generation modeling. Can we generalize diffusion models with the ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Changyou Chen , Han Ding , Bunyamin Sisman , Yi Xu , Ouye Xie , Benjamin Z. Yao , Son Dinh Tran , Belinda Zeng

We present LLaDA2.0-Uni, a unified discrete diffusion large language model (dLLM) that supports multimodal understanding and generation within a natively integrated framework. Its architecture combines a fully semantic discrete tokenizer, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Inclusion AI , Tiwei Bie , Haoxing Chen , Tieyuan Chen , Zhenglin Cheng , Long Cui , Kai Gan , Zhicheng Huang , Zhenzhong Lan , Haoquan Li , Jianguo Li , Tao Lin , Qi Qin , Hongjun Wang , Xiaomei Wang , Haoyuan Wu , Yi Xin , Junbo Zhao

Unifying image understanding and generation has gained growing attention in recent research on multimodal models. Although design choices for image understanding have been extensively studied, the optimal model architecture and training…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Jiuhai Chen , Zhiyang Xu , Xichen Pan , Yushi Hu , Can Qin , Tom Goldstein , Lifu Huang , Tianyi Zhou , Saining Xie , Silvio Savarese , Le Xue , Caiming Xiong , Ran Xu

Beyond high-fidelity image synthesis, diffusion models have recently exhibited promising results in dense visual perception tasks. However, most existing work treats diffusion models as a standalone component for perception tasks, employing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shuhong Zheng , Zhipeng Bao , Ruoyu Zhao , Martial Hebert , Yu-Xiong Wang

Diffusion models arise as a powerful generative tool recently. Despite the great progress, existing diffusion models mainly focus on uni-modal control, i.e., the diffusion process is driven by only one modality of condition. To further…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziqi Huang , Kelvin C. K. Chan , Yuming Jiang , Ziwei Liu

In this paper, we present MoMA: an open-vocabulary, training-free personalized image model that boasts flexible zero-shot capabilities. As foundational text-to-image models rapidly evolve, the demand for robust image-to-image translation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Kunpeng Song , Yizhe Zhu , Bingchen Liu , Qing Yan , Ahmed Elgammal , Xiao Yang
‹ Prev 1 2 3 10 Next ›