English
Related papers

Related papers: All-atom Diffusion Transformers: Unified generativ…

200 papers

Diffusion Models have become a cornerstone of modern generative AI for their exceptional generation quality and controllability. However, their inherent \textit{multi-step iterations} and \textit{complex backbone networks} lead to…

Several recent studies have attempted to autoregressively generate continuous speech representations without discrete speech tokens by combining diffusion and autoregressive models, yet they often face challenges with excessive…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-09 Dongya Jia , Zhuo Chen , Jiawei Chen , Chenpeng Du , Jian Wu , Jian Cong , Xiaobin Zhuang , Chumin Li , Zhen Wei , Yuping Wang , Yuxuan Wang

We empirically study the scaling properties of various Diffusion Transformers (DiTs) for text-to-image generation by performing extensive and rigorous ablations, including training scaled DiTs ranging from 0.3B upto 8B parameters on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Hao Li , Shamit Lal , Zhiheng Li , Yusheng Xie , Ying Wang , Yang Zou , Orchid Majumder , R. Manmatha , Zhuowen Tu , Stefano Ermon , Stefano Soatto , Ashwin Swaminathan

Diffusion models have become the dominant approach for visual generation. They are trained by denoising a Markovian process which gradually adds noise to the input. We argue that the Markovian property limits the model's ability to fully…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Jiatao Gu , Yuyang Wang , Yizhe Zhang , Qihang Zhang , Dinghuai Zhang , Navdeep Jaitly , Josh Susskind , Shuangfei Zhai

Recent breakthroughs in Diffusion Transformers (DiTs) have revolutionized the field of visual synthesis due to their superior scalability. To facilitate DiTs' capability of capturing meaningful internal representations, recent works such as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Mengping Yang , Zhiyu Tan , Binglei Li , Xiaomeng Yang , Hesen Chen , Hao Li

Diffusion-based models have shown great promise in molecular generation but often require a large number of sampling steps to generate valid samples. In this paper, we introduce a novel Straight-Line Diffusion Model (SLDM) to tackle this…

Machine Learning · Computer Science 2025-06-10 Yuyan Ni , Shikun Feng , Haohan Chi , Bowen Zheng , Huan-ang Gao , Wei-Ying Ma , Zhi-Ming Ma , Yanyan Lan

Diffusion Probabilistic Models (DPMs) have emerged as a powerful class of deep generative models, achieving remarkable performance in image synthesis tasks. However, these models face challenges in terms of widespread adoption due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Kidist Amde Mekonnen , Nicola Dall'Asen , Paolo Rota

Due to the ease of training, ability to scale, and high sample quality, diffusion models (DMs) have become the preferred option for generative modeling, with numerous pre-trained models available for a wide variety of datasets. Containing…

Machine Learning · Computer Science 2024-01-17 Weijian Luo , Tianyang Hu , Shifeng Zhang , Jiacheng Sun , Zhenguo Li , Zhihua Zhang

Generative AI is a fast-growing area of research offering various avenues for exploration in high-energy nuclear physics. In this work, we explore the use of generative models for simulating electron-proton collisions relevant to…

High Energy Physics - Phenomenology · Physics 2024-08-14 Peter Devlin , Jian-Wei Qiu , Felix Ringer , Nobuo Sato

Equivariant diffusion models have achieved impressive performance in 3D molecule generation. These models incorporate Euclidean symmetries of 3D molecules by utilizing an SE(3)-equivariant denoising network. However, specialized equivariant…

Machine Learning · Computer Science 2025-07-01 Yuhui Ding , Thomas Hofmann

Diffusion and flow matching models have significantly advanced media generation, yet their design space is well-explored, somewhat limiting further improvements. Concurrently, autoregressive (AR) models, particularly those generating…

Machine Learning · Computer Science 2025-07-01 Neta Shaul , Uriel Singer , Itai Gat , Yaron Lipman

Diffusion transformers (DiTs) combine transformer architectures with diffusion models. However, their computational complexity imposes significant limitations on real-time applications and sustainability of AI systems. In this study, we aim…

Machine Learning · Computer Science 2025-02-07 Younghye Hwang , Hyojin Lee , Joonhyuk Kang

This paper explores the challenges and benefits of a trainable destruction process in diffusion samplers -- diffusion-based generative models trained to sample an unnormalised density without access to data samples. Contrary to the majority…

In e-commerce and digital marketing, generating high-fidelity human-product demonstration videos is important for effective product presentation. However, most existing frameworks either fail to preserve the identities of both humans and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Lizhen Wang , Zhurong Xia , Tianshu Hu , Pengrui Wang , Pengfei Wei , Zerong Zheng , Ming Zhou , Yuan Zhang , Mingyuan Gao

Effectively addressing the challenge of industrial Anomaly Detection (AD) necessitates an ample supply of defective samples, a constraint often hindered by their scarcity in industrial contexts. This paper introduces a novel algorithm…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Hanxi Li , Zhengxun Zhang , Hao Chen , Lin Wu , Bo Li , Deyin Liu , Mingwen Wang

Recent advancements in the field of Diffusion Transformers have substantially improved the generation of high-quality 2D images, 3D videos, and 3D shapes. However, the effectiveness of the Transformer architecture in the domain of co-speech…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Xiaofeng Mao , Zhengkai Jiang , Qilin Wang , Chencan Fu , Jiangning Zhang , Jiafu Wu , Yabiao Wang , Chengjie Wang , Wei Li , Mingmin Chi

Diffusion Transformer (DiT), a promising diffusion model for visual generation, demonstrates impressive performance but incurs significant computational overhead. Intriguingly, analysis of pre-trained DiT models reveals that global…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yuang Ai , Qihang Fan , Xuefeng Hu , Zhenheng Yang , Ran He , Huaibo Huang

Standard Latent Diffusion Models rely on a complex, three-part architecture consisting of a separate encoder, decoder, and diffusion network, which are trained in multiple stages. This modular design is computationally inefficient, leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xiyuan Wang , Muhan Zhang

Recent advances in generative modeling, namely Diffusion models, have revolutionized generative modeling, enabling high-quality image generation tailored to user needs. This paper proposes a framework for the generative design of structural…

Tabular data generation has recently attracted a growing interest due to its different application scenarios. However, generating time series of tabular data, where each element of the series depends on the others, remains a largely…

Machine Learning · Computer Science 2025-04-21 Fabrizio Garuti , Enver Sangineto , Simone Luetto , Lorenzo Forni , Rita Cucchiara
‹ Prev 1 8 9 10 Next ›