English
Related papers

Related papers: All-atom Diffusion Transformers: Unified generativ…

200 papers

Molecular dynamics (MD) has long been the de facto choice for simulating complex atomistic systems from first principles. Recently deep learning models become a popular way to accelerate MD. Notwithstanding, existing models depend on…

Computational Engineering, Finance, and Science · Computer Science 2023-01-10 Fang Wu , Stan Z. Li

Diffusion and flow-based models have become the state of the art for generative AI across a wide range of data modalities, including images, videos, shapes, molecules, music, and more. This tutorial provides a self-contained introduction to…

Machine Learning · Computer Science 2026-03-19 Peter Holderrieth , Ezra Erives

Efficient exploration of the vast chemical space is a fundamental challenge in materials design and discovery, particularly for designing functional inorganic crystalline materials with targeted properties. Diffusion-based generative models…

Materials Science · Physics 2026-03-20 Sourav Mal , Nehad Ahmed , Junaid Jami , Subhankar Mishra , Prasenjit Sen

In autonomous driving, deep models have shown remarkable performance across various visual perception tasks with the demand of high-quality and huge-diversity training datasets. Such datasets are expected to cover various driving scenarios…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiahang Tu , Wei Ji , Hanbin Zhao , Chao Zhang , Roger Zimmermann , Hui Qian

Molecular generation with diffusion models has emerged as a promising direction for AI-driven drug discovery and materials science. While graph diffusion models have been widely adopted due to the discrete nature of 2D molecular graphs,…

Artificial Intelligence · Computer Science 2026-02-20 Hojung Jung , Rodrigo Hormazabal , Jaehyeong Jo , Youngrok Park , Kyunggeun Roh , Se-Young Yun , Sehui Han , Dae-Woong Jeong

The capability of generalization is a cornerstone for the success of modern learning systems. For non-Euclidean data, e.g., graphs, that particularly involves topological structures, one important aspect neglected by prior studies is how…

Machine Learning · Computer Science 2025-06-24 Qitian Wu , Chenxiao Yang , Kaipeng Zeng , Michael Bronstein

While Diffusion Transformers (DiTs) have achieved notable progress in video generation, this long-sequence generation task remains constrained by the quadratic complexity inherent to self-attention mechanisms, creating significant barriers…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yuxi Liu , Yipeng Hu , Zekun Zhang , Kunze Jiang , Kun Yuan

Path planning for a robotic system in high-dimensional cluttered environments needs to be efficient, safe, and adaptable for different environments and hardware. Conventional methods face high computation time and require extensive…

Recent advances in generative modeling have positioned diffusion models as state-of-the-art tools for sampling from complex data distributions. While these models have shown remarkable success across single-modality domains such as images…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Nimrod Berman , Omkar Joglekar , Eitan Kosman , Dotan Di Castro , Omri Azencot

Diffusion-based generative models learn to iteratively transfer unstructured noise to a complex target distribution as opposed to Generative Adversarial Networks (GANs) or the decoder of Variational Autoencoders (VAEs) which produce samples…

Machine Learning · Computer Science 2022-10-26 Sarthak Mittal , Guillaume Lajoie , Stefan Bauer , Arash Mehrjou

Generating molecular structures with desired properties is a critical task with broad applications in drug discovery and materials design. We propose 3M-Diffusion, a novel multi-modal molecular graph generation method, to generate diverse,…

Machine Learning · Computer Science 2024-10-04 Huaisheng Zhu , Teng Xiao , Vasant G Honavar

Rich data and powerful machine learning models allow us to design drugs for a specific protein target \textit{in silico}. Recently, the inclusion of 3D structures during targeted drug design shows superior performance to other target-free…

Biomolecules · Quantitative Biology 2023-03-08 Jiaqi Guan , Wesley Wei Qian , Xingang Peng , Yufeng Su , Jian Peng , Jianzhu Ma

The vast applications of deep generative models are anchored in three core capabilities -- generating new instances, reconstructing inputs, and learning compact representations -- across various data types, such as discrete text/protein…

Machine Learning · Computer Science 2024-06-06 Guangyi Liu , Yu Wang , Zeyu Feng , Qiyu Wu , Liping Tang , Yuan Gao , Zhen Li , Shuguang Cui , Julian McAuley , Zichao Yang , Eric P. Xing , Zhiting Hu

Diffusion Transformers (DiTs) excel at visual generation yet remain hampered by slow sampling. Existing training-free accelerators - step reduction, feature caching, and sparse attention - enhance inference speed but typically rely on a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Wangbo Zhao , Yizeng Han , Zhiwei Tang , Jiasheng Tang , Pengfei Zhou , Kai Wang , Bohan Zhuang , Zhangyang Wang , Fan Wang , Yang You

In the accelerating era of human-instructed visual content creation, diffusion models have demonstrated remarkable generative potential. Yet their deployment is constrained by a dual bottleneck: semantic ambiguity in diverse prompts and the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jie Qin , Jie Wu , Weifeng Chen , Yueming Lyu

Nature is infinitely resolution-free. In the context of this reality, existing diffusion models, such as Diffusion Transformers, often face challenges when processing image resolutions outside of their trained domain. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zeyu Lu , Zidong Wang , Di Huang , Chengyue Wu , Xihui Liu , Wanli Ouyang , Lei Bai

Anomaly detection (AD) plays a pivotal role across diverse domains, including cybersecurity, finance, healthcare, and industrial manufacturing, by identifying unexpected patterns that deviate from established norms in real-world data.…

Machine Learning · Computer Science 2025-06-12 Yang Liu , Jing Liu , Chengfang Li , Rui Xi , Wenchao Li , Liang Cao , Jin Wang , Laurence T. Yang , Junsong Yuan , Wei Zhou

We present Material Anything, a fully-automated, unified diffusion framework designed to generate physically-based materials for 3D objects. Unlike existing methods that rely on complex pipelines or case-specific optimizations, Material…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Xin Huang , Tengfei Wang , Ziwei Liu , Qing Wang

Pre-trained stable diffusion models (SD) have shown great advances in visual correspondence. In this paper, we investigate the capabilities of Diffusion Transformers (DiTs) for accurate dense correspondence. Distinct from SD, DiTs exhibit a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chaofan Gan , Yuanpeng Tu , Xi Chen , Tieyuan Chen , Yuxi Li , Mehrtash Harandi , Weiyao Lin

Image fusion aims to blend complementary information from multiple sensing modalities, yet existing approaches remain limited in robustness, adaptability, and controllability. Most current fusion networks are tailored to specific tasks and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jiayang Li , Chengjie Jiang , Junjun Jiang , Pengwei Liang , Jiayi Ma , Liqiang Nie