English
Related papers

Related papers: Learning Joint 2D & 3D Diffusion Models for Comple…

200 papers

Generative models have the potential to accelerate key steps in the discovery of novel molecular therapeutics and materials. Diffusion models have recently emerged as a powerful approach, excelling at unconditional sample generation and,…

Biomolecules · Quantitative Biology 2024-07-17 Leo Klarner , Tim G. J. Rudner , Garrett M. Morris , Charlotte M. Deane , Yee Whye Teh

Diffusion Generative Models (DGM) have rapidly surfaced as emerging topics in the field of computer vision, garnering significant interest across a wide array of deep learning applications. Despite their high computational demand, these…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Denisha Thakkar , Vincent Quoc-Huy Trinh , Sonal Varma , Samira Ebrahimi Kahou , Hassan Rivaz , Mahdi S. Hosseini

Deep generative models have been applied with increasing success to the generation of two dimensional molecules as SMILES strings and molecular graphs. In this work we describe for the first time a deep generative model that can generate 3D…

Chemical Physics · Physics 2020-11-24 Tomohide Masuda , Matthew Ragoza , David Ryan Koes

Text-to-3D generation has shown rapid progress in recent days with the advent of score distillation, a methodology of using pretrained text-to-2D diffusion models to optimize neural radiance field (NeRF) in the zero-shot setting. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Junyoung Seo , Wooseok Jang , Min-Seop Kwak , Hyeonsu Kim , Jaehoon Ko , Junho Kim , Jin-Hwa Kim , Jiyoung Lee , Seungryong Kim

Despite the remarkable generative capabilities of diffusion models, their integration into safety-critical or scientifically rigorous applications remains hindered by the need to ensure compliance with stringent physical, structural, and…

Machine Learning · Computer Science 2025-06-03 Jacob K. Christopher , Michael Cardei , Jinhao Liang , Ferdinando Fioretto

Generative modeling of 3D human bodies have been studied extensively in computer vision. The core is to design a compact latent representation that is both expressive and semantically interpretable, yet existing approaches struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Haorui Ji , Rong Wang , Taojun Lin , Hongdong Li

Predicting and generating human hand grasp over objects is critical for animation and robotic tasks. In this work, we focus on generating both the hand and objects in a grasp by a single diffusion model. Our proposed Joint Hand-Object…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Jinkun Cao , Jingyuan Liu , Kris Kitani , Yi Zhou

We present DIRECT-3D, a diffusion-based 3D generative model for creating high-quality 3D assets (represented by Neural Radiance Fields) from text prompts. Unlike recent 3D generative models that rely on clean and well-aligned 3D data,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Qihao Liu , Yi Zhang , Song Bai , Adam Kortylewski , Alan Yuille

The integration of deep learning, particularly AI-Generated Content, with high-quality data derived from ab initio calculations has emerged as a promising avenue for transforming the landscape of scientific research. However, the challenge…

Machine Learning · Computer Science 2024-12-11 Kaiwei Zhang , Yange Lin , Guangcheng Wu , Yuxiang Ren , Xuecang Zhang , Bo wang , Xiaoyu Zhang , Weitao Du

Effective generation of molecular structures, or new chemical entities, that bind to target proteins is crucial for lead identification and optimization in drug discovery. Despite advancements in atom- and motif-wise deep learning models…

Machine Learning · Computer Science 2025-03-04 Guanlue Li , Chenran Jiang , Ziqi Gao , Yu Liu , Chenyang Liu , Jiean Chen , Yong Huang , Jia Li

Training-free guidance methods for continuous data have seen an explosion of interest due to the fact that they enable foundation diffusion models to be paired with interchangable guidance models. Currently, equivalent guidance methods for…

Machine Learning · Statistics 2024-09-12 Thomas J. Kerby , Kevin R. Moon

Diffusion-based graph generative models have recently obtained promising results for graph generation. However, existing diffusion-based graph generative models are mostly one-shot generative models that apply Gaussian diffusion in the…

Artificial Intelligence · Computer Science 2023-07-19 Lingkai Kong , Jiaming Cui , Haotian Sun , Yuchen Zhuang , B. Aditya Prakash , Chao Zhang

We propose a new class of generative models that naturally handle data of varying dimensionality by jointly modeling the state and dimension of each datapoint. The generative process is formulated as a jump diffusion process that makes…

Graph structures offer a versatile framework for representing diverse patterns in nature and complex systems, applicable across domains like molecular chemistry, social networks, and transportation systems. While diffusion models have…

Machine Learning · Computer Science 2024-06-10 Adrien Carrel

Molecule generation is advancing rapidly in chemical discovery and drug design. Flow matching methods have recently set the state of the art (SOTA) in unconditional molecule generation, surpassing score-based diffusion models. However,…

Most current MKGC approaches are predominantly based on discriminative models that maximize conditional likelihood. These approaches struggle to efficiently capture the complex connections in real-world knowledge graphs, thereby limiting…

Information Retrieval · Computer Science 2025-04-10 Wei Huang , Meiyu Liang , Peining Li , Xu Hou , Yawen Li , Junping Du , Zhe Xue , Zeli Guan

Diffusion-based voxel prior modelling is challenging for the reconstruction of large-scale 3D porous microstructures. Due to the demanding requirements for simultaneously modelling both the continuous pore morphology and the discrete…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Yue Shi , Peng Wang , Mingzhe Yu , Yunlong Zhao , Li Liu , Gareth D Hatton , Yan Lyu , Liangxiu Han

Diffusion probabilistic models have achieved remarkable success in text guided image generation. However, generating 3D shapes is still challenging due to the lack of sufficient data containing 3D models along with their descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Zijie Wu , Yaonan Wang , Mingtao Feng , He Xie , Ajmal Mian

Recent remarkable advancements in geometric deep generative models, coupled with accumulated structural data, enable structure-based drug design (SBDD) using only target protein information. However, existing models often struggle to…

Biomolecules · Quantitative Biology 2026-03-09 Joongwon Lee , Wonho Zhung , Jisu Seo , Woo Youn Kim

State-of-the-art models for 3D molecular generation are based on significant inductive biases, SE(3), permutation equivariance to respect symmetry and graph message-passing networks to capture local chemistry, yet the generated molecules…

Machine Learning · Computer Science 2025-07-02 Carlos Vonessen , Charles Harris , Miruna Cretu , Pietro Liò