English
Related papers

Related papers: VEDA: 3D Molecular Generation via Variance-Explodi…

200 papers

Diffusion generative models have emerged as a powerful framework for addressing problems in structural biology and structure-based drug design. These models operate directly on 3D molecular structures. Due to the unfavorable scaling of…

Biomolecules · Quantitative Biology 2024-05-10 Ian Dunn , David Ryan Koes

Diffusion Transformers (DiT) trained with flow matching in a VAE latent space have unified visual generation across images and videos. A natural next step toward a single architecture for both generation (visual synthesis) and understanding…

Computation and Language · Computer Science 2026-05-11 Jiaxiu Jiang , Jingjing Ren , Wenbo Li , Bo Wang , Haoze Sun , Yijun Yang , Jianhui Liu , Yanbing Zhang , Shenghe Zheng , Yuan Zhang , Haoyang Huang , Nan Duan , Wangmeng Zuo

Image-based 3D generation has vast applications in robotics and gaming, where high-quality, diverse outputs and consistent 3D representations are crucial. However, existing methods have limitations: 3D diffusion models are limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ye Tao , Jiawei Zhang , Yahao Shi , Dongqing Zou , Bin Zhou

Diffusion Probabilistic Models (DPMs) have emerged as a powerful class of deep generative models, achieving remarkable performance in image synthesis tasks. However, these models face challenges in terms of widespread adoption due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Kidist Amde Mekonnen , Nicola Dall'Asen , Paolo Rota

We propose \textbf{DMV3D}, a novel 3D generation approach that uses a transformer-based 3D large reconstruction model to denoise multi-view diffusion. Our reconstruction model incorporates a triplane NeRF representation and can denoise…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yinghao Xu , Hao Tan , Fujun Luan , Sai Bi , Peng Wang , Jiahao Li , Zifan Shi , Kalyan Sunkavalli , Gordon Wetzstein , Zexiang Xu , Kai Zhang

The crystal diffusion variational autoencoder (CDVAE) is a machine learning model that leverages score matching to generate realistic crystal structures that preserve crystal symmetry. In this study, we leverage novel diffusion…

In this paper, we introduce an SE(3) diffusion model-based point cloud registration framework for 6D object pose estimation in real-world scenarios. Our approach formulates the 3D registration task as a denoising diffusion process, which…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Haobo Jiang , Mathieu Salzmann , Zheng Dang , Jin Xie , Jian Yang

Note: The final version of this article was published in Computers and Geosciences, Volume 206, January 2026, 106038. DOI: 10.1016/j.cageo.2025.106038. Readers should refer to the published version for the most up-to-date content.…

The inverse design of metasurfaces faces inherent challenges due to the nonlinear and highly complex relationship between geometric configurations and their electromagnetic behavior. Traditional optimization approaches often suffer from…

Generating new molecules is fundamental to advancing critical applications such as drug discovery and material synthesis. Flows can generate molecules effectively by inverting the encoding process, however, existing flow models either…

Machine Learning · Computer Science 2022-10-14 Yogesh Verma , Samuel Kaski , Markus Heinonen , Vikas Garg

Recent advances in text-to-3D generation have made significant progress. In particular, with the pretrained diffusion models, existing methods predominantly use Score Distillation Sampling (SDS) to train 3D models such as Neural RaRecent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Hangyu Li , Xiangxiang Chu , Dingyuan Shi , Wang Lin

Recently, molecule generation using deep learning has been actively investigated in drug discovery. In this field, Transformer and VAE are widely used as powerful models, but they are rarely used in combination due to structural and…

Biomolecules · Quantitative Biology 2024-04-08 Yasuhiro Yoshikai , Tadahaya Mizuno , Shumpei Nemoto , Hiroyuki Kusuhara

Recent advances in 3D generative models have shown promising results but often fall short in capturing the complexity of architectural geometries and topologies and fine geometric details at high resolutions. To tackle this, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 S. Rasoulzadeh , M. Bank , I. Kovacic , K. Schinegger , S. Rutzinger , M. Wimmer

Video classification researches that have recently attracted attention are the fields of temporal modeling and 3D efficient architecture. However, the temporal modeling methods are not efficient or the 3D efficient architecture is less…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Youngwan Lee , Hyung-Il Kim , Kimin Yun , Jinyoung Moon

End-to-end autonomous driving via Vision-Language-Action (VLA) models demands a precarious balance between high-fidelity trajectory planning and efficient inference. Existing paradigms typically fall short: autoregressive (AR) VLAs are…

Computation and Language · Computer Science 2026-05-26 Kewei Zhang , Jin Wang , Sensen Gao , Chengyue Wu , Yulong Cao , Songyang Han , Boris Ivanovic , Langechuan Liu , Marco Pavone , Song Han , Daquan Zhou , Enze Xie

This dissertation attempts to drive innovation in the field of generative modeling for computer vision, by exploring novel formulations of conditional generative models, and innovative applications in images, 3D animations, and video. Our…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Vikram Voleti

Generating high-quality and photorealistic 3D assets remains a longstanding challenge in 3D vision and computer graphics. Although state-of-the-art generative models, such as diffusion models, have made significant progress in 3D…

Graphics · Computer Science 2025-06-19 Qingming Liu , Zhen Liu , Dinghuai Zhang , Kui Jia

Multi-view 3D detection based on BEV (bird-eye-view) has recently achieved significant improvements. However, the huge memory consumption of state-of-the-art models makes it hard to deploy them on vehicles, and the non-trivial latency will…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yifan Zhang , Zhen Dong , Huanrui Yang , Ming Lu , Cheng-Ching Tseng , Yuan Du , Kurt Keutzer , Li Du , Shanghang Zhang

Tokenizers are a key component of state-of-the-art generative image models, extracting the most important features from the signal while reducing data dimension and redundancy. Most current tokenizers are based on KL-regularized variational…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Théophane Vallaeys , Jakob Verbeek , Matthieu Cord

While AI-generated content has garnered significant attention, achieving photo-realistic video synthesis remains a formidable challenge. Despite the promising advances in diffusion models for video generation quality, the complex model…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zhengang Li , Yan Kang , Yuchen Liu , Difan Liu , Tobias Hinz , Feng Liu , Yanzhi Wang