English
Related papers

Related papers: ProxelGen: Generating Proteins as 3D Densities

200 papers

Generative modeling of three-dimensional (3D) molecules is a fundamental yet challenging problem in drug discovery and materials science. Existing approaches typically represent molecules as 3D graphs and co-generate discrete atom types…

Machine Learning · Statistics 2026-03-16 Yuchen Hua , Xingang Peng , Jianzhu Ma , Muhan Zhang

We propose a new representation for encoding 3D shapes as neural fields. The representation is designed to be compatible with the transformer architecture and to benefit both shape reconstruction and shape generation. Existing works on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Biao Zhang , Matthias Nießner , Peter Wonka

Volumetric design is the first and critical step for professional building design, where architects not only depict the rough 3D geometry of the building but also specify the programs to form a 2D layout on each floor. Though 2D layout…

Machine Learning · Computer Science 2021-04-28 Kai-Hung Chang , Chin-Yi Cheng , Jieliang Luo , Shingo Murata , Mehdi Nourbakhsh , Yoshito Tsuji

When obtaining interior 3D voxel data from triangular meshes, most existing methods fail to handle low quality meshes which happens to take up a big portion on the internet. In this work we present a robust voxelization method that is based…

Graphics · Computer Science 2021-07-22 Joseph Chen , Ko-Wei Tai , Wen-Chin Chen , Ming Ouhyoung

This paper presents a learning-based, lossless compression method for static point cloud geometry, based on context-adaptive arithmetic coding. Unlike most existing methods working in the octree domain, our encoder operates in a hybrid…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Dat Thanh Nguyen , Maurice Quach , Giuseppe Valenzise , Pierre Duhamel

In recent years, deep learning techniques have made significant strides in molecular generation for specific targets, driving advancements in drug discovery. However, existing molecular generation methods present significant limitations:…

Machine Learning · Computer Science 2025-03-12 Taojie Kuang , Qianli Ma , Athanasios V. Vasilakos , Yu Wang , Qiang , Cheng , Zhixiang Ren

Diffusion models have emerged as the state-of-the-art for image generation, among other tasks. Here, we present an efficient diffusion-based model for 3D-aware generation of neural fields. Our approach pre-processes training data, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 J. Ryan Shue , Eric Ryan Chan , Ryan Po , Zachary Ankner , Jiajun Wu , Gordon Wetzstein

Is there a foreign language describing protein sequences and structures simultaneously? Protein structures, represented by continuous 3D points, have long posed a challenge due to the contrasting modeling paradigms of discrete sequences. We…

Biomolecules · Quantitative Biology 2024-03-20 Zhangyang Gao , Cheng Tan , Jue Wang , Yufei Huang , Lirong Wu , Stan Z. Li

While generative models have excelled at creating static 3D content, the pursuit of systems that understand how objects move and respond to interactions remains a fundamental challenge. Current methods for articulated motion lie at a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Tianshan Zhang , Zeyu Zhang , Hao Tang

Generating photorealistic 3D faces from given conditions is a challenging task. Existing methods often rely on time-consuming one-by-one optimization approaches, which are not efficient for modeling the same distribution content, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Xiaolong Shen , Jianxin Ma , Chang Zhou , Zongxin Yang

We introduce SegviGen, a framework that repurposes native 3D generative models for 3D part segmentation. Existing pipelines either lift strong 2D priors into 3D via distillation or multi-view mask aggregation, often suffering from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Lin Li , Haoran Feng , Zehuan Huang , Haohua Chen , Wenbo Nie , Shaohua Hou , Keqing Fan , Pan Hu , Sheng Wang , Buyu Li , Lu Sheng

In this paper we address the problem of protein classification starting from a multi-view 2D representation of proteins. From each 3D protein structure, a large set of 2D projections is generated using the protein visualization software…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Loris Nanni , Alessandra Lumini , Federica Pasquali , Sheryl Brahnam

Proteins are essential macromolecules defined by their amino acid sequences, which determine their three-dimensional structures and, consequently, their functions in all living organisms. Therefore, generative protein modeling necessitates…

Machine Learning · Computer Science 2024-10-18 Xinyou Wang , Zaixiang Zheng , Fei Ye , Dongyu Xue , Shujian Huang , Quanquan Gu

Modern 3D generation methods can rapidly create shapes from sparse or single views, but their outputs often lack geometric detail due to computational constraints. We present DetailGen3D, a generative approach specifically designed to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Ken Deng , Yuan-Chen Guo , Jingxiang Sun , Zi-Xin Zou , Yangguang Li , Xin Cai , Yan-Pei Cao , Yebin Liu , Ding Liang

Recently, diffusion- and flow-based generative models of protein structures have emerged as a powerful tool for de novo protein design. Here, we develop Proteina, a new large-scale flow-based protein backbone generator that utilizes…

Proteins are complex biomolecules that perform a variety of crucial functions within living organisms. Designing and generating novel proteins can pave the way for many future synthetic biology applications, including drug discovery.…

Recent progress in deep generative models has led to tremendous breakthroughs in image generation. However, while existing models can synthesize photorealistic images, they lack an understanding of our underlying 3D world. We present a new…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Jun-Yan Zhu , Zhoutong Zhang , Chengkai Zhang , Jiajun Wu , Antonio Torralba , Joshua B. Tenenbaum , William T. Freeman

The generation of three-dimensional (3D) medical images has great application potential since it takes into account the 3D anatomical structure. Two problems prevent effective training of a 3D medical generative model: (1) 3D medical images…

Image and Video Processing · Electrical Eng. & Systems 2023-12-07 Yanbin Liu , Girish Dwivedi , Farid Boussaid , Frank Sanfilippo , Makoto Yamada , Mohammed Bennamoun

Developing effective representations of protein structures is essential for advancing protein science, particularly for protein generative modeling. Current approaches often grapple with the complexities of the SE(3) manifold, rely on…

Machine Learning · Computer Science 2025-10-14 Shaoning Li , Le Zhuo , Yusong Wang , Mingyu Li , Xinheng He , Fandi Wu , Hongsheng Li , Pheng-Ann Heng

3D generative modeling is accelerating as the technology allowing the capture of geometric data is developing. However, the acquired data is often inconsistent, resulting in unregistered meshes or point clouds. Many generative learning…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Thomas Besnier , Sylvain Arguillère , Emery Pierson , Mohamed Daoudi