English
Related papers

Related papers: Native and Compact Structured Latents for 3D Gener…

200 papers

Three-dimensional (3D) medical image enhancement, including denoising and super-resolution, is critical for clinical diagnosis in CT, PET, and MRI. Although diffusion models have shown remarkable success in 2D medical imaging, scaling them…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Hongxu Jiang , Fei Li , Boxiao Yu , Ying Zhang , Kaleb Smith , Kuang Gong , Wei Shao

Structure learning for 3D shapes is vital for 3D computer vision. State-of-the-art methods show promising results by representing shapes using implicit functions in 3D that are learned using discriminative neural networks. However, learning…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Zhizhong Han , Guanhui Qiao , Yu-Shen Liu , Matthias Zwicker

Laminated composite materials are widely used in most fields of engineering. Wave propagation analysis plays an essential role in understanding the short-duration transient response of composite structures. The forward physics-based models…

Signal Processing · Electrical Eng. & Systems 2022-12-14 Mahindra Rautela , J. Senthilnath , Armin Huber , S. Gopalakrishnan

We propose L3DG, the first approach for generative 3D modeling of 3D Gaussians through a latent 3D Gaussian diffusion formulation. This enables effective generative 3D modeling, scaling to generation of entire room-scale scenes which can be…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Barbara Roessle , Norman Müller , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Angela Dai , Matthias Nießner

Recent advances in 3D generative models have shown promising results but often fall short in capturing the complexity of architectural geometries and topologies and fine geometric details at high resolutions. To tackle this, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 S. Rasoulzadeh , M. Bank , I. Kovacic , K. Schinegger , S. Rutzinger , M. Wimmer

Latent variable generative models have emerged as powerful tools for generative tasks including image and video synthesis. These models are enabled by pretrained autoencoders that map high resolution data into a compressed lower dimensional…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

3D-aware generative adversarial networks (GANs) synthesize high-fidelity and multi-view-consistent facial images using only collections of single-view 2D imagery. Towards fine-grained control over facial attributes, recent efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Jingxiang Sun , Xuan Wang , Lizhen Wang , Xiaoyu Li , Yong Zhang , Hongwen Zhang , Yebin Liu

This paper presents a new approach for 3D shape generation, inversion, and manipulation, through a direct generative modeling on a continuous implicit representation in wavelet domain. Specifically, we propose a compact wavelet…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Jingyu Hu , Ka-Hei Hui , Zhengzhe Liu , Ruihui Li , Chi-Wing Fu

While 3D content generation has advanced significantly, existing methods still face challenges with input formats, latent space design, and output representations. This paper introduces a novel 3D generation framework that addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yushi Lan , Shangchen Zhou , Zhaoyang Lyu , Fangzhou Hong , Shuai Yang , Bo Dai , Xingang Pan , Chen Change Loy

We develop the sparse VAE for unsupervised representation learning on high-dimensional data. The sparse VAE learns a set of latent factors (representations) which summarize the associations in the observed data features. The underlying…

Machine Learning · Statistics 2025-04-16 Gemma E. Moran , Dhanya Sridhar , Yixin Wang , David M. Blei

Existing 3D surface representation approaches are unable to accurately classify pixels and their orientation lying on the boundary of an object. Thus resulting in coarse representations which usually require post-processing steps to extract…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Mateusz Michalkiewicz , Jhony K. Pontes , Dominic Jack , Mahsa Baktashmotlagh , Anders Eriksson

We present a novel algorithm for point cloud segmentation. Our approach transforms unstructured point clouds into regular voxel grids, and further uses a kernel-based interpolated variational autoencoder (VAE) architecture to encode the…

Graphics · Computer Science 2019-08-21 Hsien-Yu Meng , Lin Gao , YuKun Lai , Dinesh Manocha

3D single object tracking remains a challenging problem due to the sparsity and incompleteness of the point clouds. Existing algorithms attempt to address the challenges in two strategies. The first strategy is to learn dense geometric…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Jingwen Zhang , Zikun Zhou , Guangming Lu , Jiandong Tian , Wenjie Pei

We present Smol-GS, a novel method for learning compact representations for 3D Gaussian Splatting (3DGS). Our approach learns highly efficient splat-wise features to model 3D space which capture abstracted cues, including color, opacity,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Haishan Wang , Mohammad Hassan Vali , Arno Solin

We present ShaDDR, an example-based deep generative neural network which produces a high-resolution textured 3D shape through geometry detailization and conditional texture generation applied to an input coarse voxel shape. Trained on a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Qimin Chen , Zhiqin Chen , Hang Zhou , Hao Zhang

Many robotic tasks involving some form of 3D visual perception greatly benefit from a complete knowledge of the working environment. However, robots often have to tackle unstructured environments and their onboard visual sensors can only…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Andrea Rosasco , Stefano Berti , Fabrizio Bottarel , Michele Colledanchise , Lorenzo Natale

Generative modeling of 3D human bodies have been studied extensively in computer vision. The core is to design a compact latent representation that is both expressive and semantically interpretable, yet existing approaches struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Haorui Ji , Rong Wang , Taojun Lin , Hongdong Li

Recent advances in 3D generation have transitioned from multi-view 2D rendering approaches to 3D-native latent diffusion frameworks that exploit geometric priors in ground truth data. Despite progress, three key limitations persist: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shaocong Dong , Lihe Ding , Xiao Chen , Yaokun Li , Yuxin Wang , Yucheng Wang , Qi Wang , Jaehyeok Kim , Chenjian Gao , Zhanpeng Huang , Zibin Wang , Tianfan Xue , Dan Xu

We introduce a latent 3D representation that models 3D surfaces as probability density functions in 3D, i.e., p(x,y,z), with flow-matching. Our representation is specifically designed for consumption by machine learning models, offering…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jen-Hao Rick Chang , Yuyang Wang , Miguel Angel Bautista Martin , Jiatao Gu , Xiaoming Zhao , Josh Susskind , Oncel Tuzel

3D shape generation aims to produce innovative 3D content adhering to specific conditions and constraints. Existing methods often decompose 3D shapes into a sequence of localized components, treating each element in isolation without…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Ruikai Cui , Weizhe Liu , Weixuan Sun , Senbo Wang , Taizhang Shang , Yang Li , Xibin Song , Han Yan , Zhennan Wu , Shenzhou Chen , Hongdong Li , Pan Ji