English
Related papers

Related papers: HuGeDiff: 3D Human Generation via Diffusion with G…

200 papers

3D editing plays a crucial role in many areas such as gaming and virtual reality. Traditional 3D editing methods, which rely on representations like meshes and point clouds, often fall short in realistically depicting complex scenes. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Yiwen Chen , Zilong Chen , Chi Zhang , Feng Wang , Xiaofeng Yang , Yikai Wang , Zhongang Cai , Lei Yang , Huaping Liu , Guosheng Lin

Despite recent advancements in high-fidelity human reconstruction techniques, the requirements for densely captured images or time-consuming per-instance optimization significantly hinder their applications in broader scenarios. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Panwang Pan , Zhuo Su , Chenguo Lin , Zhen Fan , Yongjie Zhang , Zeming Li , Tingting Shen , Yadong Mu , Yebin Liu

3D human generation from 2D images has achieved remarkable progress through the synergistic utilization of neural rendering and generative models. Existing 3D human generative models mainly generate a clothed 3D human as an undetectable 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Shoukang Hu , Fangzhou Hong , Tao Hu , Liang Pan , Haiyi Mei , Weiye Xiao , Lei Yang , Ziwei Liu

Despite remarkable progress having been made on the problem of 3D human pose and shape estimation (HPS), current state-of-the-art methods rely heavily on either confined indoor mocap datasets or datasets generated by a rendering engine…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Yongtao Ge , Wenjia Wang , Yongfan Chen , Fanzhou Wang , Lei Yang , Hao Chen , Chunhua Shen

3D human digitization has long been a highly pursued yet challenging task. Existing methods aim to generate high-quality 3D digital humans from single or multiple views, but remain primarily constrained by current paradigms and the scarcity…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yuhang Yang , Fengqi Liu , Yixing Lu , Qin Zhao , Pingyu Wu , Wei Zhai , Ran Yi , Yang Cao , Lizhuang Ma , Zheng-Jun Zha , Junting Dong

While AI-generated text and 2D images continue to expand its territory, 3D generation has gradually emerged as a trend that cannot be ignored. Since the year 2023 an abundant amount of research papers has emerged in the domain of 3D…

Artificial Intelligence · Computer Science 2024-01-08 Song Bai , Jie Li

While text-to-3D and image-to-3D generation tasks have received considerable attention, one important but under-explored field between them is controllable text-to-3D generation, which we mainly focus on in this work. To address this task,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Zhiqi Li , Yiming Chen , Lingzhe Zhao , Peidong Liu

We present PrimDiffusion, the first diffusion-based framework for 3D human generation. Devising diffusion models for 3D human generation is difficult due to the intensive computational cost of 3D representations and the articulated topology…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Zhaoxi Chen , Fangzhou Hong , Haiyi Mei , Guangcong Wang , Lei Yang , Ziwei Liu

Recent years have seen significant progress in human image generation, particularly with the advancements in diffusion models. However, existing diffusion methods encounter challenges when producing consistent hand anatomy and the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Anton Pelykh , Ozge Mercanoglu Sincan , Richard Bowden

3D Gaussian Splatting (3DGS) has shown convincing performance in rendering speed and fidelity, yet the generation of Gaussian Splatting remains a challenge due to its discreteness and unstructured nature. In this work, we propose DiffGS, a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Junsheng Zhou , Weiqi Zhang , Yu-Shen Liu

3D Gaussian Splatting (3DGS) has demonstrated its advantages in achieving fast and high-quality rendering. As point clouds serve as a widely-used and easily accessible form of 3D representation, bridging the gap between point clouds and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Weiqi Zhang , Junsheng Zhou , Haotian Geng , Wenyuan Zhang , Yu-Shen Liu

Image-based 3D generation has vast applications in robotics and gaming, where high-quality, diverse outputs and consistent 3D representations are crucial. However, existing methods have limitations: 3D diffusion models are limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ye Tao , Jiawei Zhang , Yahao Shi , Dongqing Zou , Bin Zhou

3D modeling has long been an important area in computer vision and computer graphics. Recently, thanks to the breakthroughs in neural representations and generative models, we witnessed a rapid development of 3D modeling. 3D human modeling,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Ruihe Wang , Yukang Cao , Kai Han , Kwan-Yee K. Wong

Recent months have witnessed rapid progress in 3D generation based on diffusion models. Most advances require fine-tuning existing 2D Stable Diffsuions into multi-view settings or tedious distilling operations and hence fall short of 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Suyi Jiang , Haimin Luo , Haoran Jiang , Ziyu Wang , Jingyi Yu , Lan Xu

Recent works on text-to-3d generation show that using only 2D diffusion supervision for 3D generation tends to produce results with inconsistent appearances (e.g., faces on the back view) and inaccurate shapes (e.g., animals with extra…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cheng Chen , Xiaofeng Yang , Fan Yang , Chengzeng Feng , Zhoujie Fu , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

This work addresses the problem of real-time rendering of photorealistic human body avatars learned from multi-view videos. While the classical approaches to model and render virtual humans generally use a textured mesh, recent research has…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Arthur Moreau , Jifei Song , Helisa Dhamo , Richard Shaw , Yiren Zhou , Eduardo Pérez-Pellitero

Recently, text-guided 3D generative methods have made remarkable advancements in producing high-quality textures and geometry, capitalizing on the proliferation of large vision-language and image diffusion models. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Xiao Han , Yukang Cao , Kai Han , Xiatian Zhu , Jiankang Deng , Yi-Zhe Song , Tao Xiang , Kwan-Yee K. Wong

Most existing human rendering methods require every part of the human to be fully visible throughout the input video. However, this assumption does not hold in real-life settings where obstructions are common, resulting in only partial…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Adam Sun , Tiange Xiang , Scott Delp , Li Fei-Fei , Ehsan Adeli

We propose a novel 3D deepfake generation framework based on 3D Gaussian Splatting that enables realistic, identity-preserving face swapping and reenactment in a fully controllable 3D space. Compared to conventional 2D deepfake approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Wending Liu , Siyun Liang , Huy H. Nguyen , Isao Echizen

Controllable generation of 3D assets is important for many practical applications like content creation in movies, games and engineering, as well as in AR/VR. Recently, diffusion models have shown remarkable results in generation quality of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Philipp Schröppel , Christopher Wewer , Jan Eric Lenssen , Eddy Ilg , Thomas Brox