English
Related papers

Related papers: 3DProxyImg: Controllable 3D-Aware Animation Synthe…

200 papers

Unsupervised generation of 3D-aware clothed humans with various appearances and controllable geometries is important for creating virtual human avatars and other AR/VR applications. Existing methods are either limited to rigid object…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

Recent 3D novel view synthesis (NVS) methods often require extensive 3D data for training, and also typically lack generalization beyond the training distribution. Moreover, they tend to be object centric and struggle with complex and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Taewon Kang , Divya Kothandaraman , Dinesh Manocha , Ming C. Lin

Recent video diffusion models have made remarkable strides in visual quality, yet precise, fine-grained control remains a key bottleneck that limits practical customizability for content creation. For AI video creators, three forms of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhenghong Zhou , Xiaohang Zhan , Zhiqin Chen , Soo Ye Kim , Nanxuan Zhao , Haitian Zheng , Qing Liu , He Zhang , Zhe Lin , Yuqian Zhou , Jiebo Luo

The ultimate goal of video generation is to satisfy a fundamental trilemma: achieving high visual quality, maintaining rigorous physical consistency, and enabling precise controllability. While recent models can maintain this balance in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tianshuo Xu , Zhifei Chen , Leyi Wu , Hao Lu , Ying-cong Chen

Current 2D-to-3D conversion methods achieve geometric accuracy but are artistically deficient, failing to replicate the immersive and emotionally resonant experience of professional 3D cinema. This is because geometric reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ping Chen , Zezhou Chen , Xingpeng Zhang , Yanlin Qian , Huan Hu , Xiang Liu , Zipeng Wang , Xin Wang , Zhaoxiang Liu , Kai Wang , Shiguo Lian

State-of-the-art 3D-aware generative models rely on coordinate-based MLPs to parameterize 3D radiance fields. While demonstrating impressive results, querying an MLP for every sample along each ray leads to slow rendering. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Katja Schwarz , Axel Sauer , Michael Niemeyer , Yiyi Liao , Andreas Geiger

Recent years have seen remarkable progress in deep learning powered visual content creation. This includes deep generative 3D-aware image synthesis, which produces high-idelity images in a 3D-consistent manner while simultaneously capturing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Weihao Xia , Jing-Hao Xue

Reconstructing personalized animatable head avatars has significant implications in the fields of AR/VR. Existing methods for achieving explicit face control of 3D Morphable Models (3DMM) typically rely on multi-view images or videos of a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Haoyu Ma , Tong Zhang , Shanlin Sun , Xiangyi Yan , Kun Han , Xiaohui Xie

Recent advances in 3D generation have been remarkable, with methods such as DreamFusion leveraging large-scale text-to-image diffusion-based models to guide 3D object generation. These methods enable the synthesis of detailed and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Bohan Zeng , Shanglin Li , Yutang Feng , Ling Yang , Hong Li , Sicheng Gao , Jiaming Liu , Conghui He , Wentao Zhang , Jianzhuang Liu , Baochang Zhang , Shuicheng Yan

We present FaceLift, a novel feed-forward approach for generalizable high-quality 360-degree 3D head reconstruction from a single image. Our pipeline first employs a multi-view latent diffusion model to generate consistent side and back…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Weijie Lyu , Yi Zhou , Ming-Hsuan Yang , Zhixin Shu

Recent methods have made notable progress in the visual quality of hand-object interaction video synthesis. However, most approaches rely on 2D control signals that lack spatial expressiveness and limit the utilization of synthetic 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Mingjin Chen , Junhao Chen , Zhaoxin Fan , Yujian Lee , Zichen Dang , Lili Wang , Yawen Cui , Lap-Pui Chau , Yi Wang

Joint rendering and deformation of mesh and 3D Gaussian Splatting (3DGS) have significant value as both representa tions offer complementary advantages for graphics applica tions. However, due to differences in representation and ren dering…

This paper presents A3D, an adaptive 3D network that can infer at a wide range of computational constraints with one-time training. Instead of training multiple models in a grid-search manner, it generates good configurations by trading off…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Sijie Zhu , Taojiannan Yang , Matias Mendieta , Chen Chen

Audio-driven 3D facial animation synthesis has been an active field of research with attention from both academia and industry. While there are promising results in this area, recent approaches largely focus on lip-sync and identity…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Sichun Wu , Kazi Injamamul Haque , Zerrin Yumak

Recent advances in video generation have shown remarkable potential for constructing world simulators. However, current models still struggle to produce physically consistent results, particularly when handling large-scale or complex…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zijun Wang , Panwen Hu , Jing Wang , Terry Jingchen Zhang , Yuhao Cheng , Long Chen , Yiqiang Yan , Zutao Jiang , Hanhui Li , Xiaodan Liang

Current 3D representations like meshes, voxels, point clouds, and NeRF-based neural implicit fields exhibit significant limitations: they are often task-specific, lacking universal applicability across reconstruction, generation, editing,…

Graphics · Computer Science 2025-07-17 Tielong Wang , Yuxuan Xiong , Jinfan Liu , Zhifan Zhang , Ye Chen , Yue Shi , Bingbing Ni

We propose a compositional method for constructing a complete 3D head avatar from a single image. Prior one-shot holistic approaches frequently fail to produce realistic hair dynamics during animation, largely due to inadequate decoupling…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Yuan Sun , Xuan Wang , WeiLi Zhang , Wenxuan Zhang , Yu Guo , Fei Wang

Creating compelling 3D character animations typically requires either expert use of professional software or expensive motion capture systems operated by skilled actors. We present DancingBox, a lightweight, vision-based system that makes…

Graphics · Computer Science 2026-03-19 Haocheng Yuan , Adrien Bousseau , Hao Pan , Lei Zhong , Changjian Li

Generating a street-level 3D scene from a single satellite image is a crucial yet challenging task. Current methods present a stark trade-off: geometry-colorization models achieve high geometric fidelity but are typically building-focused…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ming Qian , Zimin Xia , Changkun Liu , Shuailei Ma , Wen Wang , Zeran Ke , Bin Tan , Hang Zhang , Gui-Song Xia

Recent advancements in generative models have unlocked the capabilities to render photo-realistic data in a controllable fashion. Trained on the real data, these generative models are capable of producing realistic samples with minimal to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Abhay Rawat , Shubham Dokania , Astitva Srivastava , Shuaib Ahmed , Haiwen Feng , Rahul Tallamraju