English
Related papers

Related papers: PICA: Physics-Integrated Clothed Avatar

200 papers

While humans effortlessly discern intrinsic dynamics and adapt to new scenarios, modern AI systems often struggle. Current methods for visual grounding of dynamics either use pure neural-network-based simulators (black box), which may…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Junyi Cao , Shanyan Guan , Yanhao Ge , Wei Li , Xiaokang Yang , Chao Ma

We present a data-driven method for learning to generate animations of 3D garments using a 2D image diffusion model. In contrast to existing methods, typically based on fully connected networks, graph neural networks, or generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Raquel Vidaurre , Elena Garces , Dan Casas

Efficient and accurate reconstruction of a relightable, dynamic clothed human avatar from a monocular video is crucial for the entertainment industry. This paper presents SGIA (Surfel-based Gaussian Inverse Avatar), which introduces…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Yiqun Zhao , Chenming Wu , Binbin Huang , Yihao Zhi , Chen Zhao , Jingdong Wang , Shenghua Gao

Recent approaches to jointly reconstruct 3D humans and objects from a single RGB image represent 3D shapes with template-based or coarse models, which fail to capture details of loose clothing on human bodies. In this paper, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ayushi Dutta , Marco Pesavento , Marco Volino , Adrian Hilton , Armin Mustafa

Photorealistic telepresence requires both high-fidelity body modeling and faithful driving to enable dynamically synthesized appearance that is indistinguishable from reality. In this work, we propose an end-to-end framework that addresses…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Edoardo Remelli , Timur Bagautdinov , Shunsuke Saito , Tomas Simon , Chenglei Wu , Shih-En Wei , Kaiwen Guo , Zhe Cao , Fabian Prada , Jason Saragih , Yaser Sheikh

Achieving realistic animated human avatars requires accurate modeling of pose-dependent clothing deformations. Existing learning-based methods heavily rely on the Linear Blend Skinning (LBS) of minimally-clothed human models like SMPL to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Hang Ye , Xiaoxuan Ma , Hai Ci , Wentao Zhu , Yizhou Wang

In this paper, we introduce GaussianMotion, a novel human rendering model that generates fully animatable scenes aligned with textual descriptions using Gaussian Splatting. Although existing methods achieve reasonable text-to-3D generation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Gyumin Shim , Sangmin Lee , Jaegul Choo

Existing digital human models approximate the human skeletal system using rigid bodies connected by rotational joints. While the simplification is considered acceptable for legs and arms, it significantly lacks fidelity to model rich torso…

Graphics · Computer Science 2023-05-10 Seunghwan Lee , Yifeng Jiang , C. Karen Liu

As the population continues to age, a shortage of caregivers is expected in the future. Dressing assistance, in particular, is crucial for opportunities for social participation. Especially dressing close-fitting garments, such as socks,…

Robotics · Computer Science 2026-01-27 Takuma Tsukakoshi , Tamon Miyake , Tetsuya Ogata , Yushi Wang , Takumi Akaishi , Shigeki Sugano

Real-time rendering of photorealistic and controllable human avatars stands as a cornerstone in Computer Vision and Graphics. While recent advances in neural implicit rendering have unlocked unprecedented photorealism for digital avatars,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haokai Pang , Heming Zhu , Adam Kortylewski , Christian Theobalt , Marc Habermann

This paper proposes a do-it-all neural model of human hands, named LISA. The model can capture accurate hand shape and appearance, generalize to arbitrary hand subjects, provide dense surface correspondences, be reconstructed from images in…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Enric Corona , Tomas Hodan , Minh Vo , Francesc Moreno-Noguer , Chris Sweeney , Richard Newcombe , Lingni Ma

Reconstructing a high-quality, animatable 3D human avatar with expressive facial and hand motions from a single image has gained significant attention due to its broad application potential. 3D human avatar reconstruction typically requires…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Dongbin Zhang , Yunfei Liu , Lijian Lin , Ye Zhu , Yang Li , Minghan Qin , Yu Li , Haoqian Wang

In this paper, we present a novel method that facilitates the creation of vivid 3D Gaussian avatars from monocular video inputs (GVA). Our innovation lies in addressing the intricate challenges of delivering high-fidelity human body…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Xinqi Liu , Chenming Wu , Jialun Liu , Xing Liu , Jinbo Wu , Chen Zhao , Haocheng Feng , Errui Ding , Jingdong Wang

This paper addresses the task of 3D clothed human generation from textural descriptions. Previous works usually encode the human body and clothes as a holistic model and generate the whole model in a single-stage optimization, which makes…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Junting Dong , Qi Fang , Zehuan Huang , Xudong Xu , Jingbo Wang , Sida Peng , Bo Dai

We present a novel neural implicit representation for articulated human bodies. Compared to explicit template meshes, neural implicit body representations provide an efficient mechanism for modeling interactions with the environment, which…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Marko Mihajlovic , Shunsuke Saito , Aayush Bansal , Michael Zollhoefer , Siyu Tang

We introduce TADA, a simple-yet-effective approach that takes textual descriptions and produces expressive 3D avatars with high-quality geometry and lifelike textures, that can be animated and rendered with traditional graphics pipelines.…

Artificial Intelligence · Computer Science 2023-08-22 Tingting Liao , Hongwei Yi , Yuliang Xiu , Jiaxaing Tang , Yangyi Huang , Justus Thies , Michael J. Black

We present a methodology to automatically obtain Pose Space Deformation (PSD) basis for rigged garments through deep learning. Classical approaches rely on Physically Based Simulations (PBS) to animate clothes. These are general solutions…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Hugo Bertiche , Meysam Madadi , Sergio Escalera

We present SCANimate, an end-to-end trainable framework that takes raw 3D scans of a clothed human and turns them into an animatable avatar. These avatars are driven by pose parameters and have realistic clothing that moves and deforms…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Shunsuke Saito , Jinlong Yang , Qianli Ma , Michael J. Black

Real-time rendering of human head avatars is a cornerstone of many computer graphics applications, such as augmented reality, video games, and films, to name a few. Recent approaches address this challenge with computationally efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Kartik Teotia , Hyeongwoo Kim , Pablo Garrido , Marc Habermann , Mohamed Elgharib , Christian Theobalt

3D facial animation is often produced by manipulating facial deformation models (or rigs), that are traditionally parameterized by expression controls. A key component that is usually overlooked is expression 'style', as in, how a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Lingchen Yang , Gaspard Zoss , Prashanth Chandran , Paulo Gotardo , Markus Gross , Barbara Solenthaler , Eftychios Sifakis , Derek Bradley