English
Related papers

Related papers: Human Interaction-Aware 3D Reconstruction from a S…

200 papers

We present a method for inferring diverse 3D models of human-object interactions from images. Reasoning about how humans interact with objects in complex scenes from a single 2D image is a challenging task given ambiguities arising from the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Xi Wang , Gen Li , Yen-Ling Kuo , Muhammed Kocabas , Emre Aksan , Otmar Hilliges

Reconstructing dynamic scenes with complex human-object interactions is a fundamental challenge in computer vision and graphics. Existing Gaussian Splatting methods either rely on human pose priors while neglecting dynamic objects, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Taewoo Kim , Suwoong Yeom , Jaehyun Pyun , Geonho Cha , Dongyoon Wee , Joonsik Nam , Yun-Seong Jeong , Kyeongbo Kong , Suk-Ju Kang

This paper proposes the use of an end-to-end Convolutional Neural Network for direct reconstruction of the 3D geometry of humans via volumetric regression. The proposed method does not require the fitting of a shape model and can be trained…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Aaron S. Jackson , Chris Manafas , Georgios Tzimiropoulos

Reconstructing 3D humans from a single image has been extensively investigated. However, existing approaches often fall short on capturing fine geometry and appearance details, hallucinating occluded parts with plausible details, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhenzhen Weng , Jingyuan Liu , Hao Tan , Zhan Xu , Yang Zhou , Serena Yeung-Levy , Jimei Yang

Given a single in-the-wild human photo, it remains a challenging task to reconstruct a high-fidelity 3D human model. Existing methods face difficulties including a) the varying body proportions captured by in-the-wild human images; b)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Wentao Wang , Hang Ye , Fangzhou Hong , Xue Yang , Jianfu Zhang , Yizhou Wang , Ziwei Liu , Liang Pan

In this study, we tackle the complex task of generating 3D human-object interactions (HOI) from textual descriptions in a zero-shot text-to-3D manner. We identify and address two key challenges: the unsatisfactory outcomes of direct…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Sisi Dai , Wenhao Li , Haowen Sun , Haibin Huang , Chongyang Ma , Hui Huang , Kai Xu , Ruizhen Hu

Human imitation has become topical recently, driven by GAN's ability to disentangle human pose and body content. However, the latest methods hardly focus on 3D information, and to avoid self-occlusion, a massive amount of input images are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Haoxi Ran , Guangfu Wang , Li Lu

Despite recent advancements in high-fidelity human reconstruction techniques, the requirements for densely captured images or time-consuming per-instance optimization significantly hinder their applications in broader scenarios. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Panwang Pan , Zhuo Su , Chenguo Lin , Zhen Fan , Yongjie Zhang , Zeming Li , Tingting Shen , Yadong Mu , Yebin Liu

Reconstructing 3D clothed humans from images is fundamental to applications like virtual try-on, avatar creation, and mixed reality. While recent advances have enhanced human body recovery, accurate reconstruction of garment geometry --…

Graphics · Computer Science 2025-05-16 Ren Li , Cong Cao , Corentin Dumery , Yingxuan You , Hao Li , Pascal Fua

We present a method for generating a full 360{\deg} orbit video around a person from a single input image. Existing methods typically adapt image-based diffusion models for multi-view synthesis, but yield inconsistent results across views…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Keito Suzuki , Kunyao Chen , Lei Wang , Bang Du , Runfa Blark Li , Peng Liu , Ning Bi , Truong Nguyen

Human-object interactions with articulated objects are common in everyday life. Despite much progress in single-view 3D reconstruction, it is still challenging to infer an articulated 3D object model from an RGB video showing a person…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Sanjay Haresh , Xiaohao Sun , Hanxiao Jiang , Angel X. Chang , Manolis Savva

Recently, 3D hand reconstruction has gained more attention in human-computer cooperation, especially for hand-object interaction scenario. However, it still remains huge challenge due to severe hand-occlusion caused by interaction, which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Feng Shuang , Wenbo He , Shaodong Li

Human-Object Interaction (HOI) detection lies at the core of action understanding. Besides 2D information such as human/object appearance and locations, 3D pose is also usually utilized in HOI learning since its view-independence. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Yong-Lu Li , Xinpeng Liu , Han Lu , Shiyi Wang , Junqi Liu , Jiefeng Li , Cewu Lu

This paper propose a interactive 3D modeling method and corresponding system based on single or multiple uncalibrated images. The main feature of this method is that, according to the modeling habits of ordinary people, the 3D model of the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhi He , Rui Wang , Wei Hua , Yuchi Huo

Single image 3D reconstruction is an important but challenging task that requires extensive knowledge of our natural world. Many existing methods solve this problem by optimizing a neural radiance field under the guidance of 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Minghua Liu , Chao Xu , Haian Jin , Linghao Chen , Mukund Varma T , Zexiang Xu , Hao Su

A long-standing goal of 3D human reconstruction is to create lifelike and fully detailed 3D humans from single-view images. The main challenge lies in inferring unknown body shapes, appearances, and clothing details in areas not visible in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Hsuan-I Ho , Jie Song , Otmar Hilliges

In this work, we tackle the task of learning 3D human Gaussians from a single image, focusing on recovering detailed appearance and geometry including unobserved regions. We introduce a single-view generalizable Human Gaussian Model (HGM),…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Jinnan Chen , Chen Li , Jianfeng Zhang , Lingting Zhu , Buzhen Huang , Hanlin Chen , Gim Hee Lee

The task of reconstructing detailed 3D human body models from images is interesting but challenging in computer vision due to the high freedom of human bodies. In order to tackle the problem, we propose a coarse-to-fine method to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Zhongguo Li , Magnus Oskarsson , Anders Heyden

Single-view 3D reconstruction is currently approached from two dominant perspectives: reconstruction of scenes with limited diversity using 3D data supervision or reconstruction of diverse singular objects using large image priors. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Andreea Ardelean , Mert Özer , Bernhard Egger

Our work aims to reconstruct hand-object interactions from a single-view image, which is a fundamental but ill-posed task. Unlike methods that reconstruct from videos, multi-view images, or predefined 3D templates, single-view…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yumeng Liu , Xiaoxiao Long , Zemin Yang , Yuan Liu , Marc Habermann , Christian Theobalt , Yuexin Ma , Wenping Wang