English
Related papers

Related papers: 3D Human Interaction Generation: A Survey

200 papers

Learning to generate diverse scene-aware and goal-oriented human motions in 3D scenes remains challenging due to the mediocre characteristics of the existing datasets on Human-Scene Interaction (HSI); they only have limited scale/quality…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Zan Wang , Yixin Chen , Tengyu Liu , Yixin Zhu , Wei Liang , Siyuan Huang

Generative AI has made significant progress in recent years, with text-guided content generation being the most practical as it facilitates interaction between human instructions and AI-generated content (AIGC). Thanks to advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Chenghao Li , Chaoning Zhang , Joseph Cho , Atish Waghwase , Lik-Hang Lee , Francois Rameau , Yang Yang , Sung-Ho Bae , Choong Seon Hong

The rise of non-linear and interactive media such as video games has increased the need for automatic movement animation generation. In this survey, we review and analyze different aspects of building automatic movement generation systems…

Machine Learning · Computer Science 2019-03-21 Omid Alemi , Philippe Pasquier

Emotion recognition and generation have emerged as crucial topics in Artificial Intelligence research, playing a significant role in enhancing human-computer interaction within healthcare, customer service, and other fields. Although…

Machine Learning · Computer Science 2025-02-12 Rebecca Mobbs , Dimitrios Makris , Vasileios Argyriou

With advances in data-driven machine learning research, a wide variety of prediction models have been proposed to capture spatio-temporal features for the analysis of video streams. Recognising actions and detecting action transitions…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Harshala Gammulle , David Ahmedt-Aristizabal , Simon Denman , Lachlan Tychsen-Smith , Lars Petersson , Clinton Fookes

3D content creation plays a vital role in various applications, such as gaming, robotics simulation, and virtual reality. However, the process is labor-intensive and time-consuming, requiring skilled designers to invest considerable effort…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Chenhan Jiang

Generating realistic human geometry animations remains a challenging task, as it requires modeling natural clothing dynamics with fine-grained geometric details under limited data. To address these challenges, we propose two novel designs.…

Graphics · Computer Science 2025-12-09 Xiangjun Tang , Biao Zhang , Peter Wonka

The generation of high-quality 3D environments is crucial for industries such as gaming, virtual reality, and cinema, yet remains resource-intensive due to the reliance on manual processes. This study performs a systematic review of…

Graphics · Computer Science 2025-06-09 Miguel Silva , Alexandre Valle de Carvalho

This paper summarizes the recent progress in human motion analysis and its applications. In the beginning, we reviewed the motion capture systems and the representation model of human's motion data. Next, we sketched the advanced human…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Qifei Wang

World modeling has become a cornerstone in AI research, enabling agents to understand, represent, and predict the dynamic environments they inhabit. While prior work largely emphasizes generative methods for 2D image and video data, they…

Generating 3D humans that functionally interact with 3D scenes remains an open problem with applications in embodied AI, robotics, and interactive content creation. The key challenge involves reasoning about both the semantics of functional…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Jie Liu , Yu Sun , Alpar Cseke , Yao Feng , Nicolas Heron , Michael J. Black , Yan Zhang

Recent advancements in video generation have witnessed significant progress, especially with the rapid advancement of diffusion models. Despite this, their deficiencies in physical cognition have gradually received widespread attention -…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Minghui Lin , Xiang Wang , Yishan Wang , Shu Wang , Fengqi Dai , Pengxiang Ding , Cunxiang Wang , Zhengrong Zuo , Nong Sang , Siteng Huang , Donglin Wang

This paper introduces the first text-guided work for generating the sequence of hand-object interaction in 3D. The main challenge arises from the lack of labeled data where existing ground-truth datasets are nowhere near generalizable in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Junuk Cha , Jihyeon Kim , Jae Shin Yoon , Seungryul Baek

Robotic grasping of house-hold objects has made remarkable progress in recent years. Yet, human grasps are still difficult to synthesize realistically. There are several key reasons: (1) the human hand has many degrees of freedom (more than…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Korrawe Karunratanakul , Jinlong Yang , Yan Zhang , Michael Black , Krikamol Muandet , Siyu Tang

Human understanding and generation are critical for modeling digital humans and humanoid embodiments. Recently, Human-centric Foundation Models (HcFMs) inspired by the success of generalist models, such as large language and vision models,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Shixiang Tang , Yizhou Wang , Lu Chen , Yuan Wang , Sida Peng , Dan Xu , Wanli Ouyang

Recent years have seen an explosion of work and interest in text-to-3D shape generation. Much of the progress is driven by advances in 3D representations, large-scale pretraining and representation learning for text and image data enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Han-Hung Lee , Manolis Savva , Angel X. Chang

Generative AI (GenAI) has shown remarkable capabilities in generating diverse and realistic content across different formats like images, videos, and text. In Generative AI, human involvement is essential, thus HCI literature has…

Human-Computer Interaction · Computer Science 2024-01-17 Jingyu Shi , Rahul Jain , Hyungjun Doh , Ryo Suzuki , Karthik Ramani

Technological progress has persistently shaped the dynamics of human-machine interactions in task execution. In response to the advancements in Generative AI, this paper outlines a detailed study plan that investigates various human-AI…

Human-Computer Interaction · Computer Science 2024-02-13 Zijian Ding

Deep person generation has attracted extensive research attention due to its wide applications in virtual agents, video conferencing, online shopping and art/movie production. With the advancement of deep learning, visual appearances (face,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Tong Sha , Wei Zhang , Tong Shen , Zhoujun Li , Tao Mei

This paper presents a novel method for generating diverse 3D human poses in scenes with semantic control. Existing methods heavily rely on the human-scene interaction dataset, resulting in a limited diversity of the generated human poses.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Bowen Dang , Xi Zhao