English
Related papers

Related papers: Hierarchical Generation of Human-Object Interactio…

200 papers

Modeling and generating human reactions poses a significant challenge with broad applications for computer vision and human-computer interaction. Existing methods either treat multiple individuals as a single entity, directly generating…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xiyan Xu , Sirui Xu , Yu-Xiong Wang , Liang-Yan Gui

Vision-based human-to-robot handover is an important and challenging task in human-robot interaction. Recent work has attempted to train robot policies by interacting with dynamic virtual humans in simulated environments, where the policies…

Robotics · Computer Science 2025-01-03 Sammy Christen , Lan Feng , Wei Yang , Yu-Wei Chao , Otmar Hilliges , Jie Song

Segmenting humans in 3D indoor scenes has become increasingly important with the rise of human-centered robotics and AR/VR applications. To this end, we propose the task of joint 3D human semantic segmentation, instance segmentation and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Ayça Takmaz , Jonas Schult , Irem Kaftan , Mertcan Akçay , Bastian Leibe , Robert Sumner , Francis Engelmann , Siyu Tang

Human motion synthesis is a fundamental task in computer animation. Recent methods based on diffusion models or GPT structure demonstrate commendable performance but exhibit drawbacks in terms of slow sampling speeds and error accumulation.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Vincent Tao Hu , Wenzhe Yin , Pingchuan Ma , Yunlu Chen , Basura Fernando , Yuki M Asano , Efstratios Gavves , Pascal Mettes , Bjorn Ommer , Cees G. M. Snoek

In this paper, we address the challenging problem of long-term 3D human motion generation. Specifically, we aim to generate a long sequence of smoothly connected actions from a stream of multiple sentences (i.e., paragraph). Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Taeryung Lee , Fabien Baradel , Thomas Lucas , Kyoung Mu Lee , Gregory Rogez

In this study, we introduce a learning-based method for generating high-quality human motion sequences from text descriptions (e.g., ``A person walks forward"). Existing techniques struggle with motion diversity and smooth transitions in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Weilin Wan , Yiming Huang , Shutong Wu , Taku Komura , Wenping Wang , Dinesh Jayaraman , Lingjie Liu

Generating human-human motion interactions conditioned on textual descriptions is a very useful application in many areas such as robotics, gaming, animation, and the metaverse. Alongside this utility also comes a great difficulty in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Pablo Ruiz Ponce , German Barquero , Cristina Palmero , Sergio Escalera , Jose Garcia-Rodriguez

Can we synthesize 3D humans interacting with scenes without learning from any 3D human-scene interaction data? We propose GenZI, the first zero-shot approach to generating 3D human-scene interactions. Key to GenZI is our distillation of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Lei Li , Angela Dai

Soccer is a globally renowned sport with significant applications in video games and VR/AR. However, generating realistic soccer motions remains challenging due to the intricate interactions between the human player and the ball. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Hongdi Yang , Chengyang Li , Zhenxuan Wu , Gaozheng Li , Jingya Wang , Jingyi Yu , Zhuo Su , Lan Xu

Hypergraphs are powerful mathematical structures that can model complex, high-order relationships in various domains, including social networks, bioinformatics, and recommender systems. However, generating realistic and diverse hypergraphs…

Machine Learning · Computer Science 2026-03-11 Dorian Gailhard , Enzo Tartaglione , Lirida Naviner , Jhony H. Giraldo

3D human generation is an important problem with a wide range of applications in computer vision and graphics. Despite recent progress in generative AI such as diffusion models or rendering methods like Neural Radiance Fields or Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Maksym Ivashechkin , Oscar Mendez , Richard Bowden

Generating 3D human motions from text is a challenging yet valuable task. The key aspects of this task are ensuring text-motion consistency and achieving generation diversity. Although recent advancements have enabled the generation of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zheng Qin , Yabing Wang , Minghui Yang , Sanping Zhou , Ming Yang , Le Wang

Our goal is to populate digital environments, in which digital humans have diverse body shapes, move perpetually, and have plausible body-scene contact. The core challenge is to generate realistic, controllable, and infinitely long motions…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Yan Zhang , Siyu Tang

Generating realistic human-human interactions is a challenging task that requires not only high-quality individual body and hand motions, but also coherent coordination among all interactants. Due to limitations in available data and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Pablo Ruiz-Ponce , Sergio Escalera , José García-Rodríguez , Jiankang Deng , Rolandos Alexandros Potamias

The target duration of a synthesized human motion is a critical attribute that requires modeling control over the motion dynamics and style. Speeding up an action performance is not merely fast-forwarding it. However, state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Alessio Sampieri , Alessio Palma , Indro Spinelli , Fabio Galasso

Constructing robots to accomplish long-horizon tasks is a long-standing challenge within artificial intelligence. Approaches using generative methods, particularly Diffusion Models, have gained attention due to their ability to model…

Robotics · Computer Science 2026-04-30 Sigmund Hennum Høeg , Aksel Vaaler , Chaoqi Liu , Olav Egeland , Yilun Du

Despite advances in indoor 3D scene layout generation, synthesizing scenes with dense object arrangements remains challenging. Existing methods focus on large furniture while neglecting smaller objects, resulting in unrealistically empty…

Graphics · Computer Science 2025-12-08 Hou In Derek Pun , Hou In Ivan Tam , Austin T. Wang , Xiaoliang Huo , Angel X. Chang , Manolis Savva

We present DiverseMotion, a new approach for synthesizing high-quality human motions conditioned on textual descriptions while preserving motion diversity.Despite the recent significant process in text-based human motion generation,existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yunhong Lou , Linchao Zhu , Yaxiong Wang , Xiaohan Wang , Yi Yang

Safe and successful deployment of robots requires not only the ability to generate complex plans but also the capacity to frequently replan and correct execution errors. This paper addresses the challenge of long-horizon trajectory planning…

Robotics · Computer Science 2024-10-04 Zeyu Feng , Hao Luan , Kevin Yuchen Ma , Harold Soh

Human motion generation is a challenging task that aims to create realistic motion imitating natural human behaviour. We focus on the well-studied behaviour of priming an object/location for pick up or put down - that is, the spotting of an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Masashi Hatano , Saptarshi Sinha , Jacob Chalk , Wei-Hong Li , Hideo Saito , Dima Damen