English
Related papers

Related papers: Scene-aware Generative Network for Human Motion Sy…

200 papers

Motion synthesis in real-world 3D scenes has recently attracted much attention. However, the static environment assumption made by most current methods usually cannot be satisfied especially for real-time motion synthesis in scanned point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jingyu Gong , Min Wang , Wentao Liu , Chen Qian , Zhizhong Zhang , Yuan Xie , Lizhuang Ma

We propose a novel task of text-controlled human object interaction generation in 3D scenes with movable objects. Existing human-scene interaction datasets suffer from insufficient interaction categories and typically only consider…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xinhao Cai , Minghang Zheng , Xin Jin , Yang Liu

We present a framework for video-driven crowd synthesis. Motion vectors extracted from input crowd video are processed to compute global motion paths. These paths encode the dominant motions observed in the input video. These paths are then…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Jordan Stadler , Faisal Z. Qureshi

We present a novel method to generate human motion to populate 3D indoor scenes. It can be controlled with various combinations of conditioning signals such as a path in a scene, target poses, past motions, and scenes represented as 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Nicolas Ugrinovic , Thomas Lucas , Fabien Baradel , Philippe Weinzaepfel , Gregory Rogez , Francesc Moreno-Noguer

Pedestrian motion, due to its causal nature, is strongly influenced by domain gaps arising from discrepancies between training and testing data distributions. Focusing on 3D human pose estimation, this work presents a controllable human…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xinhao Hu , Yiyi Zhang , Liqing Zhang , Jianfu Zhang

Despite remarkable advances in image synthesis research, existing works often fail in manipulating images under the context of large geometric transformations. Synthesizing person images conditioned on arbitrary poses is one of the most…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Haoye Dong , Xiaodan Liang , Ke Gong , Hanjiang Lai , Jia Zhu , Jian Yin

The significant progress on Generative Adversarial Networks (GANs) has facilitated realistic single-object image generation based on language input. However, complex-scene generation (with various interactions among multiple objects) still…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Tianyu Hua , Hongdong Zheng , Yalong Bai , Wei Zhang , Xiao-Ping Zhang , Tao Mei

We present a physics-based character control framework for synthesizing human-scene interactions. Recent advances adopt physics simulation to mitigate artifacts produced by data-driven kinematic approaches. However, existing physics-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Liang Pan , Jingbo Wang , Buzhen Huang , Junyu Zhang , Haofan Wang , Xu Tang , Yangang Wang

Modeling human-scene interactions (HSI) is essential for understanding and simulating everyday human behaviors. Recent approaches utilizing generative modeling have made progress in this domain; however, they are limited in controllability…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Inwoo Hwang , Bing Zhou , Young Min Kim , Jian Wang , Chuan Guo

In this study, we introduce a learning-based method for generating high-quality human motion sequences from text descriptions (e.g., ``A person walks forward"). Existing techniques struggle with motion diversity and smooth transitions in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Weilin Wan , Yiming Huang , Shutong Wu , Taku Komura , Wenping Wang , Dinesh Jayaraman , Lingjie Liu

We present a new pose transfer method for synthesizing a human animation from a single image of a person controlled by a sequence of body poses. Existing pose transfer methods exhibit significant visual artifacts when applying to a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Jae Shin Yoon , Lingjie Liu , Vladislav Golyanik , Kripasindhu Sarkar , Hyun Soo Park , Christian Theobalt

Human motion generation is a challenging task that aims to create realistic motion imitating natural human behaviour. We focus on the well-studied behaviour of priming an object/location for pick up or put down - that is, the spotting of an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Masashi Hatano , Saptarshi Sinha , Jacob Chalk , Wei-Hong Li , Hideo Saito , Dima Damen

Human motion synthesis is an important task in computer graphics and computer vision. While focusing on various conditioning signals such as text, action class, or audio to guide the generation process, most existing methods utilize…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Kebing Xue , Hyewon Seo

Generating human motion that satisfies customized zero-shot goal functions, enabling applications such as controllable character animation and behavior synthesis for virtual agents, is a critical capability. While current approaches handle…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Hanchao Liu , Fang-Lue Zhang , Shining Zhang , Tai-Jiang Mu , Shi-Min Hu

Generating images from semantic visual knowledge is a challenging task, that can be useful to condition the synthesis process in complex, subtle, and unambiguous ways, compared to alternatives such as class labels or text descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Renato Sortino , Simone Palazzo , Concetto Spampinato

We present GenMM, a generative model that "mines" as many diverse motions as possible from a single or few example sequences. In stark contrast to existing data-driven methods, which typically require long offline training time, are prone…

Graphics · Computer Science 2023-06-02 Weiyu Li , Xuelin Chen , Peizhuo Li , Olga Sorkine-Hornung , Baoquan Chen

Text-guided human motion generation has drawn significant interest because of its impactful applications spanning animation and robotics. Recently, application of diffusion models for motion generation has enabled improvements in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Samaneh Azadi , Akbar Shah , Thomas Hayes , Devi Parikh , Sonal Gupta

Action recognition is a relatively established task, where givenan input sequence of human motion, the goal is to predict its ac-tion category. This paper, on the other hand, considers a relativelynew problem, which could be thought of as…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Chuan Guo , Xinxin Zuo , Sen Wang , Shihao Zou , Qingyao Sun , Annan Deng , Minglun Gong , Li Cheng

Inspired by the recent advances in generative models, we introduce a human action generation model in order to generate a consecutive sequence of human motions to formulate novel actions. We propose a framework of an autoencoder and a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Mohammad Ahangar Kiasari , Dennis Singh Moirangthem , Minho Lee

Human mobility plays a crucial role in transportation, urban planning, and public health. Advances in deep learning and the availability of diverse mobility data have transformed mobility modeling. However, existing deep learning models…

Machine Learning · Computer Science 2024-11-05 Xishun Liao , Qinhua Jiang , Brian Yueshuai He , Yifan Liu , Chenchen Kuai , Jiaqi Ma