English
Related papers

Related papers: Executing your Commands via Motion Diffusion in La…

200 papers

Recent work has demonstrated the significant potential of denoising diffusion models for generating human motion, including text-to-motion capabilities. However, these methods are restricted by the paucity of annotated motion data, a focus…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Yonatan Shafir , Guy Tevet , Roy Kapon , Amit H. Bermano

Recent work has explored a range of model families for human motion generation, including Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and diffusion-based models. Despite their differences, many methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 David Björkstrand , Tiesheng Wang , Lars Bretzner , Josephine Sullivan

Recent advances in generative models have yielded impressive progress on motion in-betweening, allowing for more complex, varied, and realistic motion transitions. However, recent methods still exhibit noticeable limitations in preserving…

Graphics · Computer Science 2026-05-14 Shiyu Fan , Paul Henderson , Edmond S. L. Ho

Diffusion models have emerged as a powerful generative method for synthesizing high-quality and diverse set of images. In this paper, we propose a video generation method based on diffusion models, where the effects of motion are modeled in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Kangfu Mei , Vishal M. Patel

Generating human-human motion interactions conditioned on textual descriptions is a very useful application in many areas such as robotics, gaming, animation, and the metaverse. Alongside this utility also comes a great difficulty in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Pablo Ruiz Ponce , German Barquero , Cristina Palmero , Sergio Escalera , Jose Garcia-Rodriguez

Generating realistic human motion sequences from text descriptions is a challenging task that requires capturing the rich expressiveness of both natural language and human motion.Recent advances in diffusion models have enabled significant…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Beibei Jing , Youjia Zhang , Zikai Song , Junqing Yu , Wei Yang

Generating sewing patterns in garment design is receiving increasing attention due to its CG-friendly and flexible-editing nature. Previous sewing pattern generation methods have been able to produce exquisite clothing, but struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Shengqi Liu , Yuhao Cheng , Zhuo Chen , Xingyu Ren , Wenhan Zhu , Lincheng Li , Mengxiao Bi , Xiaokang Yang , Yichao Yan

Generating human motion guided by conditions such as textual descriptions is challenging due to the need for datasets with pairs of high-quality motion and their corresponding conditions. The difficulty increases when aiming for finer…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Pablo Ruiz-Ponce , German Barquero , Cristina Palmero , Sergio Escalera , José García-Rodríguez

Text-guided human motion generation has drawn significant interest because of its impactful applications spanning animation and robotics. Recently, application of diffusion models for motion generation has enabled improvements in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Samaneh Azadi , Akbar Shah , Thomas Hayes , Devi Parikh , Sonal Gupta

We present a novel method to generate human motion to populate 3D indoor scenes. It can be controlled with various combinations of conditioning signals such as a path in a scene, target poses, past motions, and scenes represented as 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Nicolas Ugrinovic , Thomas Lucas , Fabien Baradel , Philippe Weinzaepfel , Gregory Rogez , Francesc Moreno-Noguer

Generating human motion from textual descriptions is a challenging task. Existing methods either struggle with physical credibility or are limited by the complexities of physics simulations. In this paper, we present \emph{ReinDiffuse} that…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Gaoge Han , Mingjiang Liang , Jinglei Tang , Yongkang Cheng , Wei Liu , Shaoli Huang

Modeling temporal characteristics and the non-stationary dynamics of body movement plays a significant role in predicting human future motions. However, it is challenging to capture these features due to the subtle transitions involved in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Yuming Feng , Zhiyang Dou , Ling-Hao Chen , Yuan Liu , Tianyu Li , Jingbo Wang , Zeyu Cao , Wenping Wang , Taku Komura , Lingjie Liu

Controllable generation of 3D human motions becomes an important topic as the world embraces digital transformation. Existing works, though making promising progress with the advent of diffusion models, heavily rely on meticulously captured…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Nhat M. Hoang , Kehong Gong , Chuan Guo , Michael Bi Mi

We introduce Efficient Motion Diffusion Model (EMDM) for fast and high-quality human motion generation. Current state-of-the-art generative diffusion models have produced impressive results but struggle to achieve fast generation without…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Wenyang Zhou , Zhiyang Dou , Zeyu Cao , Zhouyingcheng Liao , Jingbo Wang , Wenjia Wang , Yuan Liu , Taku Komura , Wenping Wang , Lingjie Liu

Human motion stylization aims to revise the style of an input motion while keeping its content unaltered. Unlike existing works that operate directly in pose space, we leverage the latent space of pretrained autoencoders as a more…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Chuan Guo , Yuxuan Mu , Xinxin Zuo , Peng Dai , Youliang Yan , Juwei Lu , Li Cheng

Time series generation is a crucial research topic in the area of decision-making systems, which can be particularly important in domains like autonomous driving, healthcare, and, notably, robotics. Recent approaches focus on learning in…

Machine Learning · Computer Science 2024-09-16 Jian Qian , Bingyu Xie , Biao Wan , Minhao Li , Miao Sun , Patrick Yin Chiang

Latent diffusion models offer an attractive alternative to discrete diffusion for non-autoregressive text generation by operating on continuous text representations and denoising entire sequences in parallel. The major challenge in latent…

Computation and Language · Computer Science 2026-05-11 Viacheslav Meshchaninov , Alexander Shabalin , Egor Chimbulatov , Nikita Gushchin , Ilya Koziev , Alexander Korotin , Dmitry Vetrov

Acting in human environments is a crucial capability for general-purpose robots, necessitating a robust understanding of natural language and its application to physical tasks. This paper seeks to harness the capabilities of diffusion…

Robotics · Computer Science 2026-04-28 Jonas Bode , Raphael Memmesheimer , Sven Behnke

Long-term human trajectory prediction is a challenging yet critical task in robotics and autonomous systems. Prior work that studied how to predict accurate short-term human trajectories with only unimodal features often failed in long-term…

Robotics · Computer Science 2024-05-31 Zhitian Zhang , Anjian Li , Angelica Lim , Mo Chen

Text-conditioned video diffusion models have emerged as a powerful tool in the realm of video generation and editing. But their ability to capture the nuances of human movement remains under-explored. Indeed the ability of these models to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Paul Janson , Tiberiu Popa , Eugene Belilovsky