English
Related papers

Related papers: Skeleton2Stage: Reward-Guided Fine-Tuning for Phys…

200 papers

Human motion synthesis is a long-standing problem with various applications in digital twins and the Metaverse. However, modern deep learning based motion synthesis approaches barely consider the physical plausibility of synthesized motions…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yunhao Li , Zhenbo Yu , Yucheng Zhu , Bingbing Ni , Guangtao Zhai , Wei Shen

Despite significant advances in video generation, synthesizing physically plausible human actions remains a persistent challenge, particularly in modeling fine-grained semantics and complex temporal dynamics. For instance, generating…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Dian Shao , Mingfei Shi , Shengda Xu , Haodong Chen , Yongle Huang , Binglu Wang

Generating realistic human motion is a central yet unsolved challenge in video generation. While reinforcement learning (RL)-based post-training has driven recent gains in general video quality, extending it to human motion remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yidong Huang , Zun Wang , Han Lin , Dong-Ki Kim , Shayegan Omidshafiei , Jaehong Yoon , Jaemin Cho , Yue Zhang , Mohit Bansal

With the growing interest in motion imitation learning (IL) for human biomechanics and wearable robotics, this study investigates how additional foot-ground interaction measures, used as reward terms, affect human gait kinematics and…

Robotics · Computer Science 2026-03-16 Xinyi Liu , Jangwhan Ahn , Edgar Lobaton , Jennie Si , He Huang

Animation of 2D hand-drawn sketches provides an effective medium for visual communication. However, these sketches pose challenges, particularly in handling occlusions and accurately mapping motion. While 3D animation naturally addresses…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Gaurav Rai , Ojaswa Sharma

Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Sashuai Zhou , Qiang Zhou , Junpeng Ma , Yue Cao , Ruofan Hu , Ziang Zhang , Xiaoda Yang , Zhibin Wang , Jun Song , Cheng Yu , Bo Zheng , Zhou Zhao

The application of machine-learning solutions to movement assessment from skeleton videos has attracted significant research attention in recent years. This advancement has made rehabilitation at home more accessible, utilizing movement…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Tal Hakim

Generating videos of complex human motions such as flips, cartwheels, and martial arts remains challenging for current video diffusion models. Text-only conditioning is temporally ambiguous for fine-grained motion control, while explicit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Ashkan Taghipour , Morteza Ghahremani , Zinuo Li , Hamid Laga , Farid Boussaid , Mohammed Bennamoun

Learning behavior in legged robots presents a significant challenge due to its inherent instability and complex constraints. Recent research has proposed the use of a large language model (LLM) to generate reward functions in reinforcement…

Robotics · Computer Science 2025-07-01 Runhao Zeng , Dingjie Zhou , Qiwei Liang , Junlin Liu , Hui Li , Changxin Huang , Jianqiang Li , Xiping Hu , Fuchun Sun

Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Wanjiang Weng , Xiaofeng Tan , Junbo Wang , Guo-Sen Xie , Pan Zhou , Hongsong Wang

Recent advances in video diffusion models have remarkably improved camera-controlled video generation, but most methods rely solely on supervised fine-tuning (SFT), leaving online reinforcement learning (RL) post-training largely…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Zhaoqing Wang , Xiaobo Xia , Zhuolin Bie , Jinlin Liu , Dongdong Yu , Jia-Wang Bian , Changhu Wang

While recent 3D generative models can produce high-quality texture images, they often fail to capture human preferences or meet task-specific requirements. Moreover, a core challenge in the 3D texture generation domain is that most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 AmirHossein Zamani , Tianhao Xie , Amir G. Aghdam , Tiberiu Popa , Eugene Belilovsky

4D generation has made remarkable progress in synthesizing dynamic 3D objects from input text, images, or videos. However, existing methods often represent motion as an implicit deformation field, which limits direct control and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Lifan Wu , Ruijie Zhu , Yubo Ai , Tianzhu Zhang

Human motion generation has been widely studied due to its crucial role in areas such as digital humans and humanoid robot control. However, many current motion generation approaches disregard physics constraints, frequently resulting in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Zhuo Li , Mingshuang Luo , Ruibing Hou , Xin Zhao , Hao Liu , Hong Chang , Zimo Liu , Chen Li

Skeleton-based human action recognition is a powerful approach for understanding human behaviour from pose data, but collecting large-scale, diverse, and well-annotated 3D skeleton datasets is both expensive and labor-intensive. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Xu Dong , Wanqing Li , Anthony Adeyemi-Ejeye , Andrew Gilbert

This paper presents an Exploratory 3D Dance generation framework, E3D2, designed to address the exploration capability deficiency in existing music-conditioned 3D dance generation models. Current models often generate monotonous and…

Human-Computer Interaction · Computer Science 2023-12-19 Zilin Wang , Haolin Zhuang , Lu Li , Yinmin Zhang , Junjie Zhong , Jun Chen , Yu Yang , Boshi Tang , Zhiyong Wu

Long-horizon precision manipulation in laboratory automation, such as pipette tip attachment and liquid transfer, requires policies that respect strict procedural logic while operating in continuous, high-dimensional state spaces. However,…

Robotics · Computer Science 2026-03-03 Yibo Qiu , Shu'ang Sun , Haoliang Ye , Ronald X Xu , Mingzhai Sun

Text-to-motion generation has advanced with diffusion- and flow-based generative models, yet supervised pretraining remains insufficient to align models with high-level objectives such as semantic consistency, realism, and human preference.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xiaofeng Tan , Wanjiang Weng , Hongsong Wang , Fang Zhao , Xin Geng , Liang Wang

Skeleton generation is essential for animating 3D assets, but current deep learning methods remain limited: they cannot handle the growing structural complexity of modern models and offer minimal controllability, creating a major bottleneck…

Computational dance generation is crucial in many areas, such as art, human-computer interaction, virtual reality, and digital entertainment, particularly for generating coherent and expressive long dance sequences. Diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Hongsong Wang , Yin Zhu , Qiuxia Lai , Yang Zhang , Guo-Sen Xie , Xin Geng
‹ Prev 1 2 3 10 Next ›