English
Related papers

Related papers: MotionFix: Text-Driven 3D Human Motion Editing

200 papers

Human motion generation aims to produce plausible human motion sequences according to various conditional inputs, such as text or audio. Despite the feasibility of existing methods in generating motion based on short prompts and simple…

Multimedia · Computer Science 2024-11-12 Bo Han , Hao Peng , Minjing Dong , Yi Ren , Yixuan Shen , Chang Xu

Our goal is to train a generative model of 3D hand motions, conditioned on natural language descriptions specifying motion characteristics such as handshapes, locations, finger/hand/arm movements. To this end, we automatically build pairs…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Léore Bensabath , Mathis Petrovich , Gül Varol

Human motion generation aims to generate natural human pose sequences and shows immense potential for real-world applications. Substantial progress has been made recently in motion data collection technologies and generation methods, laying…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Wentao Zhu , Xiaoxuan Ma , Dongwoo Ro , Hai Ci , Jinlu Zhang , Jiaxin Shi , Feng Gao , Qi Tian , Yizhou Wang

Conditional motion generation has been extensively studied in computer vision, yet two critical challenges remain. First, while masked autoregressive methods have recently outperformed diffusion-based approaches, existing masking models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Zeyu Zhang , Yiran Wang , Wei Mao , Danning Li , Rui Zhao , Biao Wu , Zirui Song , Bohan Zhuang , Ian Reid , Richard Hartley

Texture editing is a crucial task in 3D modeling that allows users to automatically manipulate the surface materials of 3D models. However, the inherent complexity of 3D models and the ambiguous text description lead to the challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Shengqi Liu , Zhuo Chen , Jingnan Gao , Yichao Yan , Wenhan Zhu , Jiangjing Lyu , Xiaokang Yang

Text-driven human motion generation has recently attracted considerable attention, allowing models to generate human motions based on textual descriptions. However, current methods neglect the influence of human attributes-such as age,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinghan Wang , Kun Xu , Fei Li , Cao Sheng , Jiazhong Yu , Yadong Mu

Text to Motion aims to generate human motions from texts. Existing settings rely on limited Action Texts that include action labels, which limits flexibility and practicability in scenarios difficult to describe directly. This paper extends…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Runqi Wang , Caoyuan Ma , Guopeng Li , Hanrui Xu , Yuke Li , Zheng Wang

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting problems on this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Gang Li , Heliang Zheng , Chaoyue Wang , Chang Li , Changwen Zheng , Dacheng Tao

Numerous diffusion models have recently been applied to image synthesis and editing. However, editing 3D scenes is still in its early stages. It poses various challenges, such as the requirement to design specific methods for different…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Shuangkang Fang , Yufeng Wang , Yi Yang , Yi-Hsuan Tsai , Wenrui Ding , Shuchang Zhou , Ming-Hsuan Yang

This paper introduces Motion Personalization, a new task that generates personalized motions aligned with text descriptions using several basic motions containing Persona. To support this novel task, we introduce a new large-scale motion…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Boeun Kim , Hea In Jeong , JungHoon Sung , Yihua Cheng , Jeongmin Lee , Ju Yong Chang , Sang-Il Choi , Younggeun Choi , Saim Shin , Jungho Kim , Hyung Jin Chang

Generating realistic human videos remains a challenging task, with the most effective methods currently relying on a human motion sequence as a control signal. Existing approaches often use existing motion extracted from other videos, which…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Hsin-Ping Huang , Yang Zhou , Jui-Hsien Wang , Difan Liu , Feng Liu , Ming-Hsuan Yang , Zhan Xu

We present DiverseMotion, a new approach for synthesizing high-quality human motions conditioned on textual descriptions while preserving motion diversity.Despite the recent significant process in text-based human motion generation,existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yunhong Lou , Linchao Zhu , Yaxiong Wang , Xiaohan Wang , Yi Yang

Effectively measuring the similarity between two human motions is necessary for several computer vision tasks such as gait analysis, person identi- fication and action retrieval. Nevertheless, we believe that traditional approaches such as…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Huseyin Coskun , David Joseph Tan , Sailesh Conjeti , Nassir Navab , Federico Tombari

Text-to-motion generation, which translates textual descriptions into human motions, has been challenging in accurately capturing detailed user-imagined motions from simple text inputs. This paper introduces StickMotion, an efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Tao Wang , Zhihua Wu , Qiaozhi He , Jiaming Chu , Ling Qian , Yu Cheng , Junliang Xing , Jian Zhao , Lei Jin

In this work, we propose TextIM, a novel framework for synthesizing TEXT-driven human Interactive Motions, with a focus on the precise alignment of part-level semantics. Existing methods often overlook the critical roles of interactive body…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Siyuan Fan , Bo Du , Xiantao Cai , Bo Peng , Longling Sun

Text-to-motion generation requires not only grounding local actions in language but also seamlessly blending these individual actions to synthesize diverse and realistic global motions. However, existing motion generation methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Peng Jin , Hao Li , Zesen Cheng , Kehan Li , Runyi Yu , Chang Liu , Xiangyang Ji , Li Yuan , Jie Chen

Text-to-motion diffusion models can generate realistic animations from text prompts, but do not support fine-grained motion editing controls. In this paper, we present a method for using natural language to iteratively specify local edits…

Graphics · Computer Science 2024-06-04 Purvi Goel , Kuan-Chieh Wang , C. Karen Liu , Kayvon Fatahalian

Natural and expressive human motion generation is the holy grail of computer animation. It is a challenging task, due to the diversity of possible motion, human perceptual sensitivity to it, and the difficulty of accurately describing it.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Guy Tevet , Sigal Raab , Brian Gordon , Yonatan Shafir , Daniel Cohen-Or , Amit H. Bermano

Diffusion models have shown remarkable progress in text-to-audio generation. However, text-guided audio editing remains in its early stages. This task focuses on modifying the target content within an audio signal while preserving the rest,…

Sound · Computer Science 2026-04-17 Liting Gao , Yi Yuan , Yaru Chen , Yuelan Cheng , Zhenbo Li , Juan Wen , Shubin Zhang , Wenwu Wang

Text driven diffusion models have shown remarkable capabilities in editing images. However, when editing 3D scenes, existing works mostly rely on training a NeRF for 3D editing. Recent NeRF editing methods leverages edit operations by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Vivek Madhavaram , Shivangana Rawat , Chaitanya Devaguptapu , Charu Sharma , Manohar Kaul