English

Stylized Text-to-Motion Generation via Hypernetwork-Driven Low-Rank Adaptation

Computer Vision and Pattern Recognition 2026-05-14 v1 Artificial Intelligence Graphics Machine Learning

Abstract

Text-driven motion diffusion models are capable of generating realistic human motions, but text alone often struggles to express fine-level nuances of motion, commonly referred to as style. Recent approaches have tackled this challenge by attaching a style injection mechanism to a pretrained text-driven diffusion model. Existing stylization methods, however, either require style-specific fine-tuning of existing models or rely on heavy ControlNet-based architectures, limiting efficiency and generalization to unseen styles. We propose a lightweight style conditioning framework that dynamically modulates a pretrained diffusion model through hypernetwork-generated LoRA parameters. A style reference motion is encoded into a global style embedding, which is mapped by a hypernetwork to low-rank updates applied at each denoising step of the diffusion model. By structuring the style latent space with a supervised contrastive loss, our framework reliably captures diverse stylistic attributes, improves generalization to unseen styles, and supports optimization-based guidance without requiring predefined style categories. Experiments on the HumanML3D and 100STYLE datasets show state-of-the-art stylization results, while achieving improved stylization for unseen styles.

Keywords

Cite

@article{arxiv.2605.13333,
  title  = {Stylized Text-to-Motion Generation via Hypernetwork-Driven Low-Rank Adaptation},
  author = {Junhyuk Jeon and Seokhyeon Hong and Junyong Noh},
  journal= {arXiv preprint arXiv:2605.13333},
  year   = {2026}
}

Comments

Accepted to SIGGRAPH 2026. Project page: https://junhyukjeon.github.io/projects/style-salad/

R2 v1 2026-07-22T07:09:50.486Z