中文
相关论文

相关论文: Stylized Text-to-Motion Generation via Hypernetwor…

200 篇论文

Controlling the manner in which a character moves in a real-time animation system is a challenging task with useful applications. Existing style transfer systems require access to a reference content motion clip, however, in real-time…

图形学 · 计算机科学 2022-01-13 Ian Mason , Sebastian Starke , Taku Komura

Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Wanjiang Weng , Xiaofeng Tan , Junbo Wang , Guo-Sen Xie , Pan Zhou , Hongsong Wang

Text-to-motion generation is a formidable task, aiming to produce human motions that align with the input text while also adhering to human capabilities and physical laws. While there have been advancements in diffusion models, their…

计算机视觉与模式识别 · 计算机科学 2023-08-31 Hanyang Kong , Kehong Gong , Dongze Lian , Michael Bi Mi , Xinchao Wang

Motion style transfer is a common method for enriching character animation. Motion style transfer algorithms are often designed for offline settings where motions are processed in segments. However, for online animation applications, such…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Tianxin Tao , Xiaohang Zhan , Zhongquan Chen , Michiel van de Panne

In the evolving domain of text-to-image generation, diffusion models have emerged as powerful tools in content creation. Despite their remarkable capability, existing models still face challenges in achieving controlled generation with a…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Jaeseok Jeong , Junho Kim , Yunjey Choi , Gayoung Lee , Youngjung Uh

Diffusion models have demonstrated exceptional capabilities in generating a broad spectrum of visual content, yet their proficiency in rendering text is still limited: they often generate inaccurate characters or words that fail to blend…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Jianyi Zhang , Yufan Zhou , Jiuxiang Gu , Curtis Wigington , Tong Yu , Yiran Chen , Tong Sun , Ruiyi Zhang

The dominant approach to unsupervised "style transfer" in text is based on the idea of learning a latent representation, which is independent of the attributes specifying its "style". In this paper, we show that this condition is not…

Text-to-image diffusion models generate highly detailed textures, yet they often rely on surface appearance and fail to follow strict geometric constraints, particularly when those constraints conflict with the style implied by the text…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Antara Titikhsha , Om Kulkarni , Dharun Muthaiah

Text-to-video diffusion models have enabled high-quality video synthesis, yet often fail to generate temporally coherent and physically plausible motion. A key reason is the models' insufficient understanding of complex motions that natural…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Aritra Bhowmik , Denis Korzhenkov , Cees G. M. Snoek , Amirhossein Habibian , Mohsen Ghafoorian

Diffusion models and flow matching have demonstrated remarkable success in text-to-image generation. While many existing alignment methods primarily focus on fine-tuning pre-trained generative models to maximize a given reward function,…

机器学习 · 统计学 2026-02-03 Yidong Ouyang , Liyan Xie , Hongyuan Zha , Guang Cheng

Text-to-motion generation has gained increasing attention, but most existing methods are limited to generating short-term motions that correspond to a single sentence describing a single action. However, when a text stream describes a…

计算机视觉与模式识别 · 计算机科学 2023-08-04 Zhao Yang , Bing Su , Ji-Rong Wen

The use of denoising diffusion models is becoming increasingly popular in the field of image editing. However, current approaches often rely on either image-guided methods, which provide a visual reference but lack control over semantic…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Zhanbo Feng , Zenan Ling , Xinyu Lu , Ci Gong , Feng Zhou , Wugedele Bao , Jie Li , Fan Yang , Robert C. Qiu

Diffusion models, particularly latent diffusion models, have demonstrated remarkable success in text-driven human motion generation. However, it remains challenging for latent diffusion models to effectively compose multiple semantic…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Jianrong Zhang , Hehe Fan , Yi Yang

Despite the success of style transfer in image processing, it has seen limited progress in natural language generation. Part of the problem is that content is not as easily decoupled from style in the text domain. Curiously, in the field of…

计算与语言 · 计算机科学 2019-11-11 Katy Gero , Chris Kedzie , Jonathan Reeve , Lydia Chilton

Recent advances in latent diffusion models have demonstrated state-of-the-art performance in high-dimensional time-series data synthesis while providing flexible control through conditioning and guidance. However, existing methodologies…

机器学习 · 计算机科学 2025-11-11 Matteo Pettenó , Alessandro Ilic Mezza , Alberto Bernardini

Synthetic data offers a promising solution for mitigating data scarcity and demographic bias in mental health analysis, yet existing approaches largely rely on pretrained large language models (LLMs), which may suffer from limited output…

计算与语言 · 计算机科学 2026-01-21 Saad Mankarious , Aya Zirikly

In this paper, we presents a novel method for improving text-to-image generation by combining Large Language Models (LLMs) with diffusion models, a hybrid approach aimed at achieving both higher quality and efficiency in image synthesis…

计算与语言 · 计算机科学 2025-02-04 Julian Perry , Frank Sanders , Carter Scott

We present TeSMo, a method for text-controlled scene-aware motion generation based on denoising diffusion models. Previous text-to-motion methods focus on characters in isolation without considering scenes due to the limited availability of…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Hongwei Yi , Justus Thies , Michael J. Black , Xue Bin Peng , Davis Rempe

The objective of personalization and stylization in text-to-image is to instruct a pre-trained diffusion model to analyze new concepts introduced by users and incorporate them into expected styles. Recently, parameter-efficient fine-tuning…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Likun Li , Haoqi Zeng , Changpeng Yang , Haozhe Jia , Di Xu

In this paper, we present DesignDiffusion, a simple yet effective framework for the novel task of synthesizing design images from textual descriptions. A primary challenge lies in generating accurate and style-consistent textual and visual…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Zhendong Wang , Jianmin Bao , Shuyang Gu , Dong Chen , Wengang Zhou , Houqiang Li