English
Related papers

Related papers: HunyuanCustom: A Multimodal-Driven Architecture fo…

200 papers

Recent advances in video generation produce visually realistic content, yet the absence of synchronized audio severely compromises immersion. To address key challenges in video-to-audio generation, including multimodal data scarcity,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-26 Sizhe Shan , Qiulin Li , Yutao Cui , Miles Yang , Yuehai Wang , Qun Yang , Jin Zhou , Zhao Zhong

Recent advancements in video generation have significantly impacted daily life for both individuals and industries. However, the leading video generation models remain closed-source, resulting in a notable performance gap between industry…

Recent advances in diffusion-based and controllable video generation have enabled high-quality and temporally coherent video synthesis, laying the groundwork for immersive interactive gaming experiences. However, current methods face…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Jiaqi Li , Junshu Tang , Zhiyong Xu , Longhuang Wu , Yuan Zhou , Shuai Shao , Tianbao Yu , Zhiguo Cao , Qinglin Lu

Customized text-to-video generation aims to generate high-quality videos guided by text prompts and subject references. Current approaches for personalizing text-to-video generation suffer from tackling multiple subjects, which is a more…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Zhao Wang , Aoxue Li , Lingting Zhu , Yong Guo , Qi Dou , Zhenguo Li

To address key limitations in human-object interaction (HOI) video generation -- specifically the reliance on curated motion data, limited generalization to novel objects/scenarios, and restricted accessibility -- we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Ziyao Huang , Zixiang Zhou , Juan Cao , Yifeng Ma , Yi Chen , Zejing Rao , Zhiyong Xu , Hongmei Wang , Qin Lin , Yuan Zhou , Qinglin Lu , Fan Tang

Recent years have witnessed significant progress in audio-driven human animation. However, critical challenges remain in (i) generating highly dynamic videos while preserving character consistency, (ii) achieving precise emotion alignment…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yi Chen , Sen Liang , Zixiang Zhou , Ziyao Huang , Yifeng Ma , Junshu Tang , Qin Lin , Yuan Zhou , Qinglin Lu

Human-Centric Video Generation (HCVG) methods seek to synthesize human videos from multimodal inputs, including text, image, and audio. Existing methods struggle to effectively coordinate these heterogeneous modalities due to two…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Liyang Chen , Tianxiang Ma , Jiawei Liu , Bingchuan Li , Zhuowei Chen , Lijie Liu , Xu He , Gen Li , Qian He , Zhiyong Wu

While 3D generative models have greatly improved artists' workflows, the existing diffusion models for 3D generation suffer from slow generation and poor generalization. To address this issue, we propose a two-stage approach named Hunyuan3D…

Intelligent game creation represents a transformative advancement in game development, utilizing generative artificial intelligence to dynamically generate and enhance game content. Despite notable progress in generative models, the…

Recent advances in 3D-native generative models have accelerated asset creation for games, film, and design. However, most methods still rely primarily on image or text conditioning and lack fine-grained, cross-modal controls, which limits…

Most existing video diffusion models (VDMs) are limited to mere text conditions. Thereby, they are usually lacking in control over visual appearance and geometry structure of the generated videos. This work presents Moonshot, a new video…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 David Junhao Zhang , Dongxu Li , Hung Le , Mike Zheng Shou , Caiming Xiong , Doyen Sahoo

Customized text-to-video generation aims to generate text-guided videos with user-given subjects, which has gained increasing attention. However, existing works are primarily limited to single-subject oriented text-to-video generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Hong Chen , Xin Wang , Guanning Zeng , Yipeng Zhang , Yuwei Zhou , Feilin Han , Yaofei Wu , Wenwu Zhu

We introduce HunyuanPortrait, a diffusion-based condition control method that employs implicit representations for highly controllable and lifelike portrait animation. Given a single portrait image as an appearance reference and video clips…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Zunnan Xu , Zhentao Yu , Zixiang Zhou , Jun Zhou , Xiaoyu Jin , Fa-Ting Hong , Xiaozhong Ji , Junwei Zhu , Chengfei Cai , Shiyu Tang , Qin Lin , Xiu Li , Qinglin Lu

Recent video generation models demonstrate impressive synthesis capabilities but remain limited by single-modality conditioning, constraining their holistic world understanding. This stems from insufficient cross-modal interaction and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jiehui Huang , Yuechen Zhang , Xu He , Yuan Gao , Zhi Cen , Bin Xia , Yan Zhou , Xin Tao , Pengfei Wan , Jiaya Jia

We present HunyuanImage 3.0, a native multimodal model that unifies multimodal understanding and generation within an autoregressive framework, with its image generation module publicly available. The achievement of HunyuanImage 3.0 relies…

Despite recent advances in video generation, existing models still lack fine-grained controllability, especially for multi-subject customization with consistent identity and interaction. In this paper, we propose PolyVivid, a multi-subject…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Teng Hu , Zhentao Yu , Zhengguang Zhou , Jiangning Zhang , Yuan Zhou , Qinglin Lu , Ran Yi

Creating a vivid video from the event or scenario in our imagination is a truly fascinating experience. Recent advancements in text-to-video synthesis have unveiled the potential to achieve this with prompts only. While text is convenient…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Jinbo Xing , Menghan Xia , Yuxin Liu , Yuechen Zhang , Yong Zhang , Yingqing He , Hanyuan Liu , Haoxin Chen , Xiaodong Cun , Xintao Wang , Ying Shan , Tien-Tsin Wong

Video generation has witnessed remarkable progress with the advent of deep generative models, particularly diffusion models. While existing methods excel in generating high-quality videos from text prompts or single images, personalized…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yufan Deng , Xun Guo , Yizhi Wang , Jacob Zhiyuan Fang , Angtian Wang , Shenghai Yuan , Yiding Yang , Bo Liu , Haibin Huang , Chongyang Ma

Recent advances in generative world models have enabled remarkable progress in creating open-ended game environments, evolving from static scene synthesis toward dynamic, interactive simulation. However, current approaches remain limited by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Junshu Tang , Jiacheng Liu , Jiaqi Li , Longhuang Wu , Haoyu Yang , Penghao Zhao , Siruis Gong , Xiang Yuan , Shuai Shao , Linfeng Zhang , Qinglin Lu
‹ Prev 1 2 3 10 Next ›