中文
相关论文

相关论文: Identity-Preserving Text-to-Video Generation by Fr…

200 篇论文

Recent advances in large pretrained text-to-image models have shown unprecedented capabilities for high-quality human-centric generation, however, customizing face identity is still an intractable problem. Existing methods cannot ensure…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Qinghe Wang , Xu Jia , Xiaomin Li , Taiqing Li , Liqian Ma , Yunzhi Zhuge , Huchuan Lu

Text-guided 3D face synthesis has achieved remarkable results by leveraging text-to-image (T2I) diffusion models. However, most existing works focus solely on the direct generation, ignoring the editing, restricting them from synthesizing…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Yunjie Wu , Yapeng Meng , Zhipeng Hu , Lincheng Li , Haoqian Wu , Kun Zhou , Weiwei Xu , Xin Yu

In this paper, we present LaVieID, a novel \underline{l}ocal \underline{a}utoregressive \underline{vi}d\underline{e}o diffusion framework designed to tackle the challenging \underline{id}entity-preserving text-to-video task. The key idea of…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Wenhui Song , Hanhui Li , Jiehui Huang , Panwen Hu , Yuhao Cheng , Long Chen , Yiqiang Yan , Xiaodan Liang

Recent advances have demonstrated compelling capabilities in synthesizing real individuals into generated videos, reflecting the growing demand for identity-aware content creation. Nevertheless, an openly accessible framework enabling…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Yingjie Chen , Shilun Lin , Cai Xing , Binxin Yang , Long Zhou , Qixin Yan , Wenjing Wang , Dingming Liu , Hao Liu , Chen Li , Jing Lyu

Customized text-to-video generation (CTVG) has recently witnessed great progress in generating tailored videos from user-specific text. However, most CTVG methods assume that personalized concepts remain static and do not expand…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Jiahua Dong , Xudong Wang , Wenqi Liang , Zongyan Han , Meng Cao , Duzhen Zhang , Hanbin Zhao , Zhi Han , Salman Khan , Fahad Shahbaz Khan

In the paradigm of AI-generated content (AIGC), there has been increasing attention to transferring knowledge from pre-trained text-to-image (T2I) models to text-to-video (T2V) generation. Despite their effectiveness, these frameworks face…

计算机视觉与模式识别 · 计算机科学 2024-02-07 Susung Hong , Junyoung Seo , Heeseong Shin , Sunghwan Hong , Seungryong Kim

To replicate the success of text-to-image (T2I) generation, recent works employ large-scale video datasets to train a text-to-video (T2V) generator. Despite their promising results, such paradigm is computationally expensive. In this work,…

计算机视觉与模式识别 · 计算机科学 2023-03-20 Jay Zhangjie Wu , Yixiao Ge , Xintao Wang , Weixian Lei , Yuchao Gu , Yufei Shi , Wynne Hsu , Ying Shan , Xiaohu Qie , Mike Zheng Shou

The remarkable generative capabilities of diffusion models have motivated extensive research in both image and video editing. Compared to video editing which faces additional challenges in the time dimension, image editing has witnessed the…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Wenqi Ouyang , Yi Dong , Lei Yang , Jianlou Si , Xingang Pan

Existing DeepFake detection techniques primarily focus on facial manipulations, such as face-swapping or lip-syncing. However, advancements in text-to-video (T2V) and image-to-video (I2V) generative models now allow fully AI-generated…

计算机视觉与模式识别 · 计算机科学 2025-09-04 Rohit Kundu , Hao Xiong , Vishal Mohanty , Athula Balachandran , Amit K. Roy-Chowdhury

With the growing popularity of personalized human content creation and sharing, there is a rising demand for advanced techniques in customized human image generation. However, current methods struggle to simultaneously maintain the fidelity…

图形学 · 计算机科学 2025-02-21 Ye Wang , Xuping Xie , Lanjun Wang , Zili Yi , Rui Ma

Text-to-video (T2V) generation has gained significant attention due to its wide applications to video generation, editing, enhancement and translation, \etc. However, high-quality (HQ) video synthesis is extremely challenging because of the…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Tao Yang , Yangming Shi , Yunwen Huang , Feng Chen , Yin Zheng , Lei Zhang

Text-conditioned diffusion models have emerged as powerful tools for high-quality video generation. However, enabling Interactive Video Generation (IVG), where users control motion elements such as object trajectory, remains challenging.…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Ishaan Rawal , Suryansh Kumar

We present a method to create diffusion-based video models from pretrained Text-to-Image (T2I) models. Recently, AnimateDiff proposed freezing the T2I model while only training temporal layers. We advance this method by proposing a unique…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Mingi Kwon , Seoung Wug Oh , Yang Zhou , Difan Liu , Joon-Young Lee , Haoran Cai , Baqiao Liu , Feng Liu , Youngjung Uh

Despite advancements in Text-to-Video (T2V) generation, producing videos with realistic motion remains challenging. Current models often yield static or minimally dynamic outputs, failing to capture complex motions described by text. This…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Penghui Ruan , Pichao Wang , Divya Saxena , Jiannong Cao , Yuhui Shi

Large-scale text-to-image diffusion models have been a ground-breaking development in generating convincing images following an input text prompt. The goal of image editing research is to give users control over the generated images by…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Chuanming Tang , Kai Wang , Joost van de Weijer

Methods for image-to-video generation have achieved impressive, photo-realistic quality. However, adjusting specific elements in generated videos, such as object motion or camera movement, is often a tedious process of trial and error,…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Koichi Namekata , Sherwin Bahmani , Ziyi Wu , Yash Kant , Igor Gilitschenski , David B. Lindell

Producing prompt-faithful videos that preserve a user-specified identity remains challenging: models need to extrapolate facial dynamics from sparse reference while balancing the tension between identity preservation and motion naturalness.…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Yixuan Lai , He Wang , Kun Zhou , Tianjia Shao

Human-centric generative models designed for AI-driven storytelling must bring together two core capabilities: identity consistency and precise control over human performance. While recent diffusion-based approaches have made significant…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Foivos Paraperas Papantoniou , Stefanos Zafeiriou

In text-to-image models, consistent character generation is the task of achieving text alignment while maintaining the subject's appearance across different prompts. However, since style and appearance are often entangled, the existing…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Yohai Mazuz , Janna Bruner , Lior Wolf

Personalized text-to-image (P-T2I) generation aims to create new, text-guided images featuring the personalized subject with a few reference images. However, balancing the trade-off relationship between prompt fidelity and identity…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Kangyeol Kim , Wooseok Seo , Sehyun Nam , Bodam Kim , Suhyeon Jeong , Wonwoo Cho , Jaegul Choo , Youngjae Yu