中文
相关论文

相关论文: StyleCrafter: Enhancing Stylized Text-to-Video Gen…

200 篇论文

In the evolving domain of text-to-image generation, diffusion models have emerged as powerful tools in content creation. Despite their remarkable capability, existing models still face challenges in achieving controlled generation with a…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Jaeseok Jeong , Junho Kim , Yunjey Choi , Gayoung Lee , Youngjung Uh

Synthesizing motion-rich and temporally consistent videos remains a challenge in artificial intelligence, especially when dealing with extended durations. Existing text-to-video (T2V) models commonly employ spatial cross-attention for text…

计算机视觉与模式识别 · 计算机科学 2025-08-18 Jiasong Feng , Ao Ma , Jing Wang , Ke Cao , Zhanjie Zhang

Customized text-to-video generation (CTVG) has recently witnessed great progress in generating tailored videos from user-specific text. However, most CTVG methods assume that personalized concepts remain static and do not expand…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Jiahua Dong , Xudong Wang , Wenqi Liang , Zongyan Han , Meng Cao , Duzhen Zhang , Hanbin Zhao , Zhi Han , Salman Khan , Fahad Shahbaz Khan

Image generation based on text-to-image generation models is a task with practical application scenarios that fine-grained styles cannot be precisely described and controlled in natural language, while the guidance information of stylized…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Shuochen Chang

Driven by the upsurge progress in text-to-image (T2I) generation models, text-to-video (T2V) generation has experienced a significant advance as well. Accordingly, tasks such as modifying the object or changing the style in a video have…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Yeji Song , Wonsik Shin , Junsoo Lee , Jeesoo Kim , Nojun Kwak

Text-to-video (T2V) generation technology holds potential to transform multiple domains such as education, marketing, entertainment, and assistive technologies for individuals with visual or reading comprehension challenges, by creating…

图形学 · 计算机科学 2025-10-07 Nilay Kumar , Priyansh Bhandari , G. Maragatham

Large text-to-video models trained on internet-scale data have demonstrated exceptional capabilities in generating high-fidelity videos from arbitrary textual descriptions. However, adapting these models to tasks with limited…

人工智能 · 计算机科学 2023-06-06 Mengjiao Yang , Yilun Du , Bo Dai , Dale Schuurmans , Joshua B. Tenenbaum , Pieter Abbeel

Benefiting from large-scale pre-training of text-video pairs, current text-to-video (T2V) diffusion models can generate high-quality videos from the text description. Besides, given some reference images or videos, the parameter-efficient…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Xiuli Bi , Jian Lu , Bo Liu , Xiaodong Cun , Yong Zhang , Weisheng Li , Bin Xiao

With the advancement of computer vision and natural language processing, text-to-video generation, enabled by text-to-video diffusion models, has become more prevalent. These models are trained using a large amount of data from the…

机器学习 · 计算机科学 2025-08-29 Shiqi Liu , Yihua Tan

Accurate Story visualization requires several necessary elements, such as identity consistency across frames, the alignment between plain text and visual content, and a reasonable layout of objects in images. Most previous works endeavor to…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Yuan Gong , Youxin Pang , Xiaodong Cun , Menghan Xia , Yingqing He , Haoxin Chen , Longyue Wang , Yong Zhang , Xintao Wang , Ying Shan , Yujiu Yang

State-of-the-art Text-to-Video (T2V) diffusion models can generate visually impressive results, yet they still frequently fail to compose complex scenes or follow logical temporal instructions. In this paper, we argue that many errors,…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Mariam Hassan , Bastien Van Delft , Wuyang Li , Alexandre Alahi

The ability to fine-tune generative models for text-to-image generation tasks is crucial, particularly facing the complexity involved in accurately interpreting and visualizing textual inputs. While LoRA is efficient for language model…

计算机视觉与模式识别 · 计算机科学 2024-05-13 Mohan Zhou , Yalong Bai , Qing Yang , Tiejun Zhao

Collaborative driving systems leverage vehicle-to-everything (V2X) communication for multi-agent collaborative perception to enhance driving safety, yet they remain constrained by scarce annotated real-world V2X driving datasets and limited…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Yihang Tao , Yu Guo , Senkang Hu , Yanan Ma , Zihan Fang , Sam Kwong , Yuguang Fang

The text-to-video (T2V) generation models, offering convenient visual creation, have recently garnered increasing attention. Despite their substantial potential, the generated videos may present artifacts, including structural…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Jiazi Bu , Pengyang Ling , Pan Zhang , Tong Wu , Xiaoyi Dong , Yuhang Zang , Yuhang Cao , Dahua Lin , Jiaqi Wang

Previous text-to-image synthesis algorithms typically use explicit textual instructions to generate/manipulate images accurately, but they have difficulty adapting to guidance in the form of coarsely matched texts. In this work, we attempt…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Mengyao Cui , Zhe Zhu , Shao-Ping Lu , Yulu Yang

Despite the typical inversion-then-editing paradigm using text-to-image (T2I) models has demonstrated promising results, directly extending it to text-to-video (T2V) models still suffers severe artifacts such as color flickering and content…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Yukun Wang , Longguang Wang , Zhiyuan Ma , Qibin Hu , Kai Xu , Yulan Guo

Large-scale Text-to-Image (T2I) models have rapidly gained prominence across creative fields, generating visually compelling outputs from textual prompts. However, controlling these models to ensure consistent style remains challenging,…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Amir Hertz , Andrey Voynov , Shlomi Fruchter , Daniel Cohen-Or

Customized text-to-video generation aims to generate high-quality videos guided by text prompts and subject references. Current approaches for personalizing text-to-video generation suffer from tackling multiple subjects, which is a more…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Zhao Wang , Aoxue Li , Lingting Zhu , Yong Guo , Qi Dou , Zhenguo Li

Existing multi-view image generation methods often make invasive modifications to pre-trained text-to-image (T2I) models and require full fine-tuning, leading to (1) high computational costs, especially with large base models and…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Zehuan Huang , Yuan-Chen Guo , Haoran Wang , Ran Yi , Lizhuang Ma , Yan-Pei Cao , Lu Sheng

The remarkable advancement in text-to-image generation models significantly boosts the research in ID customization generation. However, existing personalization methods cannot simultaneously satisfy high fidelity and high-efficiency…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Peng Xing , Ning Wang , Jianbo Ouyang , Zechao Li