中文
相关论文

相关论文: I2V-Adapter: A General Image-to-Video Adapter for …

200 篇论文

The rapid progress of image-guided video generation (I2V) has raised concerns about its potential misuse in misinformation and fraud, underscoring the urgent need for effective digital watermarking. While existing watermarking methods…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Guanjie Wang , Zehua Ma , Han Fang , Weiming Zhang

While diffusion models have shown impressive performance in 2D image/video generation, diffusion-based Text-to-Multi-view-Video (T2MVid) generation remains underexplored. The new challenges posed by T2MVid generation lie in the lack of…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Bing Li , Cheng Zheng , Wenxuan Zhu , Jinjie Mai , Biao Zhang , Peter Wonka , Bernard Ghanem

In this paper, we focus on enhancing a diffusion-based text-to-video (T2V) model during the post-training phase by distilling a highly capable consistency model from a pretrained T2V model. Our proposed method, T2V-Turbo-v2, introduces a…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Jiachen Li , Qian Long , Jian Zheng , Xiaofeng Gao , Robinson Piramuthu , Wenhu Chen , William Yang Wang

Recent image-to-video (I2V) based video inpainting methods have made significant strides by leveraging single-image priors and modeling temporal consistency across masked frames. Nevertheless, these methods suffer from severe content…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Ming Xie , Junqiu Yu , Qiaole Dong , Xiangyang Xue , Yanwei Fu

Large-scale video generation models have demonstrated high visual realism in diverse contexts, spurring interest in their potential as general-purpose world simulators. Existing benchmarks focus on individual subjects rather than scenes…

计算机视觉与模式识别 · 计算机科学 2025-10-24 Aaron Appelle , Jerome P. Lynch

Image-to-image translation (I2I) is a fundamental task in computer vision, focused on mapping an input image from a source domain to a corresponding image in a target domain while preserving domain-invariant features and adapting…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Feiyu Tan , Heran Yang , Qihong Duan , Kai Ye , Qi Xie , Deyu Meng

Text-to-image synthesis has made significant progress, benefiting from the strong generative capabilities of diffusion models. However, these models struggle to achieve precise text-to-image alignment within cross-attention maps during the…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Shipeng Cao , Biao Qian , Haipeng Liu , Yang Wang , Meng Wang

The issue of generative pretraining for vision models has persisted as a long-standing conundrum. At present, the text-to-image (T2I) diffusion model demonstrates remarkable proficiency in generating high-definition images matching textual…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Qiang Wan , Zilong Huang , Bingyi Kang , Jiashi Feng , Li Zhang

In facial image generation, current text-to-image models often suffer from facial attribute leakage and insufficient physical consistency when responding to local semantic instructions. In this study, we propose Face-MakeUpV2, a facial…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Dawei Dai , Yinxiu Zhou , Chenghang Li , Guolai Jiang , Chengfang Zhang

Text-to-image (T2I) diffusion models have revolutionized generative modeling by producing high-fidelity, diverse, and visually realistic images from textual prompts. Despite these advances, existing models struggle with complex prompts…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Eric Hanchen Jiang , Yasi Zhang , Zhi Zhang , Yixin Wan , Andrew Lizarraga , Shufan Li , Ying Nian Wu

Preserving first-frame identity while ensuring precise motion control is a fundamental challenge in human image animation. The Image-to-Motion Binding process of the dominant Reference-to-Video (R2V) paradigm overlooks critical…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Jiaming Zhang , Shengming Cao , Rui Li , Xiaotong Zhao , Yutao Cui , Xinglin Hou , Gangshan Wu , Haolan Chen , Yu Xu , Limin Wang , Kai Ma

Existing text-to-video (T2V) models often struggle with generating videos with sufficiently pronounced or complex actions. A key limitation lies in the text prompt's inability to precisely convey intricate motion details. To address this,…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Qiang Zhou , Shaofeng Zhang , Nianzu Yang , Ye Qian , Hao Li

Text serves as the key control signal in video generation due to its narrative nature. To render text descriptions into video clips, current video diffusion models borrow features from text encoders yet struggle with limited text…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Shuai Tan , Biao Gong , Yutong Feng , Kecheng Zheng , Dandan Zheng , Shuwei Shi , Yujun Shen , Jingdong Chen , Ming Yang

Recent high-performing image-to-video (I2V) models based on variants of the diffusion transformer (DiT) have displayed remarkable inherent world-modeling capabilities by virtue of training on large scale video datasets. We investigate…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Aaron Appelle , Jerome P. Lynch

Recent video generation models have revealed the emergence of Chain-of-Frame (CoF) reasoning, enabling frame-by-frame visual inference. With this capability, video models have been successfully applied to various visual tasks (e.g., maze…

Motion transfer has emerged as a promising direction for controllable video generation, yet existing methods largely focus on single-object scenarios and struggle when multiple objects require distinct motion patterns. In this work, we…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Yuze Li , Dong Gong , Xiao Cao , Junchao Yuan , Dongsheng Li , Lei Zhou , Yun Sing Koh , Cheng Yan , Xinyu Zhang

Text-to-video (T2V) generation has gained significant attention recently. However, the costs of training a T2V model from scratch remain persistently high, and there is considerable room for improving the generation performance, especially…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Zhefan Rao , Liya Ji , Yazhou Xing , Runtao Liu , Zhaoyang Liu , Jiaxin Xie , Ziqiao Peng , Yingqing He , Qifeng Chen

Recent studies have shown that adversarial examples hand-crafted on one white-box model can be used to attack other black-box models. Such cross-model transferability makes it feasible to perform black-box attacks, which has raised security…

计算机视觉与模式识别 · 计算机科学 2021-12-13 Zhipeng Wei , Jingjing Chen , Zuxuan Wu , Yu-Gang Jiang

\textit{Nature is infinitely resolution-free}. In the context of this reality, existing diffusion models, such as Diffusion Transformers, often face challenges when processing image resolutions outside of their trained domain. To address…

机器学习 · 计算机科学 2024-10-21 ZiDong Wang , Zeyu Lu , Di Huang , Cai Zhou , Wanli Ouyang , and Lei Bai

This work introduces ArtAdapter, a transformative text-to-image (T2I) style transfer framework that transcends traditional limitations of color, brushstrokes, and object shape, capturing high-level style elements such as composition and…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Dar-Yen Chen , Hamish Tennent , Ching-Wen Hsu