English
Related papers

Related papers: VideoShield: Regulating Diffusion-based Video Gene…

200 papers

Although powerful for image generation, consistent and controllable video is a longstanding problem for diffusion models. Video models require extensive training and computational resources, leading to high costs and large environmental…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Muhammad Haaris Khan , Hadrien Reynaud , Bernhard Kainz

Text-to-video generation aims to produce a video based on a given prompt. Recently, several commercial video models have been able to generate plausible videos with minimal noise, excellent details, and high aesthetic scores. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Haoxin Chen , Yong Zhang , Xiaodong Cun , Menghan Xia , Xintao Wang , Chao Weng , Ying Shan

Latent Diffusion Models (LDMs) have established themselves as powerful tools in the rapidly evolving field of image generation, capable of producing highly realistic images. However, their widespread adoption raises critical concerns about…

Cryptography and Security · Computer Science 2026-01-28 Zhonghao Yang , Linye Lyu , Xuanhang Chang , Daojing He , YU LI

AI-generated video has advanced rapidly and poses serious challenges to content security and forensic analysis. Existing detectors rely mainly on pixel-level visual cues and generalize poorly to unseen generators. We propose DBINDS, a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Yanlin Wu , Xiaogang Yuan , Dezhi An

Image-to-video generation, which aims to generate a video starting from a given reference image, has drawn great attention. Existing methods try to extend pre-trained text-guided image diffusion models to image-guided video generation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Cong Wang , Jiaxi Gu , Panwen Hu , Songcen Xu , Hang Xu , Xiaodan Liang

Text-based diffusion models have exhibited remarkable success in generation and editing, showing great promise for enhancing visual content with their generative prior. However, applying these models to video super-resolution remains…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Shangchen Zhou , Peiqing Yang , Jianyi Wang , Yihang Luo , Chen Change Loy

The rapid proliferation of AI-generated images necessitates effective watermarking techniques to protect intellectual property and detect fraudulent content. While existing training-based watermarking methods show promise, they often…

Machine Learning · Computer Science 2025-02-18 Lu Zhang , Liang Zeng

Large-scale text-to-video diffusion models have demonstrated an exceptional ability to synthesize diverse videos. However, due to the lack of extensive text-to-video datasets and the necessary computational resources for training, directly…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Nisha Huang , Yuxin Zhang , Weiming Dong

Text-conditioned image-to-video generation (TI2V) aims to synthesize a realistic video starting from a given image (e.g., a woman's photo) and a text description (e.g., "a woman is drinking water."). Existing TI2V frameworks often require…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Haomiao Ni , Bernhard Egger , Suhas Lohit , Anoop Cherian , Ye Wang , Toshiaki Koike-Akino , Sharon X. Huang , Tim K. Marks

Modern text-to-video synthesis models demonstrate coherent, photorealistic generation of complex videos from a text description. However, most existing models lack fine-grained control over camera movement, which is critical for downstream…

The advancement of diffusion models has enhanced the realism of AI-generated content but also raised concerns about misuse, necessitating robust copyright protection and tampering localization. Although recent methods have made progress…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Haoxin Yang , Bangzhen Liu , Xuemiao Xu , Cheng Xu , Yuyang Yu , Zikai Huang , Yi Wang , Shengfeng He

Multimedia generation approaches occupy a prominent place in artificial intelligence research. Text-to-image models achieved high-quality results over the last few years. However, video synthesis methods recently started to develop. This…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Vladimir Arkhipkin , Zein Shaheen , Viacheslav Vasilev , Elizaveta Dakhova , Andrey Kuznetsov , Denis Dimitrov

Zero-shot, training-free, image-based text-to-video generation is an emerging area that aims to generate videos using existing image-based diffusion models. Current methods in this space require specific architectural changes to image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Diljeet Jagpal , Xi Chen , Vinay P. Namboodiri

With the rapid development of AI-generated content (AIGC), video generation has emerged as one of its most dynamic and impactful subfields. In particular, the advancement of video generation foundation models has led to growing demand for…

Customized text-to-video generation aims to generate text-guided videos with user-given subjects, which has gained increasing attention. However, existing works are primarily limited to single-subject oriented text-to-video generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Hong Chen , Xin Wang , Guanning Zeng , Yipeng Zhang , Yuwei Zhou , Feilin Han , Yaofei Wu , Wenwu Zhu

Watermarking the outputs of generative models has emerged as a promising approach for tracking their provenance. Despite significant interest in autoregressive image generation models and their potential for misuse, no prior work has…

Machine Learning · Computer Science 2025-10-24 Nikola Jovanović , Ismail Labiad , Tomáš Souček , Martin Vechev , Pierre Fernandez

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li

Despite substantial progress in text-to-video generation, achieving precise and flexible control over fine-grained spatiotemporal attributes remains a significant unresolved challenge in video generation research. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Xu Zhang , Hao Zhou , Haoming Qin , Xiaobin Lu , Jiaxing Yan , Guanzhong Wang , Zeyu Chen , Yi Liu

Recent advances in diffusion models have successfully enabled text-guided image inpainting. While it seems straightforward to extend such editing capability into the video domain, there have been fewer works regarding text-guided video…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhixing Zhang , Bichen Wu , Xiaoyan Wang , Yaqiao Luo , Luxin Zhang , Yinan Zhao , Peter Vajda , Dimitris Metaxas , Licheng Yu

Text-to-image diffusion models, which are theoretically equivalent to score-based generative models, generate images through a multi-step denoising process guided by text embeddings extracted from pretrained vision-language models such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Seung Hyuk Lee , Songkuk Kim