English
Related papers

Related papers: ReToMe-VA: Recursive Token Merging for Video Diffu…

200 papers

Rapid advancements in video diffusion models have enabled the creation of realistic videos, raising concerns about unauthorized use and driving the demand for techniques to protect model ownership. Existing watermarking methods, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 MinHyuk Jang , Youngdong Jang , JaeHyeok Lee , Feng Yang , Gyeongrok Oh , Jongheon Jeong , Sangpil Kim

Diffusion Transformers (DiT) have become the de-facto model for generating high-quality visual content like videos and images. A huge bottleneck is the attention mechanism where complexity scales quadratically with resolution and video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Ruichen Chen , Keith G. Mills , Liyao Jiang , Chao Gao , Di Niu

Transfer-based adversarial example is one of the most important classes of black-box attacks. However, there is a trade-off between transferability and imperceptibility of the adversarial perturbation. Prior work in this direction often…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Fangcheng Liu , Chao Zhang , Hongyang Zhang

Diffusion-based video editing has emerged as an important paradigm for high-quality and flexible content generation. However, despite their generality and strong modeling capacity, Diffusion Transformers (DiT) remain computationally…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Tianyi Liu , Ye Lu , Linfeng Zhang , Chen Cai , Jianjun Gao , Yi Wang , Kim-Hui Yap , Lap-Pui Chau

A number of deep learning based algorithms have been proposed to recover high-quality videos from low-quality compressed ones. Among them, some restore the missing details of each frame via exploring the spatiotemporal information of…

Image and Video Processing · Electrical Eng. & Systems 2021-08-13 Minyi Zhao , Yi Xu , Shuigeng Zhou

The quadratic cost of self-attention in Vision Transformers (ViTs) constitutes a fundamental bottleneck for practical deployment, motivating a vibrant line of research on token reduction. Among existing approaches, token merging (ToMe) has…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Semi Lee , Hyejin Go , Hyesong Choi

Advanced text-to-image diffusion models raise safety concerns regarding identity privacy violation, copyright infringement, and Not Safe For Work content generation. Towards this, unlearning methods have been developed to erase these…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Xiaoxuan Han , Songlin Yang , Wei Wang , Yang Li , Jing Dong

Unrestricted adversarial attacks typically manipulate the semantic content of an image (e.g., color or texture) to create adversarial examples that are both effective and photorealistic, demonstrating their ability to deceive human…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Zhaoyu Chen , Bo Li , Shuang Wu , Kaixun Jiang , Shouhong Ding , Wenqiang Zhang

Image animation has seen significant progress, driven by the powerful generative capabilities of diffusion models. However, maintaining appearance consistency with static input images and mitigating abrupt motion transitions in generated…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xin Ma , Yaohui Wang , Genyun Jia , Xinyuan Chen , Tien-Tsin Wong , Cunjian Chen

Video restoration aims to reconstruct high quality video sequences from low quality inputs, addressing tasks such as super resolution, denoising, and deblurring. Traditional regression based methods often produce unrealistic details and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Sicheng Gao , Nancy Mehta , Zongwei Wu , Radu Timofte

In recent years, a significant amount of research efforts concentrated on adversarial attacks on images, while adversarial video attacks have seldom been explored. We propose an adversarial attack strategy on videos, called DeepSAVA. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Ronghui Mu , Wenjie Ruan , Leandro Soriano Marcolino , Qiang Ni

Large-scale transformers are central to modern semantic communication, yet their high computational and communication costs hinder deployment on resource-constrained edge devices. This paper introduces a training-free framework for adaptive…

Machine Learning · Computer Science 2025-09-15 Omar Erak , Omar Alhussein , Hatem Abou-Zeid , Mehdi Bennis , Sami Muhaidat

With the success of autoregressive learning in large language models, it has become a dominant approach for text-to-image generation, offering high efficiency and visual quality. However, invisible watermarking for visual autoregressive…

Multimedia · Computer Science 2025-03-17 Ziyi Wang , Songbai Tan , Gang Xu , Xuerui Qiu , Hongbin Xu , Xin Meng , Ming Li , Fei Richard Yu

We present TALE, a novel training-free framework harnessing the generative capabilities of text-to-image diffusion models to address the cross-domain image composition task that focuses on flawlessly incorporating user-specified objects…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Kien T. Pham , Jingye Chen , Qifeng Chen

Video Diffusion Models (VDMs) have demonstrated remarkable capabilities in synthesizing realistic videos by learning from large-scale data. Although vanilla Low-Rank Adaptation (LoRA) can learn specific spatial or temporal movement to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Yisu Zhang , Chenjie Cao , Chaohui Yu , Jianke Zhu

In Virtual Reality (VR), adversarial attack remains a significant security threat. Most deep learning-based methods for physical and digital adversarial attacks focus on enhancing attack performance by crafting adversarial examples that…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Qianyu Guo , Jiaming Fu , Yawen Lu , Dongming Gan

We introduce LTX-Video, a transformer-based latent diffusion model that adopts a holistic approach to video generation by seamlessly integrating the responsibilities of the Video-VAE and the denoising transformer. Unlike existing methods,…

The rapid evolution of Text-to-Video (T2V) diffusion models has driven remarkable advancements in generating high-quality, temporally coherent videos from natural language descriptions. Despite these achievements, their vulnerability to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Changzhen Li , Yuecong Min , Jie Zhang , Zheng Yuan , Shiguang Shan , Xilin Chen

Diffusion Transformers (DiT) trained with flow matching in a VAE latent space have unified visual generation across images and videos. A natural next step toward a single architecture for both generation (visual synthesis) and understanding…

Computation and Language · Computer Science 2026-05-11 Jiaxiu Jiang , Jingjing Ren , Wenbo Li , Bo Wang , Haoze Sun , Yijun Yang , Jianhui Liu , Yanbing Zhang , Shenghe Zheng , Yuan Zhang , Haoyang Huang , Nan Duan , Wangmeng Zuo

Diffusion models have exhibited promising progress in video generation. However, they often struggle to retain consistent details within local regions across frames. One underlying cause is that traditional diffusion models approximate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Yupu Yao , Shangqi Deng , Zihan Cao , Harry Zhang , Liang-Jian Deng