English
Related papers

Related papers: Robust and Generalizable Safety Steering for Text-…

200 papers

Diffusion Transformers (DiT)-based video generation models with 3D full attention exhibit strong generative capabilities. Trajectory control represents a user-friendly task in the field of controllable video generation. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Cheng Lei , Jiayu Zhang , Yue Ma , Xinyu Wang , Long Chen , Liang Tang , Yiqiang Yan , Fei Su , Zhicheng Zhao

Recently, stable diffusion (SD) models have typically flourished in the field of image synthesis and personalized editing, with a range of photorealistic and unprecedented images being successfully generated. As a result, widespread…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Zhiyuan Ma , Guoli Jia , Biqing Qi , Bowen Zhou

Diffusion Transformer (DiT), an emerging diffusion model for visual generation, has demonstrated superior performance but suffers from substantial computational costs. Our investigations reveal that these costs primarily stem from the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Wangbo Zhao , Yizeng Han , Jiasheng Tang , Kai Wang , Hao Luo , Yibing Song , Gao Huang , Fan Wang , Yang You

While the diffusion transformer (DiT) has become a focal point of interest in recent years, its application in low-light image enhancement remains a blank area for exploration. Current methods recover the details from low-light images while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xiangchen Yin , Zhenda Yu , Longtao Jiang , Xin Gao , Xiao Sun , Zhi Liu , Xun Yang

Transformer-based architectures have become the dominant paradigm for Continuous-Time Dynamic Graph (CTDG) learning, yet their performance remains limited on temporally shifted datasets. In this work, we identify attention dispersion as a…

Machine Learning · Computer Science 2026-05-18 Jinhao Zhang , Kangfei Zhao , Qiuhao Zeng , Long-Kai Huang

Diffusion models (DMs) have demonstrated exceptional performance in text-to-image tasks, leading to their widespread use. With the introduction of classifier-free guidance (CFG), the quality of images generated by DMs is significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Jiadong Pan , Liang Li , Hongcheng Gao , Zheng-Jun Zha , Qingming Huang , Jiebo Luo

Text-to-Image (T2I) diffusion models have demonstrated significant advancements in generating high-quality images, while raising potential safety concerns regarding harmful content generation. Safety-guidance-based methods have been…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yongli Xiang , Ziming Hong , Zhaoqing Wang , Xiangyu Zhao , Bo Han , Tongliang Liu

Large-scale text-to-image (T2I) diffusion models excel at open-domain synthesis but still struggle with precise text rendering, especially for multi-line layouts, dense typography, and long-tailed scripts such as Chinese. Prior solutions…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Ruiqiang Zhang , Hengyi Wang , Chang Liu , Guanjie Wang , Zehua Ma , Weiming Zhang

Recent work on text diffusion models offers a promising alternative to autoregressive generation, but controlling their safety remains underexplored. Existing safety approaches are geared toward autoregressive models and typically rely on…

Machine Learning · Computer Science 2026-05-12 Amman Yusuf , Zhejun Jiang , Mijung Park

Diffusion Transformers (DiTs) excel at generation, but their global self-attention makes controllable, reference-image-based editing a distinct challenge. Unlike U-Nets, naively injecting local appearance into a DiT can disrupt its holistic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Shengrong Gu , Ye Wang , Song Wu , Rui Ma , Qian Wang , Lanjun Wang , Zili Yi

Semantic communication enhances transmission efficiency by conveying semantic information rather than raw input symbol sequences. Task-oriented semantic communication is a variant that tries to retains only task-specific information, thus…

Cryptography and Security · Computer Science 2025-10-06 Xuesong Wang , Mo Li , Xingyan Shi , Zhaoqian Liu , Shenghao Yang

Diffusion Transformers (DiT) have demonstrated remarkable generative capabilities but remain highly computationally expensive. Previous acceleration methods, such as pruning and distillation, typically rely on a fixed computational…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jiangshan Wang , Zeqiang Lai , Jiarui Chen , Jiayi Guo , Hang Guo , Xiu Li , Xiangyu Yue , Chunchao Guo

Stable Diffusion is a recent open-source image generation model comparable to proprietary models such as DALLE, Imagen, or Parti. Stable Diffusion comes with a safety filter that aims to prevent generating explicit images. Unfortunately,…

Artificial Intelligence · Computer Science 2022-11-11 Javier Rando , Daniel Paleka , David Lindner , Lennart Heim , Florian Tramèr

We present StableMotion, a novel framework leverages knowledge (geometry and content priors) from pretrained large-scale image diffusion models to perform motion estimation, solving single-image-based image rectification tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Ziyi Wang , Haipeng Li , Lin Sui , Tianhao Zhou , Hai Jiang , Lang Nie , Shuaicheng Liu

StableDiffusion is a revolutionary text-to-image generator that is causing a stir in the world of image generation and editing. Unlike traditional methods that learn a diffusion model in pixel space, StableDiffusion learns a diffusion model…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Zixin Zhu , Xuelu Feng , Dongdong Chen , Jianmin Bao , Le Wang , Yinpeng Chen , Lu Yuan , Gang Hua

Discrete diffusion models are a new class of text generators that offer advantages such as bidirectional context use, parallelizable generation, and flexible prompting compared to autoregressive models. However, a critical limitation of…

Machine Learning · Computer Science 2025-10-23 Andrew Zhang , Anushka Sivakumar , Chiawei Tang , Chris Thomas

Shared autonomy in driving requires anticipating human behavior, flagging risk before it becomes unavoidable, and transferring control safely and smoothly. We propose Diffusion-SAFE, a closed-loop framework built on two diffusion models: an…

Robotics · Computer Science 2026-03-10 Yunxin Fan , Monroe Kennedy

Understanding foggy image sequence in the driving scenes is critical for autonomous driving, but it remains a challenging task due to the difficulty in collecting and annotating real-world images of adverse weather. Recently, the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Liang Liao , Wenyi Chen , Jing Xiao , Zheng Wang , Chia-Wen Lin , Shin'ichi Satoh

Stable Diffusion is a popular Transformer-based model for image generation from text; it applies an image information creator to the input text and the visual knowledge is added in a step-by-step fashion to create an image that corresponds…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Zhen Gao , Lini Yuan , Pedro Reviriego , Shanshan Liu , Fabrizio Lombardi

Recent Text-to-Image (T2I) models based on rectified-flow transformers (e.g., SD3, FLUX) achieve high generative fidelity but remain vulnerable to unsafe semantics, especially when triggered by multi-token interactions. Existing mitigation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Xiang Yang , Feifei Li , Mi Zhang , Geng Hong , Xiaoyu You , Min Yang