English
Related papers

Related papers: Robust and Generalizable Safety Steering for Text-…

200 papers

Diffusion-based image compression has recently shown outstanding perceptual fidelity, yet its practicality is hindered by prohibitive sampling overhead and high memory usage. Most existing diffusion codecs employ U-Net architectures, where…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Junqi Shi , Ming Lu , Xingchen Li , Anle Ke , Ruiqi Zhang , Zhan Ma

ControlNet offers a powerful way to guide diffusion-based generative models, yet most implementations rely on ad-hoc heuristics to choose which network blocks to control-an approach that varies unpredictably with different tasks. To address…

Machine Learning · Computer Science 2025-02-21 Zheng Fang , Lichuan Xiang , Xu Cai , Kaicheng Zhou , Hongkai Wen

Text-to-image generation has important implications for generation of diverse and controllable images. Several attempts have been made to adapt Stable Diffusion (SD) to the medical domain. However, the large distribution difference between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Peng Huang , Xue Gao , Lihong Huang , Jing Jiao , Xiaokang Li , Yuanyuan Wang , Yi Guo

Recent advances indicate that diffusion models hold great promise in image super-resolution. While the latest methods are primarily based on latent diffusion models with convolutional neural networks, there are few attempts to explore…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Kun Cheng , Lei Yu , Zhijun Tu , Xiao He , Liyu Chen , Yong Guo , Mingrui Zhu , Nannan Wang , Xinbo Gao , Jie Hu

Personalizing text-to-image diffusion models is crucial for adapting the pre-trained models to specific target concepts, enabling diverse image generation. However, fine-tuning with few images introduces an inherent trade-off between…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sunghyun Park , Seokeon Choi , Hyoungwoo Park , Sungrack Yun

Diffusion policies have recently emerged as a powerful paradigm for visuomotor control in robotic manipulation due to their ability to model the distribution of action sequences and capture multimodality. However, iterative denoising leads…

Robotics · Computer Science 2026-05-05 Jinhao Li , Yuxuan Cong , Yingqiao Wang , Hao Xia , Shan Huang , Yijia Zhang , Ningyi Xu , Guohao Dai

This paper introduces DrDiff, a novel framework for long-text generation that overcomes the efficiency-quality trade-off through three core technologies. First, we design a dynamic expert scheduling mechanism that intelligently allocates…

Computation and Language · Computer Science 2025-10-14 Jusheng Zhang , Yijia Fan , Kaitong Cai , Zimeng Huang , Xiaofei Sun , Jian Wang , Chengpei Tang , Keze Wang

Diffusion models have emerged as a powerful approach for multimodal motion planning in autonomous driving. However, their practical deployment is typically hindered by the inherent difficulty in enforcing vehicle dynamics and a critical…

Robotics · Computer Science 2026-01-23 Rui Yang , Lei Zheng , Ruoyu Yao , Jun Ma

Guiding unconditional diffusion models typically requires either retraining with conditional inputs or per-step gradient computations (e.g., classifier-based guidance), both of which incur substantial computational overhead. We present a…

Machine Learning · Computer Science 2026-02-13 Qingsong Wang , Mikhail Belkin , Yusu Wang

Predicting the behavior of complex systems is critical in many scientific and engineering domains, and hinges on the model's ability to capture their underlying dynamics. Existing methods encode the intrinsic dynamics of high-dimensional…

Computational Engineering, Finance, and Science · Computer Science 2025-11-18 Jingwen Cheng , Ruikun Li , Huandong Wang , Yong Li

Diffusion model deployment has been suffering from high energy consumption and inference latency despite its superior performance in visual generation tasks. Dynamic voltage and frequency scaling (DVFS) offers a promising solution to…

Hardware Architecture · Computer Science 2026-04-13 Jinqi Wen , Tong Xie , Runsheng Wang , Meng Li

Diffusion models achieve superior generation quality but suffer from slow generation speed due to the iterative nature of denoising. In contrast, consistency models, a new generative family, achieve competitive performance with…

Machine Learning · Computer Science 2024-12-05 Fu-Yun Wang , Zhengyang Geng , Hongsheng Li

Recent advancements in Unet-based diffusion models, such as ControlNet and IP-Adapter, have introduced effective spatial and subject control mechanisms. However, the DiT (Diffusion Transformer) architecture still struggles with efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuxuan Zhang , Yirui Yuan , Yiren Song , Haofan Wang , Jiaming Liu

Despite their remarkable performance, modern Diffusion Transformers are hindered by substantial resource requirements during inference, stemming from the fixed and large amount of compute needed for each denoising step. In this work, we…

Diffusion Transformers (DiTs) have emerged as the dominant architecture for high-quality image and video generation, yet their iterative denoising process incurs substantial computational cost during inference. Existing caching methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Guandong Li

Text-to-image diffusion models have shown great potential for image editing, with techniques such as text-based and object-dragging methods emerging as key approaches. However, each of these methods has inherent limitations: text-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Haoran Yu , Yi Shi

Learning-based MIMO detection has shown strong empirical performance, yet existing methods typically rely on fixed-depth architectures without explicitly modeling the progressive refinement of symbol estimates. In this paper, we revisit…

Information Theory · Computer Science 2026-05-04 Nan Jiang , Jiadong Hong , Lei Liu , Xinyu Bian , Wenjie Wang , Zhaoyang Zhang

In this paper, we address the task of multimodal-to-speech generation, which aims to synthesize high-quality speech from multiple input modalities: text, video, and reference audio. This task has gained increasing attention due to its wide…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Jeongsoo Choi , Ji-Hoon Kim , Kim Sung-Bin , Tae-Hyun Oh , Joon Son Chung

Diffusion Transformer (DiT) models have achieved unprecedented quality in image and video generation, yet their iterative sampling process remains computationally prohibitive. To accelerate inference, feature caching methods have emerged by…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Guantao Chen , Shikang Zheng , Yuqi Lin , Linfeng Zhang

Text-to-image diffusion models often memorize training data, revealing a fundamental failure to generalize beyond the training set. Current mitigation strategies typically sacrifice image quality or prompt alignment to reduce memorization.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Sathwik Karnik , Juyeop Kim , Sanmi Koyejo , Jong-Seok Lee , Somil Bansal