English
Related papers

Related papers: The Safety-Aware Denoiser for Text Diffusion Model…

200 papers

More and more end-to-end text spotting methods based on Transformer architecture have demonstrated superior performance. These methods utilize a bipartite graph matching algorithm to perform one-to-one optimal matching between predicted…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yu Xie , Qian Qiao , Jun Gao , Tianxiang Wu , Jiaqing Fan , Yue Zhang , Jielei Zhang , Huyang Sun

Diffusion language models expose an explicit denoising trajectory, making it possible to ask when different kinds of information become measurable during generation. We study three independent 32-step runs of LLaDA-8B-Base on masked…

Computation and Language · Computer Science 2026-04-28 Harry Lu

With the ability to generate high-quality images, text-to-image (T2I) models can be exploited for creating inappropriate content. To prevent misuse, existing safety measures are either based on text blacklists, which can be easily…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Runtao Liu , Ashkan Khakzar , Jindong Gu , Qifeng Chen , Philip Torr , Fabio Pizzati

The post-training pipeline for diffusion models currently has two stages: supervised fine-tuning (SFT) on curated data and reinforcement learning (RL) with reward models. A fundamental gap separates them. SFT optimizes the denoiser only on…

Machine Learning · Computer Science 2026-04-20 You Qin , Linqing Wang , Hao Fei , Roger Zimmermann , Liefeng Bo , Qinglin Lu , Chunyu Wang

Diffusion generative models transform noise into data by inverting a process that progressively adds noise to data samples. Inspired by concepts from the renormalization group in physics, which analyzes systems across different scales, we…

Machine Learning · Computer Science 2024-10-04 Mathis Gerdes , Max Welling , Miranda C. N. Cheng

Despite recent advances, diffusion-based text-to-image models still struggle with accurate text rendering. Several studies have proposed fine-tuning or training-free refinement methods for accurate text rendering. However, the critical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Kanghyun Baek , Sangyub Lee , Jin Young Choi , Jaewoo Song , Daemin Park , Jooyoung Choi , Chaehun Shin , Bohyung Han , Sungroh Yoon

Blind image restoration remains a significant challenge in low-level vision tasks. Recently, denoising diffusion models have shown remarkable performance in image synthesis. Guided diffusion models, leveraging the potent generative priors…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Jun Xiao , Zihang Lyu , Hao Xie , Cong Zhang , Yakun Ju , Changjian Shui , Kin-Man Lam

Many self-supervised denoising approaches have been proposed in recent years. However, these methods tend to overly smooth images, resulting in the loss of fine structures that are essential for medical applications. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2025-04-02 Basar Demir , Yikang Liu , Xiao Chen , Eric Z. Chen , Lin Zhao , Boris Mailhe , Terrence Chen , Shanhui Sun

Discrete diffusion models are a powerful, emerging paradigm for code generation. They construct programs through iterative refinement of partially corrupted token sequences and enable parallel token refinement. Importantly, this paradigm…

Computation and Language · Computer Science 2026-05-19 Lize Shao , Michael Cardei , Zichen Xie , Ferdinando Fioretto , Wenxi Wang

Despite the burst of innovative methods for controlling the diffusion process, effectively controlling image styles in text-to-image generation remains a challenging task. Many adapter-based methods impose image representation conditions on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Wen Li , Muyuan Fang , Cheng Zou , Biao Gong , Ruobing Zheng , Meng Wang , Jingdong Chen , Ming Yang

Text-to-image diffusion models can be fine-tuned in custom domains to adapt to specific user preferences, but such adaptability has also been utilized for illegal purposes, such as forging public figures' portraits, duplicating copyrighted…

Machine Learning · Computer Science 2024-11-28 Kai Huang , Haoming Wang , Wei Gao

This paper presents a novel framework for Speech Activity Detection (SAD). Inspired by the recent success of multi-task learning approaches in the speech processing domain, we propose a novel joint learning framework for SAD. We utilise…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-06 Tharindu Fernando , Sridha Sridharan , Mitchell McLaren , Darshana Priyasad , Simon Denman , Clinton Fookes

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

Machine Learning · Computer Science 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu

Video diffusion models have revolutionized generative video synthesis, but they are imprecise, slow, and can be opaque during generation -- keeping users in the dark for a prolonged period. In this work, we propose DiffusionBrowser, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Susung Hong , Chongjian Ge , Zhifei Zhang , Jui-Hsien Wang

Deformable image registration aims to precisely align medical images from different modalities or times. Traditional deep learning methods, while effective, often lack interpretability, real-time observability and adjustment capacity during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yongtai Zhuo , Yiqing Shen

Trajectory prediction is an essential component in autonomous driving, particularly for collision avoidance systems. Considering the inherent uncertainty of the task, numerous studies have utilized generative models to produce multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chen Liu , Shibo He , Haoyu Liu , Jiming Chen

The application of supervised models to clinical screening tasks is challenging due to the need for annotated data for each considered pathology. Unsupervised Anomaly Detection (UAD) is an alternative approach that aims to identify any…

Image and Video Processing · Electrical Eng. & Systems 2025-01-24 Finn Behrendt , Debayan Bhattacharya , Robin Mieling , Lennart Maack , Julia Krüger , Roland Opfer , Alexander Schlaefer

With the availability of large-scale video datasets and the advances of diffusion models, text-driven video generation has achieved substantial progress. However, existing video generation models are typically trained on a limited number of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Haonan Qiu , Menghan Xia , Yong Zhang , Yingqing He , Xintao Wang , Ying Shan , Ziwei Liu

Diffusion-based text-to-image (T2I) models enable high-quality image generation but also pose significant risks of misuse, particularly in producing not-safe-for-work (NSFW) content. While prior detection methods have focused on filtering…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Fan Yang , Yihao Huang , Jiayi Zhu , Ling Shi , Geguang Pu , Jin Song Dong , Kailong Wang

Diffusion models have garnered considerable interest in the field of text generation. Several studies have explored text diffusion models with different structures and applied them to various tasks, including named entity recognition and…

Computation and Language · Computer Science 2023-10-19 Renzhi Wang , Jing Li , Piji Li