English
Related papers

Related papers: Mechanistic Interpretability of Diffusion Models: …

200 papers

Deep learning-based models generalize better to unknown data samples after being guided "where to look" by incorporating human perception into training strategies. We made an observation that the entropy of the model's salience trained in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Jacob Piland , Adam Czajka , Christopher Sweet

Understanding how generative models represent and transform data is a foundational problem in deep learning interpretability. While mechanistic interpretability of discriminative architectures has yielded substantial insights, relatively…

Machine Learning · Computer Science 2026-04-07 Dip Roy , Rajiv Misra , Sanjay Kumar Singh , Anisha Roy

Recognizing the expressions of partially occluded faces is a challenging computer vision problem. Previous expression recognition methods, either overlooked this issue or resolved it using extreme assumptions. Motivated by the fact that the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Hui Ding , Peng Zhou , Rama Chellappa

While real-time image generation using diffusion models has advanced rapidly on NVIDIA GPUs, systematic optimization research on non-CUDA platforms such as Apple Silicon remains extremely limited. In this study, we conducted comprehensive…

Machine Learning · Computer Science 2026-05-19 Yoichi Ochiai

Diffusion models have shown impressive performance for generative modelling of images. In this paper, we present a novel semantic segmentation method based on diffusion models. By modifying the training and sampling scheme, we show that…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Julia Wolleb , Robin Sandkühler , Florentin Bieder , Philippe Valmaggia , Philippe C. Cattin

Diffusion models have established themselves as state-of-the-art generative models across various data modalities, including images and videos, due to their ability to accurately approximate complex data distributions. Unlike traditional…

Machine Learning · Computer Science 2025-10-23 Daniel Wesego

Diffusion models have recently shown strong progress in generative tasks, offering a more stable alternative to GAN-based approaches for makeup transfer. Existing methods often suffer from limited datasets, poor disentanglement between…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Qihe Pan , Yiming Wu , Xing Zhao , Liang Xie , Guodao Sun , Ronghua Liang

This thesis presents novel contributions in two primary areas: advancing the efficiency of generative models, particularly normalizing flows, and applying generative models to solve real-world computer vision challenges. The first part…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Sandeep Nagar

Diffusion probabilistic models (DPMs) have achieved remarkable quality in image generation that rivals GANs'. But unlike GANs, DPMs use a set of latent variables that lack semantic meaning and cannot serve as a useful representation for…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Konpat Preechakul , Nattanat Chatthee , Suttisak Wizadwongsa , Supasorn Suwajanakorn

We present a technique for efficiently synthesizing images of atmospheric clouds using a combination of Monte Carlo integration and neural networks. The intricacies of Lorenz-Mie scattering and the high albedo of cloud-forming aerosols make…

Machine Learning · Computer Science 2017-09-19 Simon Kallweit , Thomas Müller , Brian McWilliams , Markus Gross , Jan Novák

Real-world image super-resolution (Real-ISR) must handle complex degradations and inherent reconstruction ambiguities. While generative models have improved perceptual quality, a key trade-off remains with computational cost. One-step…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Yun Kai Zhuang

Limited by the encoder-decoder architecture, learning-based edge detectors usually have difficulty predicting edge maps that satisfy both correctness and crispness. With the recent success of the diffusion probabilistic model (DPM), we…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yunfan Ye , Kai Xu , Yuhang Huang , Renjiao Yi , Zhiping Cai

Diffusion models have become the go-to method for text-to-image generation, producing high-quality images from pure noise. However, the inner workings of diffusion models is still largely a mystery due to their black-box nature and complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Berk Tinaz , Zalan Fabian , Mahdi Soltanolkotabi

Data imputation and data generation have important applications for many domains, like healthcare and finance, where incomplete or missing data can hinder accurate analysis and decision-making. Diffusion models have emerged as powerful…

Machine Learning · Computer Science 2025-06-10 Mario Villaizán-Vallelado , Matteo Salvatori , Carlos Segura , Ioannis Arapakis

Diffusion models have revolutionized generative modeling, enabling unprecedented realism in image and video synthesis. This success has sparked interest in leveraging their representations for visual understanding tasks. While recent works…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Pedro Vélez , Luisa F. Polanía , Yi Yang , Chuhan Zhang , Rishabh Kabra , Anurag Arnab , Mehdi S. M. Sajjadi

Facial expression recognition is vital for human behavior analysis, and deep learning has enabled models that can outperform humans. However, it is unclear how closely they mimic human processing. This study aims to explore the similarity…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 F. Xavier Gaya-Morey , Silvia Ramis-Guarinos , Cristina Manresa-Yee , Jose M. Buades-Rubio

Despite the notable accomplishments of deep object detection models, a major challenge that persists is the requirement for extensive amounts of training data. The process of procuring such real-world data is a laborious undertaking, which…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Roy Voetman , Maya Aghaei , Klaas Dijkstra

Complex degradations like noise, blur, and low resolution are typical challenges in real world image fusion tasks, limiting the performance and practicality of existing methods. End to end neural network based approaches are generally…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yu Shi , Yu Liu , Zhong-Cheng Wu , Juan Cheng , Huafeng Li , Xun Chen

Denoising diffusion probabilistic models have recently received much research attention since they outperform alternative approaches, such as GANs, and currently provide state-of-the-art generative performance. The superior performance of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Dmitry Baranchuk , Ivan Rubachev , Andrey Voynov , Valentin Khrulkov , Artem Babenko

Diffusion models achieve remarkable quality in image generation, but at a cost. Iterative denoising requires many time steps to produce high fidelity images. We argue that the denoising process is crucially limited by an accumulation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Hui Lu , Albert ali Salah , Ronald Poppe