English
Related papers

Related papers: Mechanistic Interpretability of Diffusion Models: …

200 papers

Deep neural perception and control networks are likely to be a key component of self-driving vehicles. These models need to be explainable - they should provide easy-to-interpret rationales for their behavior - so that passengers, insurance…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Jinkyu Kim , John Canny

Recent advances in computer vision have led to significant progress in the generation of realistic image data, with denoising diffusion probabilistic models proving to be a particularly effective method. In this study, we demonstrate that…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Dennis Eschweiler , Rüveyda Yilmaz , Matisse Baumann , Ina Laube , Rijo Roy , Abin Jose , Daniel Brückner , Johannes Stegmaier

The class-conditional image generation based on diffusion models is renowned for generating high-quality and diverse images. However, most prior efforts focus on generating images for general categories, e.g., 1000 classes in ImageNet-1k. A…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ziying Pan , Kun Wang , Gang Li , Feihong He , Yongxuan Lai

Facial image inpainting, with high-fidelity preservation for image realism, is a very challenging task. This is due to the subtle texture in key facial features (component) that are not easily transferable. Many image inpainting techniques…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Jireh Jam , Connah Kendrick , Vincent Drouard , Kevin Walker , Moi Hoon Yap

We introduce a deep appearance model for rendering the human face. Inspired by Active Appearance Models, we develop a data-driven rendering pipeline that learns a joint representation of facial geometry and appearance from a multiview…

Graphics · Computer Science 2018-08-02 Stephen Lombardi , Jason Saragih , Tomas Simon , Yaser Sheikh

Diffusion models, widely used in image generation, rely on iterative refinement to generate images from noise. Understanding this data evolution is important for model development and interpretability, yet challenging due to its…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Vidya Prasad , Hans van Gorp , Christina Humer , Ruud J. G. van Sloun , Anna Vilanova , Nicola Pezzotti

Deep generative models, while revolutionizing fields like image and text generation, largely operate as opaque ``black boxes'', hindering human understanding, control, and alignment. While methods like sparse autoencoders (SAEs) show…

Machine Learning · Computer Science 2026-04-03 Lingjing Kong , Shaoan Xie , Guangyi Chen , Yuewen Sun , Xiangchen Song , Eric P. Xing , Kun Zhang

Collective insights from a group of experts have always proven to outperform an individual's best diagnostic for clinical tasks. For the task of medical image segmentation, existing research on AI-based alternatives focuses more on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Aimon Rahman , Jeya Maria Jose Valanarasu , Ilker Hacihaliloglu , Vishal M Patel

Diffusion Models are probabilistic models that create realistic samples by simulating the diffusion process, gradually adding and removing noise from data. These models have gained popularity in domains such as image processing, speech…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Md Manjurul Ahsan , Shivakumar Raman , Yingtao Liu , Zahed Siddique

Single-particle trajectories measured in microscopy experiments contain important information about dynamic processes undergoing in a range of materials including living cells and tissues. However, extracting that information is not a…

Quantitative Methods · Quantitative Biology 2019-09-25 Patrycja Kowalek , Hanna Loch-Olszewska , Janusz Szwabiński

The entropy of the codes usually serves as the rate loss in the recent learned lossy image compression methods. Precise estimation of the probabilistic distribution of the codes plays a vital role in the performance. However, existing deep…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 Mu Li , Kai Zhang , Wangmeng Zuo , Radu Timofte , David Zhang

This study investigates human-computer interface generation based on diffusion models to overcome the limitations of traditional template-based design and fixed rule-driven methods. It first analyzes the key challenges of interface…

Human-Computer Interaction · Computer Science 2026-01-13 Rui Liu , Liuqingqing Yang , Runsheng Zhang , Shixiao Wang

Generative models have been widely studied in computer vision. Recently, diffusion models have drawn substantial attention due to the high quality of their generated images. A key desired property of image generative models is the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Qiucheng Wu , Yujian Liu , Handong Zhao , Ajinkya Kale , Trung Bui , Tong Yu , Zhe Lin , Yang Zhang , Shiyu Chang

2D portrait animation has experienced significant advancements in recent years. Much research has utilized the prior knowledge embedded in large generative diffusion models to enhance high-quality image manipulation. However, most methods…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Xinya Ji , Gaspard Zoss , Prashanth Chandran , Lingchen Yang , Xun Cao , Barbara Solenthaler , Derek Bradley

The ability to recognize facial expressions automatically enables novel applications in human-computer interaction and other areas. Consequently, there has been active research in this field, with several recent works utilizing…

Computer Vision and Pattern Recognition · Computer Science 2016-12-12 Christopher Pramerdorfer , Martin Kampel

We propose a novel approach for estimating the difficulty and transferability of supervised classification tasks. Unlike previous work, our approach is solution agnostic and does not require or assume trained models. Instead, we estimate…

Machine Learning · Computer Science 2019-08-23 Anh T. Tran , Cuong V. Nguyen , Tal Hassner

Current perceptive models heavily depend on resource-intensive datasets, prompting the need for innovative solutions. Leveraging recent advances in diffusion models, synthetic data, by constructing image inputs from various annotations,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yibo Wang , Ruiyuan Gao , Kai Chen , Kaiqiang Zhou , Yingjie Cai , Lanqing Hong , Zhenguo Li , Lihui Jiang , Dit-Yan Yeung , Qiang Xu , Kai Zhang

Generative diffusion models have advanced image editing with high-quality results and intuitive interfaces such as prompts and semantic drawing. However, these interfaces lack precise control, and the associated methods typically specialize…

In this paper, we propose a computational efficient end-to-end training deep neural network (CEDNN) model and spatial attention maps based on difference images. Firstly, the difference image is generated by image processing. Then five…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Jing Chen , Chenhui Wang , Kejun Wang , Meichen Liu

The information diffusion prediction on social networks aims to predict future recipients of a message, with practical applications in marketing and social media. While different prediction models all claim to perform well, general…

Social and Information Networks · Computer Science 2025-01-16 Wenjin Xie , Xiaomeng Wang , Radosław Michalski , Tao Jia