English
Related papers

Related papers: DisDiff: Unsupervised Disentanglement of Diffusion…

200 papers

While deep representation learning has become increasingly capable of separating task-relevant representations from other confounding factors in the data, two significant challenges remain. First, there is often an unknown and potentially…

Machine Learning · Computer Science 2019-05-07 Prashnna K Gyawali , Cameron Knight , Sandesh Ghimire , B. Milan Horacek , John L. Sapp , Linwei Wang

Learning disentangled representations that correspond to factors of variation in real-world data is critical to interpretable and human-controllable machine learning. Recently, concerns about the viability of learning disentangled…

Machine Learning · Computer Science 2020-04-14 Rui Shu , Yining Chen , Abhishek Kumar , Stefano Ermon , Ben Poole

We present a masked-guided approach for a denoising diffusion probabilistic model (DDPM) trained to generate and inpaint realistic radio galaxy images. The inpainting capability is particularly relevant for reconstructing incomplete…

Astrophysics of Galaxies · Physics 2026-05-26 Rémi Poitevineau , Emma Tolley , Verlon Etsebeth

SDE-based methods such as denoising diffusion probabilistic models (DDPMs) have shown remarkable success in real-world sample generation tasks. Prior analyses of DDPMs have been focused on the exponential Euler discretization, showing…

Machine Learning · Computer Science 2025-11-10 Matthew S. Zhang , Stephen Huan , Jerry Huang , Nicholas M. Boffi , Sitan Chen , Sinho Chewi

Diffusion models (DMs) have revolutionized generative learning. They utilize a diffusion process to encode data into a simple Gaussian distribution. However, encoding a complex, potentially multimodal data distribution into a single…

Machine Learning · Computer Science 2024-07-04 Yilun Xu , Gabriele Corso , Tommi Jaakkola , Arash Vahdat , Karsten Kreis

From the intuitive notion of disentanglement, the image variations corresponding to different factors should be distinct from each other, and the disentangled representation should reflect those variations with separate dimensions. To…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Xuanchi Ren , Tao Yang , Yuwang Wang , Wenjun Zeng

Existing customization methods require access to multiple reference examples to align pre-trained diffusion probabilistic models (DPMs) with user-provided concepts. This paper aims to address the challenge of DPM customization when the only…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jiachun Pan , Jun Hao Liew , Vincent Y. F. Tan , Jiashi Feng , Hanshu Yan

Effective computational search holds great potential for aiding the discovery of High-Temperature Superconductors (HTSs), especially given the lack of systematic methods for their discovery. Recent progress has been made in this area with…

Superconductivity · Physics 2024-05-10 Samuel Yuan , S. V. Dordevic

In the context of MDPs with high-dimensional states, downstream tasks are predominantly applied on a compressed, low-dimensional representation of the original input space. A variety of learning objectives have therefore been used to attain…

Machine Learning · Computer Science 2024-01-04 Jacob E. Kooi , Mark Hoogendoorn , Vincent François-Lavet

While representation learning aims to derive interpretable features for describing visual data, representation disentanglement further results in such features so that particular image attributes can be identified and manipulated. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Yen-Cheng Liu , Yu-Ying Yeh , Tzu-Chien Fu , Sheng-De Wang , Wei-Chen Chiu , Yu-Chiang Frank Wang

Recent disentangled representation learning (DRL) methods heavily rely on factor specific strategies-either learning objectives for attributes or model architectures for objects-to embed inductive biases. Such divergent approaches result in…

Machine Learning · Computer Science 2025-11-12 Whie Jung , Dong Hoon Lee , Seunghoon Hong

Large intra-class variation is the result of changes in multiple object characteristics. Images, however, only show the superposition of different variable factors such as appearance or shape. Therefore, learning to disentangle and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Dominik Lorenz , Leonard Bereska , Timo Milbich , Björn Ommer

Tabular data plays a crucial role in various domains but often suffers from missing values, thereby curtailing its potential utility. Traditional imputation techniques frequently yield suboptimal results and impose substantial computational…

Machine Learning · Computer Science 2024-03-22 Yizhu Wen , Kai Yi , Jing Ke , Yiqing Shen

Disentanglement is a highly desirable property of representation due to its similarity with human's understanding and reasoning. This improves interpretability, enables the performance of down-stream tasks, and enables controllable…

Machine Learning · Computer Science 2020-10-24 Jiantao Wu , Lin Wang

In response to the rapid growth of Internet of Things (IoT) devices and rising security risks, Radio Frequency Fingerprint (RFF) has become key for device identification and authentication. However, various changing factors - beyond the RFF…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Yezhuo Zhang , Zinan Zhou , Guangyu Li , Xuanpeng Li

In this work, we address the challenge of multi-task image generation with limited data for denoising diffusion probabilistic models (DDPM), a class of generative models that produce high-quality images by reversing a noisy diffusion…

Machine Learning · Computer Science 2023-11-29 Delaram Pirhayatifard , Mohammad Taha Toghani , Guha Balakrishnan , César A. Uribe

Diffusion probabilistic models (DPMs) have shown remarkable results on various image synthesis tasks such as text-to-image generation and image inpainting. However, compared to other generative methods like VAEs and GANs, DPMs lack a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Yipeng Leng , Qiangjuan Huang , Zhiyuan Wang , Yangyang Liu , Haoyu Zhang

We present Diff3F as a simple, robust, and class-agnostic feature descriptor that can be computed for untextured input shapes (meshes or point clouds). Our method distills diffusion features from image foundational models onto input shapes.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Niladri Shekhar Dutt , Sanjeev Muralikrishnan , Niloy J. Mitra

It has been postulated that a good representation is one that disentangles the underlying explanatory factors of variation. However, it remains an open question what kind of training framework could potentially achieve that. Whereas most…

Score-based diffusion models, which generate new data by learning to reverse a diffusion process that perturbs data from the target distribution into noise, have achieved remarkable success across various generative tasks. Despite their…

Machine Learning · Computer Science 2025-01-23 Gen Li , Yuling Yan