English
Related papers

Related papers: Deeper Diffusion Models Amplify Bias

200 papers

Diffusion Models (DMs) iteratively denoise random samples to produce high-quality data. The iterative sampling process is derived from Stochastic Differential Equations (SDEs), allowing a speed-quality trade-off chosen at inference. Another…

Machine Learning · Computer Science 2024-09-27 Mattias Cross , Anton Ragni

In recent years, diffusion models (DMs) have drawn significant attention for their success in approximating data distributions, yielding state-of-the-art generative results. Nevertheless, the versatility of these models extends beyond their…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Peter Lorenz , Ricard Durall , Janis Keuper

Diffusion-based models have shown the merits of generating high-quality visual data while preserving better diversity in recent studies. However, such observation is only justified with curated data distribution, where the data samples are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Yiming Qin , Huangjie Zheng , Jiangchao Yao , Mingyuan Zhou , Ya Zhang

Diffusion Models (DMs), as a leading class of generative models, offer key advantages for reinforcement learning (RL), including multi-modal expressiveness, stable training, and trajectory-level planning. This survey delivers a…

Machine Learning · Computer Science 2025-10-15 Changfu Xu , Jianxiong Guo , Yuzhu Liang , Haiyang Huang , Haodong Zou , Xi Zheng , Shui Yu , Xiaowen Chu , Jiannong Cao , Tian Wang

Developments in deep generative models have allowed for tractable learning of high-dimensional data distributions. While the employed learning procedures typically assume that training data is drawn i.i.d. from the distribution of interest,…

Machine Learning · Computer Science 2017-05-24 Ari Seff , Alex Beatson , Daniel Suo , Han Liu

Diffusion-based learning has settled as a rising paradigm in generative recommendation, outperforming traditional approaches built upon variational autoencoders and generative adversarial networks. Despite their effectiveness, concerns have…

Information Retrieval · Computer Science 2025-08-12 Daniele Malitesta , Giacomo Medda , Erasmo Purificato , Mirko Marras , Fragkiskos D. Malliaros , Ludovico Boratto

Diffusion models (DMs) have emerged as a powerful class of generative AI models, showing remarkable potential in anomaly detection (AD) tasks across various domains, such as cybersecurity, fraud detection, healthcare, and manufacturing. The…

Machine Learning · Computer Science 2025-02-28 Jing Liu , Zhenchao Ma , Zepu Wang , Chenxuanyin Zou , Jiayang Ren , Zehua Wang , Liang Song , Bo Hu , Yang Liu , Victor C. M. Leung

Data reconstruction attacks on machine learning models pose a substantial threat to privacy, potentially leaking sensitive information. Although defending against such attacks using differential privacy (DP) provides theoretical guarantees,…

Machine Learning · Computer Science 2025-03-11 Kristian Schwethelm , Johannes Kaiser , Moritz Knolle , Sarah Lockfisch , Daniel Rueckert , Alexander Ziller

Diffusion Probabilistic Models (DPMs) have recently demonstrated impressive results on various generative tasks.Despite its promises, the learned representations of pre-trained DPMs, however, have not been fully understood. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Xingyi Yang , Xinchao Wang

It has been suggested that adversarial examples cause deep learning models to make incorrect predictions with high confidence. In this work, we take the opposite stance: an overly confident model is more likely to be vulnerable to…

Machine Learning · Computer Science 2018-02-14 Angus Galloway , Graham W. Taylor , Medhat Moussa

Diffusion models are a new class of generative models that have shown outstanding performance in image generation literature. As a consequence, studies have attempted to apply diffusion models to other tasks, such as speech enhancement. A…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-10 Philippe Gonzalez , Zheng-Hua Tan , Jan Østergaard , Jesper Jensen , Tommy Sonne Alstrøm , Tobias May

The potential of applying diffusion models (DMs) for multiple antenna communications is discussed. A unified framework of applying DM for multiple antenna tasks is first proposed. Then, the tasks are innovatively divided into two…

Signal Processing · Electrical Eng. & Systems 2025-02-05 Jia Guo , Xiaoxia Xu , Yuanwei Liu , Arumugam Nallanathan

Gradient-based deep-learning algorithms exhibit remarkable performance in practice, but it is not well-understood why they are able to generalize despite having more parameters than training examples. It is believed that implicit bias is a…

Machine Learning · Computer Science 2022-11-08 Gal Vardi

Large-scale text-to-image diffusion models excel in generating high-quality images from textual inputs, yet concerns arise as research indicates their tendency to memorize and replicate training data, raising We also addressed the issue of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Ruchika Chavhan , Ondrej Bohdal , Yongshuo Zong , Da Li , Timothy Hospedales

Diffusion models (DMs) are a powerful generative framework that have attracted significant attention in recent years. However, the high computational cost of training DMs limits their practical applications. In this paper, we start with a…

Machine Learning · Computer Science 2024-04-12 Tianshuo Xu , Peng Mi , Ruilin Wang , Yingcong Chen

Diffusion Models (DMs), also referred to as score-based diffusion models, utilize neural networks to specify score functions. Unlike most other probabilistic models, DMs directly model the score functions, which makes them more flexible to…

Machine Learning · Computer Science 2023-04-11 Weijian Luo

Unmanned Aerial Vehicles (UAVs) are increasingly adopted in modern communication networks. However, challenges in decision-making and digital modeling continue to impede their rapid advancement. Reinforcement Learning (RL) algorithms face…

Machine Learning · Computer Science 2025-01-13 Yousef Emami , Hao Zhou , Luis Almeida , Kai Li

The embedding spaces of image models have been shown to encode a range of social biases such as racism and sexism. Here, we investigate specific factors that contribute to the emergence of these biases in Vision Transformers (ViT).…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Jannik Brinkmann , Paul Swoboda , Christian Bartelt

Diffusion models pose risks of privacy breaches and copyright disputes, primarily stemming from the potential utilization of unauthorized data during the training phase. The Training Membership Inference (TMI) task aims to determine whether…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Xiaomeng Fu , Xi Wang , Qiao Li , Jin Liu , Jiao Dai , Jizhong Han

The bias/variance tradeoff is fundamental to learning: increasing a model's complexity can improve its fit on training data, but potentially worsens performance on future samples. Remarkably, however, the human brain effortlessly handles a…

Neurons and Cognition · Quantitative Biology 2012-10-18 David Balduzzi