English
Related papers

Related papers: Generative Myopia: Why Diffusion Models Fail at St…

200 papers

We present Fractional Diffusion Bridge Models (FDBM), a novel generative diffusion bridge framework driven by an approximation of the rich and non-Markovian fractional Brownian motion (fBM). Real stochastic processes exhibit a degree of…

Real-world data generation often involves complex inter-dependencies among instances, violating the IID-data hypothesis of standard learning paradigms and posing a challenge for uncovering the geometric structures for learning desired…

Machine Learning · Computer Science 2023-05-30 Qitian Wu , Chenxiao Yang , Wentao Zhao , Yixuan He , David Wipf , Junchi Yan

Diffusion probabilistic models (DPMs), widely recognized for their potential to generate high-quality samples, tend to go unnoticed in representation learning. While recent progress has highlighted their potential for capturing visual…

Machine Learning · Computer Science 2025-05-09 Dingshuo Chen , Shuchen Xue , Liuji Chen , Yingheng Wang , Qiang Liu , Shu Wu , Zhi-Ming Ma , Liang Wang

Digital Terrain Models (DTMs) represent the bare-earth elevation and are important in numerous geospatial applications. Such data models cannot be directly measured by sensors and are typically generated from Digital Surface Models (DSMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Oussema Dhaouadi , Johannes Meier , Jacques Kaiser , Daniel Cremers

Oversmoothing has been recognized as a main obstacle to building deep Graph Neural Networks (GNNs), limiting the performance. This position paper argues that the influence of oversmoothing has been overstated and advocates for a further…

Machine Learning · Computer Science 2025-06-06 MoonJeong Park , Sunghyun Choi , Jaeseung Heo , Eunhyeok Park , Dongwoo Kim

Magnetic resonance (MR) imaging, including cardiac MR, is prone to domain shift due to variations in imaging devices and acquisition protocols. This challenge limits the deployment of trained AI models in real-world scenarios, where…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Xin Ci Wong , Duygu Sarikaya , Kieran Zucker , Marc De Kamps , Nishant Ravikumar

In recent years, diffusion models have become the leading approach for distribution learning. This paper focuses on structure-preserving diffusion models (SPDM), a specific subset of diffusion processes tailored for distributions with…

Machine Learning · Computer Science 2025-03-12 Haoye Lu , Spencer Szabados , Yaoliang Yu

Data-driven generative models excel in language and vision, but diffusion models often fail in constrained planning and design tasks, exhibiting severe constraint violations in engineering inverse design, molecular generation, multi-robot…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zirui Zhao , Boye Niu , Harold Soh , David Hsu , Wee Sun Lee

Explicit noise-level conditioning is widely regarded as essential for the effective operation of Graph Diffusion Models (GDMs). In this work, we challenge this assumption by investigating whether denoisers can implicitly infer noise levels…

Machine Learning · Computer Science 2025-06-12 Jipeng Li , Yanning Shen

Accurate prediction with multimodal data-encompassing tabular, textual, and visual inputs or outputs-is fundamental to advancing analytics in diverse application domains. Traditional approaches often struggle to integrate heterogeneous data…

Machine Learning · Statistics 2025-03-11 Xinyu Tian , Xiaotong Shen

Deep generative models have gained recent traction in accelerated MRI reconstruction. Diffusion priors are particularly promising given their representational fidelity. Instead of the target transformation from undersampled to fully-sampled…

Image and Video Processing · Electrical Eng. & Systems 2023-12-19 Muhammad U. Mirza , Onat Dalmaz , Hasan A. Bedel , Gokberk Elmas , Yilmaz Korkmaz , Alper Gungor , Salman UH Dar , Tolga Çukur

Solving inverse problems -- recovering signals from incomplete or noisy measurements -- is fundamental in science and engineering. Score-based generative models (SGMs) have recently emerged as a powerful framework for this task. Two main…

Machine Learning · Computer Science 2025-10-27 Bartlomiej Sobieski , Matthew Tivnan , Yuang Wang , Siyeop Yoon , Pengfei Jin , Dufan Wu , Quanzheng Li , Przemyslaw Biecek

In the realm of medical imaging, inverse problems aim to infer high-quality images from incomplete, noisy measurements, with the objective of minimizing expenses and risks to patients in clinical settings. The Diffusion Models have recently…

Image and Video Processing · Electrical Eng. & Systems 2024-04-08 Hossein Askari , Fred Roosta , Hongfu Sun

Graph foundation models (GFMs) have recently attracted interest due to the promise of graph neural network (GNN) architectures that generalize zero-shot across graphs of arbitrary scales, feature dimensions, and domains. While existing work…

Machine Learning · Computer Science 2026-03-25 Benjamin Gutteridge , Michael Bronstein , Xiaowen Dong

Conventional diffusion models typically relies on a fixed forward process, which implicitly defines complex marginal distributions over latent variables. This can often complicate the reverse process' task in learning generative…

Machine Learning · Statistics 2025-06-10 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

Due to the over-smoothing issue, most existing graph neural networks can only capture limited dependencies with their inherently finite aggregation layers. To overcome this limitation, we propose a new kind of graph convolution, called…

Machine Learning · Computer Science 2022-06-30 Qi Chen , Yifei Wang , Yisen Wang , Jiansheng Yang , Zhouchen Lin

Generative models of graphs based on discrete Denoising Diffusion Probabilistic Models (DDPMs) offer a principled approach to molecular generation by systematically removing structural noise through iterative atom and bond adjustments.…

Machine Learning · Computer Science 2025-11-03 Matteo Ninniri , Marco Podda , Davide Bacciu

Existing approaches for analyzing neural network activations, such as PCA and sparse autoencoders, rely on strong structural assumptions. Generative models offer an alternative: they can uncover structure without such assumptions and act as…

Machine Learning · Computer Science 2026-02-09 Grace Luo , Jiahai Feng , Trevor Darrell , Alec Radford , Jacob Steinhardt

We introduce the first continuous-time score-based generative model that leverages fractional diffusion processes for its underlying dynamics. Although diffusion models have excelled at capturing data distributions, they still suffer from…

Diffusion has shown great success in improving accuracy of unsupervised image retrieval systems by utilizing high-order structures of image manifold. However, existing diffusion methods suffer from three major limitations: 1) they usually…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Zhiyong Dou , Haotian Cui , Lin Zhang , Bo Wang