English
Related papers

Related papers: Manifold-Aware Perturbations for Constrained Gener…

200 papers

Generative modeling is typically framed as learning mapping rules, but from an observer's perspective without access to these rules, the task becomes disentangling the geometric support from the probability distribution. We propose that…

Machine Learning · Statistics 2025-12-04 Rui Tong

Learning the distribution of data on Riemannian manifolds is crucial for modeling data from non-Euclidean space, which is required by many applications in diverse scientific fields. Yet, existing generative models on manifolds suffer from…

Machine Learning · Computer Science 2024-06-04 Jaehyeong Jo , Sung Ju Hwang

Unsupervised domain mapping has attracted substantial attention in recent years due to the success of models based on the cycle-consistency assumption. These models map between two domains by fooling a probabilistic discriminator, thereby…

Machine Learning · Computer Science 2019-01-25 Matthew Amodio , Smita Krishnaswamy

Flow-based models typically define a latent space with dimensionality identical to the observational space. In many problems, however, the data does not populate the full ambient data space that they natively reside in, rather inhabiting a…

Machine Learning · Statistics 2023-02-24 Mingtian Zhang , Yitong Sun , Chen Zhang , Steven McDonagh

While the manifold hypothesis is widely adopted in modern machine learning, complex data is often better modeled as stratified spaces -- unions of manifolds (strata) of varying dimensions. Stratified learning is challenging due to varying…

Machine Learning · Statistics 2026-04-14 Randy Martinez , Rong Tang , Lizhen Lin

We investigate statistical properties of a likelihood approach to nonparametric estimation of a singular distribution using deep generative models. More specifically, a deep generative model is used to model high-dimensional data that are…

Machine Learning · Statistics 2023-03-29 Minwoo Chae , Dongha Kim , Yongdai Kim , Lizhen Lin

Diffusion models have demonstrated significant promise in various generative tasks; however, they often struggle to satisfy challenging constraints. Our approach addresses this limitation by rethinking training-free loss-guided diffusion…

Machine Learning · Computer Science 2024-11-19 William Huang , Yifeng Jiang , Tom Van Wouwe , C. Karen Liu

While deep generative models~(DGMs) have demonstrated remarkable success in capturing complex data distributions, they consistently fail to learn constraints that encode domain knowledge and thus require constraint integration. Existing…

Machine Learning · Computer Science 2025-02-13 Ruoyan Li , Dipti Ranjan Sahu , Guy Van den Broeck , Zhe Zeng

Deep Generative Models are frequently used to learn continuous representations of complex data distributions using a finite number of samples. For any generative model, including pre-trained foundation models with Diffusion or Transformer…

Many generative models attempt to replicate the density of their input data. However, this approach is often undesirable, since data density is highly affected by sampling biases, noise, and artifacts. We propose a method called SUGAR…

Machine Learning · Computer Science 2018-09-10 Ofir Lindenbaum , Jay S. Stanley , Guy Wolf , Smita Krishnaswamy

We analyze the time reversed dynamics of generative diffusion models. If the exact empirical score function is used in a regime of large dimension and exponentially large number of samples, these models are known to undergo transitions…

Statistics Theory · Mathematics 2025-11-17 Anand Jerry George , Rodrigo Veiga , Nicolas Macris

Generative models such as denoising diffusion models are quickly advancing their ability to approximate highly complex data distributions. They are also increasingly leveraged in scientific machine learning, where samples from the implied…

Machine Learning · Computer Science 2025-03-14 Jan-Hendrik Bastek , WaiChing Sun , Dennis M. Kochmann

Do contemporary diffusion models preserve the class geometry of hyperspherical data? Standard diffusion models rely on isotropic Gaussian noise in the forward process, inherently favoring Euclidean spaces. However, many real-world problems…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Muskan Dosi , Chiranjeev Chiranjeev , Kartik Thakral , Mayank Vatsa , Richa Singh

Copulas are a powerful tool for modeling multivariate distributions as they allow to separately estimate the univariate marginal distributions and the joint dependency structure. However, known parametric copulas offer limited flexibility…

Machine Learning · Statistics 2021-11-11 Tim Janke , Mohamed Ghanmi , Florian Steinke

The ability to represent and compare machine learning models is crucial in order to quantify subtle model changes, evaluate generative models, and gather insights on neural network architectures. Existing techniques for comparing data…

Understanding the macroscopic characteristics of biological complexes demands precision and specificity in statistical ensemble modeling. One of the primary challenges in this domain lies in sampling from particular subsets of the…

Machine Learning · Computer Science 2023-07-11 Justin Diamond , Markus Lill

Sampling-based motion planning under task constraints is challenging because the null-measure constraint manifold in the configuration space makes rejection sampling extremely inefficient, if not impossible. This paper presents a…

Robotics · Computer Science 2022-04-15 Cihan Acar , Keng Peng Tee

Manifold learning techniques have become increasingly valuable as data continues to grow in size. By discovering a lower-dimensional representation (embedding) of the structure of a dataset, manifold learning algorithms can substantially…

Neural and Evolutionary Computing · Computer Science 2020-01-31 Andrew Lensen , Mengjie Zhang , Bing Xue

Generative modeling in machine learning aims to synthesize new data samples that are statistically similar to those observed during training. While conventional generative models such as GANs and diffusion models typically assume access to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Milad Abdollahzadeh , Guimeng Liu , Touba Malekzadeh , Christopher T. H. Teo , Keshigeyan Chandrasegaran , Ngai-Man Cheung

Deep graph generative modeling has proven capable of learning the distribution of complex, multi-scale structures characterizing real-world graphs. However, one of the main limitations of existing methods is their large output space, which…

Machine Learning · Computer Science 2023-06-01 Nathaniel Diamant , Alex M. Tseng , Kangway V. Chuang , Tommaso Biancalani , Gabriele Scalia