English
Related papers

Related papers: On learning higher-order cumulants in diffusion mo…

200 papers

The presence of global conserved quantities in interacting systems generically leads to diffusive transport at late times. Here, we show that systems conserving the dipole moment of an associated global charge, or even higher moment…

Strongly Correlated Electrons · Physics 2020-12-22 Johannes Feldmeier , Pablo Sala , Giuseppe de Tomasi , Frank Pollmann , Michael Knap

In this work, we investigate an intriguing and prevalent phenomenon of diffusion models which we term as "consistent model reproducibility": given the same starting noise input and a deterministic sampler, different diffusion models often…

Machine Learning · Computer Science 2024-06-11 Huijie Zhang , Jinfan Zhou , Yifu Lu , Minzhe Guo , Peng Wang , Liyue Shen , Qing Qu

Drifting models train one-step generators by optimizing a kernel-induced mean-shift discrepancy between the data and model distributions, with Laplace kernels used by default in practice. At each point, this discrepancy compares the…

Machine Learning · Computer Science 2026-05-18 Chieh-Hsin Lai , Bac Nguyen , Naoki Murata , Yuhta Takida , Toshimitsu Uesaka , Yuki Mitsufuji , Stefano Ermon , Molei Tao

Factorial moments and cumulants are usually defined with respect to the unconditioned Poisson process. Conditioning a sample by selecting events of a given overall multiplicity $N$ necessarily introduces correlations. By means of Edgeworth…

High Energy Physics - Phenomenology · Physics 2009-10-28 P. Lipa , H. C. Eggers , B. Buschbeck

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

Diffusion models have emerged as one of the most promising frameworks for deep generative modeling. In this work, we explore the potential of non-uniform diffusion models. We show that non-uniform diffusion leads to multi-scale diffusion…

Machine Learning · Computer Science 2022-07-21 Georgios Batzolis , Jan Stanczuk , Carola-Bibiane Schönlieb , Christian Etmann

Score-based diffusion models generate samples from an unknown target distribution using a time-reversed diffusion process. While such models represent state-of-the-art approaches in industrial applications such as artificial image…

Machine Learning · Computer Science 2026-02-09 Adrian Baule

Diffusion models are generative models that have shown significant advantages compared to other generative models in terms of higher generation quality and more stable training. However, the computational need for training diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Gulcin Baykal , Halil Faruk Karagoz , Taha Binhuraib , Gozde Unal

We apply recent advances in deep generative modeling to the task of imitation learning from biological agents. Specifically, we apply variations of the variational recurrent neural network model to a multi-agent setting where we learn…

Machine Learning · Computer Science 2020-07-02 Michael Teng , Tuan Anh Le , Adam Scibior , Frank Wood

Generative models, including diffusion models, are increasingly used as foundation models and adapted through sequential fine-tuning, making continual learning an essential problem setting. However, continual learning in such generative…

Machine Learning · Computer Science 2026-05-29 Ken Takeda , Masafumi Oizumi , Ryo Karakida

Diffusion models have demonstrated remarkable performance in generation tasks. Nevertheless, explaining the diffusion process remains challenging due to it being a sequence of denoising noisy images that are difficult for experts to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Ji-Hoon Park , Yeong-Joon Ju , Seong-Whan Lee

Among the best known quantities obtainable from photon correlation measurements are the $g^{(m)}$~correlation functions. Here, we introduce a new procedure to evaluate these correlation functions based on higher-order factorial cumulants…

Mesoscale and Nanoscale Physics · Physics 2022-05-24 Philipp Stegmann , Satyendra Nath Gupta , Gilad Haran , Jianshu Cao

We address the problem of learning of continuous exponential family distributions with unbounded support. While a lot of progress has been made on learning of Gaussian graphical models, we still lack scalable algorithms for reconstructing…

Machine Learning · Computer Science 2022-03-01 Christopher X. Ren , Sidhant Misra , Marc Vuffray , Andrey Y. Lokhov

We give a new algorithm for learning mixtures of $k$ Gaussians (with identity covariance in $\mathbb{R}^n$) to TV error $\varepsilon$, with quasi-polynomial ($O(n^{\text{poly\,log}\left(\frac{n+k}{\varepsilon}\right)})$) time and sample…

Machine Learning · Computer Science 2025-03-05 Khashayar Gatmiry , Jonathan Kelner , Holden Lee

Diffusion models generate high-dimensional data such as images by learning a process that gradually removes noise from corrupted data. Recent studies have shown that the backward dynamics of diffusion models exhibit two characteristic…

Statistical Mechanics · Physics 2026-04-14 Tomoei Takahashi , Takashi Takahashi , Yoshiyuki Kabashima

When conducting bonds are occupied randomly in a two-dimensional square lattice, the conductivity of the system increases continuously as the density of those conducting bonds exceeds the percolation threshold. Such a behavior is well known…

Statistical Mechanics · Physics 2014-11-03 Seongmin Kim , Y. S. Cho , N. A. M. Araujo , B. Kahng

Diffusion probabilistic models generate samples by learning to reverse a noise-injection process that transforms data into noise. A key development is the reformulation of the reverse sampling process as a deterministic probability flow…

Machine Learning · Computer Science 2025-08-15 Daniel Zhengyu Huang , Jiaoyang Huang , Zhengjiang Lin

Diffusion Models represent a significant advancement in generative modeling, employing a dual-phase process that first degrades domain-specific information via Gaussian noise and restores it through a trainable model. This framework enables…

Neural and Evolutionary Computing · Computer Science 2024-11-21 Benedikt Hartl , Yanbo Zhang , Hananel Hazan , Michael Levin

Diffusion models, a powerful and universal generative AI technology, have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. In these applications, diffusion models provide flexible…

Machine Learning · Computer Science 2024-04-12 Minshuo Chen , Song Mei , Jianqing Fan , Mengdi Wang

The high-order cumulants and factorial cumulants of conserved charges are suggested to study the critical dynamics in heavy ion collisions. In this paper, using parametric representation of the 3-dimensional Ising model, the sign…

Nuclear Theory · Physics 2021-06-17 Xue Pan , Mingmei Xu , Yuanfang Wu
‹ Prev 1 3 4 5 6 7 10 Next ›