English
Related papers

Related papers: SymmetricDiffusers: Learning Discrete Diffusion on…

200 papers

Previously, non-autoregressive models were widely perceived as being superior in generation efficiency but inferior in generation quality due to the difficulties of modeling multiple target modalities. To enhance the multi-modality modeling…

Computation and Language · Computer Science 2023-11-30 Lihua Qian , Mingxuan Wang , Yang Liu , Hao Zhou

Learning in deep neural networks (DNNs) is implemented through minimizing a highly non-convex loss function, typically by a stochastic gradient descent (SGD) method. This learning process can effectively find good wide minima without being…

Machine Learning · Computer Science 2021-07-27 Guozhang Chen , Cheng Kevin Qu , Pulin Gong

A central problem in machine learning involves modeling complex data-sets using highly flexible families of probability distributions in which learning, sampling, inference, and evaluation are still analytically or computationally…

Machine Learning · Computer Science 2015-11-20 Jascha Sohl-Dickstein , Eric A. Weiss , Niru Maheswaranathan , Surya Ganguli

Online reinforcement learning (RL) has been central to post-training language models, but its extension to diffusion models remains challenging due to intractable likelihoods. Recent works discretize the reverse sampling process to enable…

Machine Learning · Computer Science 2026-02-17 Kaiwen Zheng , Huayu Chen , Haotian Ye , Haoxiang Wang , Qinsheng Zhang , Kai Jiang , Hang Su , Stefano Ermon , Jun Zhu , Ming-Yu Liu

Machine learning (ML) has become a versatile tool for analyzing anomalous diffusion trajectories, yet most existing pipelines are trained on large collections of simulated data. In contrast, experimental trajectories, such as those from…

Biological Physics · Physics 2025-12-10 Gongyi Wang , Yu Zhang , Zihan Huang

In this paper we present analytical and random walk based solutions to diffusion in semi-permeable layered media with varying diffusivity. We propose a new random walk transit model (hybrid model) based on treating the membrane permeability…

Biological Physics · Physics 2022-01-27 Ignasi Alemany , Jan N. Rose , Jérôme Garnier-Brun , Andrew D. Scott , Denis J. Doorly

Discrete diffusion models (DDMs) are a powerful class of generative models for categorical data, but they typically require many function evaluations for a single sample, making inference expensive. Existing acceleration methods either rely…

Machine Learning · Computer Science 2025-12-16 Yansong Gao , Yu Sun

Visual traversability estimation is critical for autonomous navigation, but existing VLM-based methods rely on hand-crafted prompts, generalize poorly across embodiments, and output only traversability maps, leaving trajectory generation to…

Semi-supervised learning (SSL) is an indispensable tool when there are few labeled entities and many unlabeled entities for which we want to predict labels. With graph-based methods, entities correspond to nodes in a graph and edges…

Machine Learning · Computer Science 2017-01-23 Edith Cohen

We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals --…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Chicago Y. Park , Michael T. McCann , Cristina Garcia-Cardona , Brendt Wohlberg , Ulugbek S. Kamilov

Uncertainty calibration in pre-trained transformers is critical for their reliable deployment in risk-sensitive applications. Yet, most existing pre-trained transformers do not have a principled mechanism for uncertainty propagation through…

Probabilistic regression models the entire predictive distribution of a response variable, offering richer insights than classical point estimates and directly allowing for uncertainty quantification. While diffusion-based generative models…

Machine Learning · Computer Science 2025-10-07 Carlo Kneissl , Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Random walk has wide applications in many fields, such as machine learning, biology, physics, and chemistry. Random walk can be discrete or continuous in time and space. Asymmetric random walk could be described by drift-diffusion equation.…

Statistical Mechanics · Physics 2024-03-01 Guoxing Lin , Shaokun Zheng

Diffusion models surpass previous generative models in sample quality and training stability. Recent works have shown the advantages of diffusion models in improving reinforcement learning (RL) solutions. This survey aims to provide an…

Machine Learning · Computer Science 2024-02-26 Zhengbang Zhu , Hanye Zhao , Haoran He , Yichao Zhong , Shenyu Zhang , Haoquan Guo , Tingting Chen , Weinan Zhang

Deep Metric Learning (DML) aims to learn embedding functions that map semantically similar inputs to proximate points in a metric space while separating dissimilar ones. Existing methods, such as pairwise losses, are hindered by complex…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Pedro Silva , Guilherme A. L. Silva , Pablo Coelho , Vander Freitas , Gladston Moreira , David Menotii , Eduardo Luz

Diffusion models for continuous state spaces based on Gaussian noising processes are now relatively well understood from both practical and theoretical perspectives. In contrast, results for diffusion models on discrete state spaces remain…

Machine Learning · Computer Science 2026-04-02 Giovanni Conforti , Alain Durmus , Le-Tuyet-Nhi Pham , Gael Raoul

Synthesizing novel 3D models that resemble the input example has long been pursued by graphics artists and machine learning researchers. In this paper, we present Sin3DM, a diffusion model that learns the internal patch distribution from a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Rundi Wu , Ruoshi Liu , Carl Vondrick , Changxi Zheng

Diffusion Language Models (DLMs) have recently achieved strong results in text generation. However, their multi-step sampling leads to slow inference, limiting practical use. To address this, we extend Inverse Distillation, a technique…

Machine Learning · Computer Science 2026-02-24 David Li , Nikita Gushchin , Dmitry Abulkhanov , Eric Moulines , Ivan Oseledets , Maxim Panov , Alexander Korotin

While diffusion models have emerged as a powerful class of generative models, their learning dynamics remain poorly understood. We address this issue first by empirically showing that standard diffusion models trained on natural images…

Machine Learning · Statistics 2026-05-21 Lorenzo Bardone , Claudia Merger , Sebastian Goldt

Diffusion models have achieved remarkable success across a range of generative tasks. Recent efforts to enhance diffusion model architectures have reimagined them as a form of multi-task learning, where each task corresponds to a denoising…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Byeongjun Park , Hyojun Go , Jin-Young Kim , Sangmin Woo , Seokil Ham , Changick Kim