中文
相关论文

相关论文: [MASK] is All You Need

200 篇论文

Discrete diffusion models have emerged as powerful tools for high-quality data generation. Despite their success in discrete spaces, such as text generation tasks, the acceleration of discrete diffusion models remains under-explored. In…

机器学习 · 计算机科学 2024-12-09 Zixiang Chen , Huizhuo Yuan , Yongqian Li , Yiwen Kou , Junkai Zhang , Quanquan Gu

Masked discrete diffusion is a dominant paradigm for high-quality language modeling where tokens are iteratively corrupted to a mask state, yet its inference efficiency is bottlenecked by the lack of deterministic sampling tools. While…

机器学习 · 计算机科学 2026-02-03 Guinan Chen , Xunpeng Huang , Ying Sun , Shijin Wang , Yanyong Zhang , Chao Wang

Discrete diffusion has achieved state-of-the-art performance, outperforming or approaching autoregressive models on standard benchmarks. In this work, we introduce Discrete Diffusion with Planned Denoising (DDPD), a novel framework that…

机器学习 · 计算机科学 2025-04-11 Sulin Liu , Juno Nam , Andrew Campbell , Hannes Stärk , Yilun Xu , Tommi Jaakkola , Rafael Gómez-Bombarelli

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Diffusion models have demonstrated remarkable performance in generating high-dimensional samples across domains such as vision, language, and the sciences. Although continuous-state diffusion models have been extensively studied both…

机器学习 · 计算机科学 2026-02-17 Aadithya Srikanth , Mudit Gaur , Vaneet Aggarwal

Panoptic and instance segmentation networks are often trained with specialized object detection modules, complex loss functions, and ad-hoc post-processing steps to manage the permutation-invariance of the instance masks. This work builds…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Wouter Van Gansbeke , Bert De Brabandere

Diffusion models have demonstrated remarkable performance in generating unimodal data across various tasks, including image, video, and text generation. On the contrary, the joint generation of multimodal data through diffusion models is…

机器学习 · 计算机科学 2025-06-16 Kevin Rojas , Yuchen Zhu , Sichen Zhu , Felix X. -F. Ye , Molei Tao

Diffusion models typically generate data through a fixed denoising trajectory that is shared across all samples. However, generation targets can differ in complexity, suggesting that a single pre-defined diffusion process may not be optimal…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yucheng Xing , Xiaodong Liu , Xin Wang

Despite Flow Matching and diffusion models having emerged as powerful generative paradigms for continuous variables such as images and videos, their application to high-dimensional discrete data, such as language, is still limited. In this…

机器学习 · 计算机科学 2024-11-06 Itai Gat , Tal Remez , Neta Shaul , Felix Kreuk , Ricky T. Q. Chen , Gabriel Synnaeve , Yossi Adi , Yaron Lipman

We study posterior sampling for inverse problems in discrete state spaces using discrete diffusion models as generative priors. While continuous diffusion models have become widely used for inverse problems, their discrete counterparts…

机器学习 · 计算机科学 2026-05-12 Chaitanya Amballa , Sattwik Basu , Jorge Vančo Sampedro , Romit Roy Choudhury

Diffusion models and flow-matching models have enabled generating diverse and realistic images by learning to transfer noise to data. However, sampling from these models involves iterative denoising over many neural network passes, making…

机器学习 · 计算机科学 2025-06-24 Kevin Frans , Danijar Hafner , Sergey Levine , Pieter Abbeel

Accurate medical image segmentation is crucial for precise anatomical delineation. Deep learning models like U-Net have shown great success but depend heavily on large datasets and struggle with domain shifts, complex structures, and…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Hantao Zhang , Yuhe Liu , Jiancheng Yang , Weidong Guo , Xinyuan Wang , Pascal Fua

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard…

统计力学 · 物理学 2024-08-15 Luke Causer , Grant M. Rotskoff , Juan P. Garrahan

Diffusion models have emerged as a powerful new family of deep generative models with record-breaking performance in many applications, including image synthesis, video generation, and molecule design. In this survey, we provide an overview…

机器学习 · 计算机科学 2025-09-30 Ling Yang , Zhilong Zhang , Yang Song , Shenda Hong , Runsheng Xu , Yue Zhao , Wentao Zhang , Bin Cui , Ming-Hsuan Yang

Diffusion models (DMs) have revolutionized generative learning. They utilize a diffusion process to encode data into a simple Gaussian distribution. However, encoding a complex, potentially multimodal data distribution into a single…

机器学习 · 计算机科学 2024-07-04 Yilun Xu , Gabriele Corso , Tommi Jaakkola , Arash Vahdat , Karsten Kreis

Denoising models such as Diffusion or Flow Matching have recently advanced generative modeling for discrete structures, yet most approaches either operate directly in the discrete state space, causing abrupt state changes. We introduce…

机器学习 · 计算机科学 2026-03-31 Yoann Boget , Alexandros Kalousis

This paper considers the problem of utilizing a large-scale text-to-image diffusion model to tackle the challenging Inexact Segmentation (IS) task. Unlike traditional approaches that rely heavily on discriminative-model-based paradigms or…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Tianjiao Zhang , Fei Zhang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Discriminative classifiers have become a foundational tool in deep learning for medical imaging, excelling at learning separable features of complex data distributions. However, these models often need careful design, augmentation, and…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Gian Mario Favero , Parham Saremi , Emily Kaczmarek , Brennan Nichyporuk , Tal Arbel

Attribution methods assess the contribution of inputs to the model prediction. One way to do so is erasure: a subset of inputs is considered irrelevant if it can be removed without affecting the prediction. Though conceptually simple,…

计算与语言 · 计算机科学 2021-03-03 Nicola De Cao , Michael Schlichtkrull , Wilker Aziz , Ivan Titov

Denoising diffusion models have gained popularity as a generative modeling technique for producing high-quality and diverse images. Applying these models to downstream tasks requires conditioning, which can take the form of text, class…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Alexandros Graikos , Srikar Yellapragada , Dimitris Samaras