English
Related papers

Related papers: Kernel Density Steering: Inference-Time Scaling vi…

200 papers

Recent text-to-image models have achieved impressive results. However, since they require large-scale datasets of text-image pairs, it is impractical to train them on new domains where data is scarce or not labeled. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Shelly Sheynin , Oron Ashual , Adam Polyak , Uriel Singer , Oran Gafni , Eliya Nachmani , Yaniv Taigman

We propose a goodness-of-fit measure for probability densities modeling observations with varying dimensionality, such as text documents of differing lengths or variable-length sequences. The proposed measure is an instance of the kernel…

Machine Learning · Statistics 2023-07-14 Jerome Baum , Heishiro Kanagawa , Arthur Gretton

Finding a suitable density function is essential for density-based clustering algorithms such as DBSCAN and DPC. A naive density corresponding to the indicator function of a unit $d$-dimensional Euclidean ball is commonly used in these…

Machine Learning · Computer Science 2021-10-15 Chao Zheng , Yingjie Chen , Chong Chen , Jianqiang Huang , Xian-Sheng Hua

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chunyang Bi , Xin Luo , Sheng Shen , Mengxi Zhang , Huanjing Yue , Jingyu Yang

Knowledge Distillation (KD) is a fundamental technique for compressing large language models (LLMs) into compact, efficient student models. However, existing white-box KD methods mainly focus on balancing ground truth and student-generated…

Computation and Language · Computer Science 2025-08-11 Lingyuan Liu , Mengxiang Zhang

We introduce Generalized Discrete Diffusion from Snapshots (GDDS), a unified framework for discrete diffusion modeling that supports arbitrary noising processes over large discrete state spaces. Our formulation encompasses all existing…

Machine Learning · Statistics 2026-03-24 Oussama Zekri , Théo Uscidda , Nicolas Boullé , Anna Korba

Segmentation in dense visual scenes poses significant challenges due to occlusions, background clutter, and scale variations. To address this, we introduce PerSense, an end-to-end, training-free, and model-agnostic one-shot framework for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Muhammad Ibraheem Siddiqui , Muhammad Umer Sheikh , Hassan Abid , Kevin Henry , Muhammad Haris Khan

Diffusion frameworks have achieved comparable performance with previous state-of-the-art image generation models. Researchers are curious about its variants in discriminative tasks because of its powerful noise-to-image denoising pipeline.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Zhangxuan Gu , Haoxing Chen , Zhuoer Xu , Jun Lan , Changhua Meng , Weiqiang Wang

The problem of unsupervised learning and segmentation of hyperspectral images is a significant challenge in remote sensing. The high dimensionality of hyperspectral data, presence of substantial noise, and overlap of classes all contribute…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 James M. Murphy , Mauro Maggioni

This work aims to improve the efficiency of text-to-image diffusion models. While diffusion models use computationally expensive UNet-based denoising operations in every generation step, we identify that not all operations are equally…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Amirhossein Habibian , Amir Ghodrati , Noor Fathima , Guillaume Sautiere , Risheek Garrepalli , Fatih Porikli , Jens Petersen

Recent approaches have shown promises distilling diffusion models into efficient one-step generators. Among them, Distribution Matching Distillation (DMD) produces one-step generators that match their teacher in distribution, without…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Tianwei Yin , Michaël Gharbi , Taesung Park , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman

Diffusion models (DMs) have recently been introduced in image deblurring and exhibited promising performance, particularly in terms of details reconstruction. However, the diffusion model requires a large number of inference iterations to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Zheng Chen , Yulun Zhang , Ding Liu , Bin Xia , Jinjin Gu , Linghe Kong , Xin Yuan

Diffusion models are a powerful generative framework, but come with expensive inference. Existing acceleration methods often compromise image quality or fail under complex conditioning when operating in an extremely low-step regime. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Jonas Kohler , Albert Pumarola , Edgar Schönfeld , Artsiom Sanakoyeu , Roshan Sumbaly , Peter Vajda , Ali Thabet

Recent advancements in diffusion models have positioned them at the forefront of image generation. Despite their superior performance, diffusion models are not without drawbacks; they are characterized by complex architectures and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Yuda Song , Zehao Sun , Xuanwu Yin

Comparing differently sized data sets is one main task in model assessment and calibration. This is due to field data being generally sparse compared to simulated model results. We tackled this task by the application of a new…

Applications · Statistics 2023-08-30 Maria-Theresia Pelz , Christopher Somes

We present a novel framework for rectifying occlusions and distortions in degraded texture samples from natural images. Traditional texture synthesis approaches focus on generating textures from pristine samples, which necessitate…

Graphics · Computer Science 2023-09-27 Guoqing Hao , Satoshi Iizuka , Kensho Hara , Edgar Simo-Serra , Hirokatsu Kataoka , Kazuhiro Fukui

Diffusion models (DMs) have been adopted across diverse fields with its remarkable abilities in capturing intricate data distributions. In this paper, we propose a Fast Diffusion Model (FDM) to significantly speed up DMs from a stochastic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Zike Wu , Pan Zhou , Kenji Kawaguchi , Hanwang Zhang

Seismic imaging from sparsely acquired data faces challenges such as low image quality, discontinuities, and migration swing artifacts. Existing convolutional neural network (CNN)-based methods struggle with complex feature distributions…

Geophysics · Physics 2024-08-01 Xingchen Shi , Shijun Cheng , Weijian Mao , Wei Ouyang

Generative diffusion models have emerged as a powerful tool for high-quality image synthesis, yet their iterative nature demands significant computational resources. This paper proposes an efficient time step sampling method based on an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Haeil Lee , Hansang Lee , Seoyeon Gye , Junmo Kim

Conditional generative models typically demand large annotated training sets to achieve high-quality synthesis. As a result, there has been significant interest in designing models that perform plug-and-play generation, i.e., to use a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Nithin Gopalakrishnan Nair , Anoop Cherian , Suhas Lohit , Ye Wang , Toshiaki Koike-Akino , Vishal M. Patel , Tim K. Marks