English
Related papers

Related papers: Diffusion Secant Alignment for Score-Based Density…

200 papers

Discrete-time diffusion-based generative models and score matching methods have shown promising results in modeling high-dimensional image data. Recently, Song et al. (2021) show that diffusion processes that transform data into noise can…

Machine Learning · Computer Science 2021-10-01 Chin-Wei Huang , Jae Hyun Lim , Aaron Courville

A vital step towards the widespread adoption of neural retrieval models is their resource efficiency throughout the training, indexing and query workflows. The neural IR community made great advancements in training effective dual-encoder…

Information Retrieval · Computer Science 2021-05-27 Sebastian Hofstätter , Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin , Allan Hanbury

Diffusion models (DMs) have revolutionized generative learning. They utilize a diffusion process to encode data into a simple Gaussian distribution. However, encoding a complex, potentially multimodal data distribution into a single…

Machine Learning · Computer Science 2024-07-04 Yilun Xu , Gabriele Corso , Tommi Jaakkola , Arash Vahdat , Karsten Kreis

Diffusion Transformers (DiT) are renowned for their impressive generative performance; however, they are significantly constrained by considerable computational costs due to the quadratic complexity in self-attention and the extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Shuning Chang , Pichao Wang , Jiasheng Tang , Fan Wang , Yi Yang

This work is concerned with the coordination gain in integrated sensing and communication (ISAC) systems under a compress-and-estimate (CE) framework, wherein inference performance is leveraged as the key metric. To enable tractable…

Signal Processing · Electrical Eng. & Systems 2026-05-21 Biao Dong , Bin Cao , Qinyu Zhang

Pre-trained text-to-image diffusion models are increasingly applied to real-world image super-resolution (Real-ISR) task. Given the iterative refinement nature of diffusion models, most existing approaches are computationally expensive.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Linwei Dong , Qingnan Fan , Yihong Guo , Zhonghao Wang , Qi Zhang , Jinwei Chen , Yawei Luo , Changqing Zou

Infrared small target detection (ISTD) plays a vital role in numerous practical applications. In pursuit of determining the performance boundaries, researchers employ large and expensive manual-labeling data for representation learning.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Junyao Li , Yahao Lu , Xingyuan Guo , Xiaoyu Xian , Tiantian Wang , Yukai Shi

Score-based methods, such as diffusion models and Bayesian inverse problems, are often interpreted as learning the data distribution in the low-noise limit ($\sigma \to 0$). In this work, we propose an alternative perspective: their success…

Machine Learning · Statistics 2026-03-17 Xiang Li , Zebang Shen , Ya-Ping Hsieh , Niao He

Seismic data interpolation is a critical pre-processing step for improving seismic imaging quality and remains a focus of academic innovation. To address the computational inefficiencies caused by extensive iterative resampling in current…

Recent advancements in video super-resolution (VSR) models have demonstrated impressive results in enhancing low-resolution videos. However, due to limitations in adequately controlling the generation process, achieving high fidelity…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Yiwen Wang , Xinning Chai , Yuhong Zhang , Zhengxue Cheng , Jun Zhao , Rong Xie , Li Song

Internal activations of diffusion models encode rich semantic information, but interpreting such representations remains challenging. While Sparse Autoencoders (SAEs) have shown promise in disentangling latent representations, existing…

Machine Learning · Computer Science 2026-01-23 Zhenghao He , Guangzhi Xiong , Boyang Wang , Sanchit Sinha , Aidong Zhang

Surprise Adequacy (SA) has been widely studied as a test adequacy metric that can effectively guide software engineers towards inputs that are more likely to reveal unexpected behaviour of Deep Neural Networks (DNNs). Intuitively, SA is an…

Software Engineering · Computer Science 2025-02-06 Somin Kim , Shin Yoo

Diffusion models achieve high-quality image generation but are limited by slow iterative sampling. Distillation methods alleviate this by enabling one- or few-step generation. Flow matching, originally introduced as a distinct framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Mingyuan Zhou , Yi Gu , Huangjie Zheng , Liangchen Song , Guande He , Yizhe Zhang , Wenze Hu , Yinfei Yang

Inspired by non-equilibrium thermodynamics, diffusion models have achieved state-of-the-art performance in generative modeling. However, their iterative sampling nature results in high inference latency. While recent distillation techniques…

Machine Learning · Computer Science 2026-03-11 Cherish Puniani , Tushar Kumar , Arnav Bendre , Gaurav Kumar , Shree Singhi

Diffusion models now set the benchmark in high-fidelity generative sampling, yet they can, in principle, be prone to memorization. In this case, their learned score overfits the finite dataset so that the reverse-time SDE samples are mostly…

Machine Learning · Computer Science 2025-05-30 Franck Gabriel , François Ged , Maria Han Veiga , Emmanuel Schertzer

Latest diffusion models have shown promising results in category-level 6D object pose estimation by modeling the conditional pose distribution with depth image input. The existing methods, however, suffer from slow convergence during…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Seunghyun Lee , Tae-Kyun Kim

The proposed BSDE-based diffusion model represents a novel approach to diffusion modeling, which extends the application of stochastic differential equations (SDEs) in machine learning. Unlike traditional SDE-based diffusion models, our…

Machine Learning · Computer Science 2023-04-27 Zihao Wang

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method…

Machine Learning · Statistics 2024-05-27 Lorenzo Baldassari , Ali Siahkoohi , Josselin Garnier , Knut Solna , Maarten V. de Hoop

We study counterfactual distribution learning for high-dimensional outcomes whose counterfactual law may concentrate near lower-dimensional structure. Standard isotropic smoothing treats all ambient directions equally, leading to…

Methodology · Statistics 2026-05-26 Kwangho Kim

Classification tasks require a balanced distribution of data to ensure the learner to be trained to generalize over all classes. In real-world datasets, however, the number of instances vary substantially among classes. This typically leads…

Machine Learning · Computer Science 2020-11-24 Joel Jang , Yoonjeon Kim , Kyoungho Choi , Sungho Suh