中文
相关论文

相关论文: InvFusion: Bridging Supervised and Zero-shot Diffu…

200 篇论文

Diffusion probabilistic models learn to remove noise added during training, generating novel data (e.g., images) from Gaussian noise through sequential denoising. However, conditioning the generative process on corrupted or masked images is…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Sakshi Agarwal , Gabriel Hope , Jimin Heo , Erik B. Sudderth

Cross-modality image segmentation aims to segment the target modalities using a method designed in the source modality. Deep generative models can translate the target modality images into the source modality, thus enabling cross-modality…

图像与视频处理 · 电气工程与系统科学 2024-04-11 Zihao Wang , Yingyu Yang , Yuzhou Chen , Tingting Yuan , Maxime Sermesant , Herve Delingette , Ona Wu

We introduce Diffusion Active Learning, a novel approach that combines generative diffusion modeling with data-driven sequential experimental design to adaptively acquire data for inverse problems. Although broadly applicable, we focus on…

机器学习 · 计算机科学 2025-04-07 Luis Barba , Johannes Kirschner , Tomas Aidukas , Manuel Guizar-Sicairos , Benjamín Béjar

Current deep learning-based solutions for image analysis tasks are commonly incapable of handling problems to which multiple different plausible solutions exist. In response, posterior-based methods such as conditional Diffusion Models and…

A diffusion probabilistic model (DPM), which constructs a forward diffusion process by gradually adding noise to data points and learns the reverse denoising process to generate new samples, has been shown to handle complex data…

计算机视觉与模式识别 · 计算机科学 2023-10-16 Zhengxiong Luo , Dayou Chen , Yingya Zhang , Yan Huang , Liang Wang , Yujun Shen , Deli Zhao , Jingren Zhou , Tieniu Tan

The pretrained diffusion model as a strong prior has been leveraged to address inverse problems in a zero-shot manner without task-specific retraining. Different from the unconditional generation, the measurement-guided generation requires…

最优化与控制 · 数学 2025-03-14 Ji Li , Chao Wang

Diffusion-based image generators can now produce high-quality and diverse samples, but their success has yet to fully translate to 3D generation: existing diffusion methods can either generate low-resolution but 3D consistent outputs, or…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Animesh Karnewar , Niloy J. Mitra , Andrea Vedaldi , David Novotny

Ill-posed imaging inverse problems remain challenging due to the ambiguity in mapping degraded observations to clean images. Diffusion-based generative priors have recently shown promise, but typically rely on computationally intensive…

图像与视频处理 · 电气工程与系统科学 2026-02-13 Ayush Varshney , Katherine L. Bouman , Berthy T. Feng

We introduce Blind Plug-and-Play Diffusion Models (Blind-PnPDM) as a novel framework for solving blind inverse problems where both the target image and the measurement operator are unknown. Unlike conventional methods that rely on explicit…

图像与视频处理 · 电气工程与系统科学 2025-05-30 Anqi Li , Weijie Gan , Ulugbek S. Kamilov

Patient data from real-world clinical practice often suffers from data scarcity and long-tail imbalances, leading to biased outcomes or algorithmic unfairness. This study addresses these challenges by generating lesion-containing…

图像与视频处理 · 电气工程与系统科学 2024-10-08 Hantao Zhang , Yuhe Liu , Jiancheng Yang , Shouhong Wan , Xinyuan Wang , Wei Peng , Pascal Fua

Optical flow models trained on high-quality data often degrade severely when confronted with real-world corruptions such as blur, noise, and compression artifacts. To overcome this limitation, we formulate Degradation-Aware Optical Flow, a…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Jaewon Min , Jaeeun Lee , Yeji Choi , Paul Hyunbin Cho , Jin Hyeon Kim , Tae-Young Lee , Jongsik Ahn , Hwayeong Lee , Seonghyun Park , Seungryong Kim

We present the first framework to solve linear inverse problems leveraging pre-trained latent diffusion models. Previously proposed algorithms (such as DPS and DDRM) only apply to pixel-space diffusion models. We theoretically analyze our…

Mesh reconstruction from multi-view images is a fundamental problem in computer vision, but its performance degrades significantly under sparse-view conditions, especially in unseen regions where no ground-truth observations are available.…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Haoyang Wang , Liming Liu , Peiheng Wang , Junlin Hao , Jiangkai Wu , Xinggong Zhang

Diffusion inversion is a task of recovering the noise of an image in a diffusion model, which is vital for controllable diffusion image editing. At present, diffusion inversion still remains a challenging task due to the lack of viable…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Ziyue Zhang , Luxi Lin , Xiaolin Hu , Chao Chang , HuaiXi Wang , Yiyi Zhou , Rongrong Ji

Score-based diffusion models achieve state-of-the-art performance for inverse problems, but their practical deployment is hindered by long inference times and cumbersome hyperparameter tuning. While pretrained diffusion models can be reused…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Julio Oscanoa , Irmak Sivgin , Cagan Alkan , Daniel Ennis , John Pauly , Mert Pilanci , Shreyas Vasanawala

We propose a zero-shot method for generating images in arbitrary spaces (e.g., a sphere for 360{\deg} panoramas and a mesh surface for texture) using a pretrained image diffusion model. The zero-shot generation of various visual content…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Kyeongmin Yeo , Jaihoon Kim , Minhyuk Sung

Generative diffusion models are becoming one of the most popular prior in image restoration (IR) tasks due to their remarkable ability to generate realistic natural images. Despite achieving satisfactory results, IR methods based on…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Di You , Pier Luigi Dragotti

Bayesian full waveform inversion (FWI) offers uncertainty-aware subsurface models; however, posterior sampling directly on observed seismic shot records is rarely practical at the field scale because each sample requires numerous…

地球物理 · 物理学 2025-12-16 Mohammad H. Taufik , Tariq Alkhalifah

Zero-shot learning enables models to generalise to unseen classes by leveraging semantic information, bridging the gap between training and testing sets with non-overlapping classes. While much research has focused on zero-shot learning in…

声音 · 计算机科学 2025-07-03 Ysobel Sims , Alexandre Mendes , Stephan Chalup

Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and non-uniqueness of…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Yuhong Zhang , Hengsheng Zhang , Xinning Chai , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang