English
Related papers

Related papers: SLIM-Diff: Shared Latent Image-Mask Diffusion with…

200 papers

In this study, we introduce a multi-modal approach that efficiently integrates multi-scale clinical and dermoscopy features within a single network, thereby substantially reducing model parameters. The proposed method includes three novel…

Image and Video Processing · Electrical Eng. & Systems 2024-03-31 Peng Tang , Tobias Lasser

We introduce a Cascaded Diffusion Model (Cas-DM) that improves a Denoising Diffusion Probabilistic Model (DDPM) by effectively incorporating additional metric functions in training. Metric functions such as the LPIPS loss have been proven…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Jie An , Zhengyuan Yang , Jianfeng Wang , Linjie Li , Zicheng Liu , Lijuan Wang , Jiebo Luo

Advances in endoscopy use in surgeries face challenges like inadequate lighting. Deep learning, notably the Denoising Diffusion Probabilistic Model (DDPM), holds promise for low-light image enhancement in the medical field. However, DDPMs…

Image and Video Processing · Electrical Eng. & Systems 2024-05-20 Tong Chen , Qingcheng Lyu , Long Bai , Erjian Guo , Huxin Gao , Xiaoxiao Yang , Hongliang Ren , Luping Zhou

MRI and PET are crucial diagnostic tools for brain diseases, as they provide complementary information on brain structure and function. However, PET scanning is costly and involves radioactive exposure, resulting in a lack of PET. Moreover,…

By embedding discrete representations into a continuous latent space, we can leverage continuous-space latent diffusion models to handle generative modeling of discrete data. However, despite their initial success, most latent diffusion…

Machine Learning · Computer Science 2025-04-02 Bac Nguyen , Chieh-Hsin Lai , Yuhta Takida , Naoki Murata , Toshimitsu Uesaka , Stefano Ermon , Yuki Mitsufuji

Diffusion model-based approaches recently achieved re-markable success in MRI reconstruction, but integration into clinical routine remains challenging due to its time-consuming convergence. This phenomenon is partic-ularly notable when…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Yu Guan , Qinrong Cai , Wei Li , Qiuyun Fan , Dong Liang , Qiegen Liu

The Latent Diffusion Model (LDM) has demonstrated strong capabilities in high-resolution image generation and has been widely employed for Pose-Guided Person Image Synthesis (PGPIS), yielding promising results. However, the compression…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jiaqi Liu , Jichao Zhang , Paolo Rota , Nicu Sebe

Snapshot compressive spectral imaging reconstruction aims to reconstruct three-dimensional spatial-spectral images from a single-shot two-dimensional compressed measurement. Existing state-of-the-art methods are mostly based on deep…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Zongliang Wu , Ruiying Lu , Ying Fu , Xin Yuan

Faithful image super-resolution (SR) not only needs to recover images that appear realistic, similar to image generation tasks, but also requires that the restored images maintain fidelity and structural consistency with the input. To this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Junyang Chen , Jinshan Pan , Jiangxin Dong

This research presents a novel framework for the compression and decompression of medical images utilizing the Latent Diffusion Model (LDM). The LDM represents advancement over the denoising diffusion probabilistic model (DDPM) with a…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 InChan Hwang , MinJae Woo

Deformable image registration plays an essential role in various medical image tasks. Existing deep learning-based deformable registration frameworks primarily utilize convolutional neural networks (CNNs) or Transformers to learn features…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jiong Wu , Kuang Gong

Multi-contrast magnetic resonance imaging (MRI) is the most common management tool used to characterize neurological disorders based on brain tissue contrasts. However, acquiring high-resolution MRI scans is time-consuming and infeasible…

Image and Video Processing · Electrical Eng. & Systems 2023-06-08 Ye Mao , Lan Jiang , Xi Chen , Chao Li

Lung cancer has been one of the leading causes of cancer-related deaths worldwide for years. With the emergence of deep learning, computer-assisted diagnosis (CAD) models based on learning algorithms can accelerate the nodule screening…

Image and Video Processing · Electrical Eng. & Systems 2023-05-03 Xuan Zhao , Benjamin Hou

Recent advances in image editing leverage latent diffusion models (LDMs) for versatile, text-prompt-driven edits across diverse tasks. Yet, maintaining pixel-level edge structures-crucial for tasks such as photorealistic style transfer or…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Minsu Gong , Nuri Ryu , Jungseul Ok , Sunghyun Cho

As the boosting development of large vision-language models like Contrastive Language-Image Pre-training (CLIP), many CLIP-like methods have shown impressive abilities on visual recognition, especially in low-data regimes scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Zhinuo Zhou , Peng Zhou , Xiaoyong Pan

Focal cortical dysplasia (FCD) type II is a major cause of drug-resistant epilepsy, often curable only by surgery. Despite its clinical importance, the diagnosis of FCD is very difficult in MRI because of subtle abnormalities, leading to…

Image and Video Processing · Electrical Eng. & Systems 2025-04-11 Lorenzo Lasagni , Antonio Ciccarone , Renzo Guerrini , Matteo Lenge , Ludovico D'incerti

Latent diffusion models have become the popular choice for scaling up diffusion models for high resolution image synthesis. Compared to pixel-space models that are trained end-to-end, latent models are perceived to be more efficient and to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Emiel Hoogeboom , Thomas Mensink , Jonathan Heek , Kay Lamerigts , Ruiqi Gao , Tim Salimans

Weakly supervised medical image segmentation (MIS) using generative models is crucial for clinical diagnosis. However, the accuracy of the segmentation results is often limited by insufficient supervision and the complex nature of medical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Zhihao Shuai , Yinan Chen , Shunqiang Mao , Yihan Zho , Xiaohong Zhang

Generative models based on deep learning have shown significant potential in medical imaging, particularly for modality transformation and multimodal fusion in MRI-based brain imaging. This study introduces GM-LDM, a novel framework that…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Hu Xu , Yang Jingling , Jia Sihan , Bi Yuda , Calhoun Vince

Diffusion probabilistic models have recently achieved remarkable success in generating high-quality images. However, balancing high perceptual quality and low distortion remains challenging in application of diffusion models in image…

Image and Video Processing · Electrical Eng. & Systems 2025-12-23 Juan Song , Jiaxiang He , Lijie Yang , Mingtao Feng , Keyan Wang