English
Related papers

Related papers: Leveraging Diffusion Model and Image Foundation Mo…

200 papers

Incorporating diffusion models in the image compression domain has the potential to produce realistic and detailed reconstructions, especially at extremely low bitrates. Previous methods focus on using diffusion models as expressive…

Image and Video Processing · Electrical Eng. & Systems 2024-10-10 Lucas Relic , Roberto Azevedo , Markus Gross , Christopher Schroers

Usually, lesions are not isolated but are associated with the surrounding tissues. For example, the growth of a tumour can depend on or infiltrate into the surrounding tissues. Due to the pathological nature of the lesions, it is…

Image and Video Processing · Electrical Eng. & Systems 2022-10-12 Lin Wang , Xiufen Ye , Donghao Zhang , Wanji He , Lie Ju , Yi Luo , Huan Luo , Xin Wang , Wei Feng , Kaimin Song , Xin Zhao , Zongyuan Ge

Diffusion models have demonstrated significant potential in producing high-quality images in medical image translation to aid disease diagnosis, localization, and treatment. Nevertheless, current diffusion models have limited success in…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Yunxiang Li , Hua-Chieh Shao , Xiaoxue Qian , You Zhang

Computed tomography (CT) is one of the modalities for effective lung cancer screening, diagnosis, treatment, and prognosis. The features extracted from CT images are now used to quantify spatial and temporal variations in tumors. However,…

Image and Video Processing · Electrical Eng. & Systems 2023-03-28 Md Selim , Jie Zhang , Michael A. Brooks , Ge Wang , Jin Chen

Deep learning models have emerged as a powerful tool for various medical applications. However, their success depends on large, high-quality datasets that are challenging to obtain due to privacy concerns and costly annotation. Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Milad Yazdani , Yasamin Medghalchi , Pooria Ashrafian , Ilker Hacihaliloglu , Dena Shahriari

Applying machine learning to real-world medical data, e.g. from hospital archives, has the potential to revolutionize disease detection in brain images. However, detecting pathology in such heterogeneous cohorts is a difficult challenge.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Ana Lawry Aguila , Ayodeji Ijishakin , Juan Eugenio Iglesias , Tomomi Takenaga , Yukihiro Nomura , Takeharu Yoshikawa , Osamu Abe , Shouhei Hanaoka

Angiography imaging is a medical imaging technique that enhances the visibility of blood vessels within the body by using contrast agents. Angiographic images can effectively assist in the diagnosis of vascular diseases. However, contrast…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhifeng Wang , Renjiao Yi , Xin Wen , Chenyang Zhu , Kai Xu

Image completion is a challenging task, particularly when ensuring that generated content seamlessly integrates with existing parts of an image. While recent diffusion models have shown promise, they often struggle with maintaining…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Pourya Shamsolmoali , Masoumeh Zareapoor , Huiyu Zhou , Michael Felsberg , Dacheng Tao , Xuelong Li

Image restoration (IR) has been an indispensable and challenging task in the low-level vision field, which strives to improve the subjective quality of images distorted by various forms of degradation. Recently, the diffusion model has…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xin Li , Yulin Ren , Xin Jin , Cuiling Lan , Xingrui Wang , Wenjun Zeng , Xinchao Wang , Zhibo Chen

The scarcity of annotated surgical data poses a significant challenge for developing deep learning systems in computer-assisted interventions. While diffusion models can synthesize realistic images, they often suffer from data memorization,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Danush Kumar Venkatesh , Stefanie Speidel

Image harmonization, which involves adjusting the foreground of a composite image to attain a unified visual consistency with the background, can be conceptualized as an image-to-image translation task. Diffusion models have recently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Pengfei Zhou , Fangxiang Feng , Xiaojie Wang

Computed Tomography (CT) scans are the standard-of-care for the visualization and diagnosis of many clinical ailments, and are needed for the treatment planning of external beam radiotherapy. Unfortunately, the availability of CT scanners…

Image and Video Processing · Electrical Eng. & Systems 2024-08-28 Yiran Sun , Hana Baroudi , Tucker Netherton , Laurence Court , Osama Mawlawi , Ashok Veeraraghavan , Guha Balakrishnan

Diffusion models have recently gained traction as a powerful class of deep generative priors, excelling in a wide range of image restoration tasks due to their exceptional ability to model data distributions. To solve image restoration…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Xiang Li , Soo Min Kwon , Shijun Liang , Ismail R. Alkhouri , Saiprasad Ravishankar , Qing Qu

Multi-modal foundation models are typically trained on millions of pairs of natural images and text captions, frequently obtained through web-crawling approaches. Although such models depict excellent generative capabilities, they do not…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Pierre Chambon , Christian Bluethgen , Curtis P. Langlotz , Akshay Chaudhari

Diffusion models have emerged as the leading paradigm in generative modeling, excelling in various applications. Despite their success, these models often misalign with human intentions and generate results with undesired properties or even…

Machine Learning · Computer Science 2026-02-06 Buhua Liu , Shitong Shao , Bao Li , Lichen Bai , Zhiqiang Xu , Haoyi Xiong , James Kwok , Sumi Helal , Zeke Xie

We propose a novel image editing technique that enables 3D manipulations on single images, such as object rotation and translation. Existing 3D-aware image editing approaches typically rely on synthetic multi-view datasets for training…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Ruicheng Wang , Jianfeng Xiang , Jiaolong Yang , Xin Tong

In vivo cardiac diffusion tensor imaging (cDTI) is a promising Magnetic Resonance Imaging (MRI) technique for evaluating the micro-structure of myocardial tissue in the living heart, providing insights into cardiac function and enabling the…

We present an inference-time diffusion sampling method to perform multi-view consistent image editing using pre-trained 2D image editing models. These models can independently produce high-quality edits for each image in a set of multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Hadi Alzayer , Yunzhi Zhang , Chen Geng , Jia-Bin Huang , Jiajun Wu

Discriminative classifiers have become a foundational tool in deep learning for medical imaging, excelling at learning separable features of complex data distributions. However, these models often need careful design, augmentation, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Gian Mario Favero , Parham Saremi , Emily Kaczmarek , Brennan Nichyporuk , Tal Arbel

We propose a cascaded 3D diffusion model framework to synthesize high-fidelity 3D PET/CT volumes directly from demographic variables, addressing the growing need for realistic digital twins in oncologic imaging, virtual trials, and…

Image and Video Processing · Electrical Eng. & Systems 2025-05-29 Siyeop Yoon , Sifan Song , Pengfei Jin , Matthew Tivnan , Yujin Oh , Sekeun Kim , Dufan Wu , Xiang Li , Quanzheng Li