English
Related papers

Related papers: Medical Semantic Segmentation with Diffusion Pretr…

200 papers

Many inverse problems are ill-posed and need to be complemented by prior information that restricts the class of admissible models. Bayesian approaches encode this information as prior distributions that impose generic properties on the…

Machine Learning · Computer Science 2024-12-20 Julian L. Möbius , Michael Habeck

Diffusion Probabilistic Methods are employed for state-of-the-art image generation. In this work, we present a method for extending such models for performing image segmentation. The method learns end-to-end, without relying on a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Tomer Amit , Tal Shaharbany , Eliya Nachmani , Lior Wolf

We introduce Diffusion Active Learning, a novel approach that combines generative diffusion modeling with data-driven sequential experimental design to adaptively acquire data for inverse problems. Although broadly applicable, we focus on…

Machine Learning · Computer Science 2025-04-07 Luis Barba , Johannes Kirschner , Tomas Aidukas , Manuel Guizar-Sicairos , Benjamín Béjar

Computer-aided medical image analysis plays a significant role in assisting medical practitioners for expert clinical diagnosis and deciding the optimal treatment plan. At present, convolutional neural networks (CNN) are the preferred…

Image and Video Processing · Electrical Eng. & Systems 2022-04-29 S Niyas , S J Pawan , M Anand Kumar , Jeny Rajan

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Weakly supervised medical image segmentation (MIS) using generative models is crucial for clinical diagnosis. However, the accuracy of the segmentation results is often limited by insufficient supervision and the complex nature of medical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Zhihao Shuai , Yinan Chen , Shunqiang Mao , Yihan Zho , Xiaohong Zhang

Many successful methods developed for medical image analysis that are based on machine learning use supervised learning approaches, which often require large datasets annotated by experts to achieve high accuracy. However, medical data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Banafshe Felfeliyan , Abhilash Hareendranathan , Gregor Kuntze , David Cornell , Nils D. Forkert , Jacob L. Jaremko , Janet L. Ronsky

Vision-language models have demonstrated impressive capabilities in generating 2D images under various conditions; however, the success of these models is largely enabled by extensive, readily available pretrained foundation models.…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 Mohamed Mohamed , Brennan Nichyporuk , Douglas L. Arnold , Tal Arbel

Learning meaningful protein representation is important for a variety of biological downstream tasks such as structure-based drug design. Having witnessed the success of protein sequence pretraining, pretraining for structural data which is…

Machine Learning · Computer Science 2023-02-23 Yufei Huang , Lirong Wu , Haitao Lin , Jiangbin Zheng , Ge Wang , Stan Z. Li

Accurate medical image segmentation is essential for effective diagnosis and treatment planning but is often challenged by domain shifts caused by variations in imaging devices, acquisition conditions, and patient-specific attributes.…

Image and Video Processing · Electrical Eng. & Systems 2024-12-06 Jie Bao , Zhixin Zhou , Wen Jung Li , Rui Luo

Dataset expansion can effectively alleviate the problem of data scarcity for medical image segmentation, due to privacy concerns and labeling difficulties. However, existing expansion algorithms still face great challenges due to their…

Image and Video Processing · Electrical Eng. & Systems 2023-06-07 Shitong Shao , Xiaohan Yuan , Zhen Huang , Ziming Qiu , Shuai Wang , Kevin Zhou

Denoising Diffusion Models (DDMs) are widely used for high-quality image generation and medical image segmentation but often rely on Unet-based architectures, leading to high computational overhead, especially with high-resolution images.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Avni Mittal , John Kalkhof , Anirban Mukhopadhyay , Arnav Bhavsar

In medical imaging, the diffusion models have shown great potential for synthetic image generation tasks. However, these approaches often lack the interpretable connections between the generated and real images and can create anatomically…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Jian-Qing Zheng , Yuanhan Mo , Yang Sun , Jiahua Li , Fuping Wu , Ziyang Wang , Tonia Vincent , Bartłomiej W. Papież

Ambiguity in medical image segmentation calls for models that capture full conditional distributions rather than a single point estimate. We present Prior-Guided Residual Diffusion (PGRD), a diffusion-based framework that learns voxel-wise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Fuyou Mao , Beining Wu , Yanfeng Jiang , Han Xue , Yan Tang , Hao Zhang

Extensive pre-training with large data is indispensable for downstream geometry and semantic visual perception tasks. Thanks to large-scale text-to-image (T2I) pretraining, recent works show promising results by simply fine-tuning T2I…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Guangkai Xu , Yongtao Ge , Mingyu Liu , Chengxiang Fan , Kangyang Xie , Zhiyue Zhao , Hao Chen , Chunhua Shen

A major focus of clinical imaging workflow is disease diagnosis and management, leading to medical imaging datasets strongly tied to specific clinical objectives. This scenario has led to the prevailing practice of developing task-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yunhe Gao , Zhuowei Li , Di Liu , Mu Zhou , Shaoting Zhang , Dimitris N. Metaxas

Deep convolutional neural networks (CNNs) are state-of-the-art for semantic image segmentation, but typically require many labeled training samples. Obtaining 3D segmentations of medical images for supervised training is difficult and labor…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Zhenlin Xu , Marc Niethammer

Vision-language models pre-trained on large scale of unlabeled biomedical images and associated reports learn generalizable semantic representations. These multi-modal representations can benefit various downstream tasks in the biomedical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Xinliu Zhong , Kayhan Batmanghelich , Li Sun

Diffusion models have emerged as powerful tools for 3D medical image generation, yet bridging the gap between standard training objectives and clinical relevance remains a challenge. This paper presents a method to enhance 3D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yueying Tian , Xudong Han , Meng Zhou , Rodrigo Aviles-Espinosa , Rupert Young , Philip Birch

Recent advances in implicit neural representations have achieved impressive results by sampling and fusing individual points along sampling rays in the sampling space. However, due to the explosively growing sampling space, finely…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Yuhan Ding , Fukun Yin , Jiayuan Fan , Hui Li , Xin Chen , Wen Liu , Chongshan Lu , Gang YU , Tao Chen