English
Related papers

Related papers: Diffusion Models for Implicit Image Segmentation E…

200 papers

Segmenting an object in a video presents significant challenges. Each pixel must be accurately labelled, and these labels must remain consistent across frames. The difficulty increases when the segmentation is with arbitrary granularity,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Amirhossein Alimohammadi , Sauradip Nag , Saeid Asgari Taghanaki , Andrea Tagliasacchi , Ghassan Hamarneh , Ali Mahdavi Amiri

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen

Medical image segmentation is a challenging task, made more difficult by many datasets' limited size and annotations. Denoising diffusion probabilistic models (DDPM) have recently shown promise in modelling the distribution of natural…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Margherita Rosnati , Melanie Roschewitz , Ben Glocker

Visual microscopic study of diseased tissue by pathologists has been the cornerstone for cancer diagnosis and prognostication for more than a century. Recently, deep learning methods have made significant advances in the analysis and…

Image and Video Processing · Electrical Eng. & Systems 2022-09-30 Puria Azadi Moghadam , Sanne Van Dalen , Karina C. Martin , Jochen Lennerz , Stephen Yip , Hossein Farahani , Ali Bashashati

This paper introduces a novel unified representation of diffusion models for image generation and segmentation. Specifically, we use a colormap to represent entity-level masks, addressing the challenge of varying entity numbers while…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Lu Qi , Lehan Yang , Weidong Guo , Yu Xu , Bo Du , Varun Jampani , Ming-Hsuan Yang

Diffusion models have shown an impressive ability to model complex data distributions, with several key advantages over GANs, such as stable training, better coverage of the training distribution's modes, and the ability to solve inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Yinbo Chen , Oliver Wang , Richard Zhang , Eli Shechtman , Xiaolong Wang , Michael Gharbi

This paper introduces an approach, named DFormer, for universal image segmentation. The proposed DFormer views universal image segmentation task as a denoising process using a diffusion model. DFormer first adds various levels of Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Hefeng Wang , Jiale Cao , Rao Muhammad Anwer , Jin Xie , Fahad Shahbaz Khan , Yanwei Pang

Image segmentation is important in medical imaging, providing valuable, quantitative information for clinical decision-making in diagnosis, therapy, and intervention. The state-of-the-art in automated segmentation remains supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Margherita Rosnati , Fabio De Sousa Ribeiro , Miguel Monteiro , Daniel Coelho de Castro , Ben Glocker

Image segmentation is a fundamental and challenging problem in computer vision with applications spanning multiple areas, such as medical imaging, remote sensing, and autonomous vehicles. Recently, convolutional neural networks (CNNs) have…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Ali Hatamizadeh

The semantic segmentation of skin lesions is an important and common initial task in the computer aided diagnosis of dermoscopic images. Although deep learning-based approaches have considerably improved the segmentation accuracy, there is…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Kumar Abhishek , Ghassan Hamarneh , Mark S. Drew

Denoising Diffusion Models (DDMs) are widely used for high-quality image generation and medical image segmentation but often rely on Unet-based architectures, leading to high computational overhead, especially with high-resolution images.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Avni Mittal , John Kalkhof , Anirban Mukhopadhyay , Arnav Bhavsar

The brain white matter consists of a set of tracts that connect distinct regions of the brain. Segmentation of these tracts is often needed for clinical and research studies. Diffusion-weighted MRI offers unique contrast to delineate these…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Hamza Kebiri , Ali Gholipour , Meritxell Bach Cuadra , Davood Karimi

This paper presents a new regularization method to train a fully convolutional network for semantic tissue segmentation in histopathological images. This method relies on the benefit of unsupervised learning, in the form of image…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 C. T. Sari , C. Sokmensuer , C. Gunduz-Demir

Current semantic segmentation models typically require a substantial amount of manually annotated data, a process that is both time-consuming and resource-intensive. Alternatively, leveraging advanced text-to-image models such as Midjourney…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Bo Gao , Jianhui Wang , Xinyuan Song , Yangfan He , Fangxu Xing , Tianyu Shi

In this paper, we aim to improve the performance of semantic image segmentation in a semi-supervised setting in which training is effectuated with a reduced set of annotated images and additional non-annotated images. We present a method…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Jizong Peng , Guillermo Estrada , Marco Pedersoli , Christian Desrosiers

We present Generative Semantic Segmentation (GSS), a generative learning approach for semantic segmentation. Uniquely, we cast semantic segmentation as an image-conditioned mask generation problem. This is achieved by replacing the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Jiaqi Chen , Jiachen Lu , Xiatian Zhu , Li Zhang

Quantifying aleatoric uncertainty in medical image segmentation is critical since it is a reflection of the natural variability observed among expert annotators. A conventional approach is to model the segmentation distribution using the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Phi Van Nguyen , Ngoc Huynh Trinh , Duy Minh Lam Nguyen , Phu Loc Nguyen , Quoc Long Tran

Text-based image segmentation aims to delineate object boundaries within an image from text prompts, offering higher flexibility and broader application scope compared to traditional fixed-category segmentation tasks. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Zishen Qu , Xuesong Li , Haijian Gu , Hongwei Kang , Quan Meng , Tianrui Niu , Xin Yang , Ruidong Pan

The robustness of image segmentation has been an important research topic in the past few years as segmentation models have reached production-level accuracy. However, like classification models, segmentation models can be vulnerable to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Othmane Laousy , Alexandre Araujo , Guillaume Chassagnon , Marie-Pierre Revel , Siddharth Garg , Farshad Khorrami , Maria Vakalopoulou

Medical image analysis plays a pivotal role in the early diagnosis of diseases such as skin lesions. However, the scarcity of data and the class imbalance significantly hinder the performance of deep learning models. We propose a novel…

Image and Video Processing · Electrical Eng. & Systems 2025-07-29 Zhaobin Xu