English
Related papers

Related papers: Self-Attention Diffusion Models for Zero-Shot Biom…

200 papers

Medical image segmentation is a challenging task with inherent ambiguity and high uncertainty, attributed to factors such as unclear tumor boundaries and multiple plausible annotations. The accuracy and diversity of segmentation masks are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Tao Chen , Chenhui Wang , Hongming Shan

Recently, large vision model, Segment Anything Model (SAM), has revolutionized the computer vision field, especially for image segmentation. SAM presented a new promptable segmentation paradigm that exhibit its remarkable zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Chenglong Wang , Dexuan Li , Sucheng Wang , Chengxiu Zhang , Yida Wang , Yun Liu , Guang Yang

Segment Anything Model (SAM) has demonstrated impressive zero-shot performance and brought a range of unexplored capabilities to natural image segmentation tasks. However, as a very important branch of image segmentation, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Xie , Hao Tang , Dawen Cai , Yan Yan , Gady Agam

Due to the lack of properly annotated medical data, exploring the generalization capability of the deep model is becoming a public concern. Zero-shot learning (ZSL) has emerged in recent years to equip the deep model with the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Cheng Bian , Chenglang Yuan , Kai Ma , Shuang Yu , Dong Wei , Yefeng Zheng

Diffusion models have been used extensively for high quality image and video generation tasks. In this paper, we propose a novel conditional diffusion model with spatial attention and latent embedding (cDAL) for medical image segmentation.…

Image and Video Processing · Electrical Eng. & Systems 2025-02-21 Behzad Hejrati , Soumyanil Banerjee , Carri Glide-Hurst , Ming Dong

Surgical instrument segmentation is a key component in developing context-aware operating rooms. Existing works on this task heavily rely on the supervision of a large amount of labeled data, which involve laborious and expensive human…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Daochang Liu , Yuhui Wei , Tingting Jiang , Yizhou Wang , Rulin Miao , Fei Shan , Ziyu Li

Medical image segmentation is crucial for accurate clinical diagnoses, yet it faces challenges such as low contrast between lesions and normal tissues, unclear boundaries, and high variability across patients. Deep learning has improved…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Houze Liu , Tong Zhou , Yanlin Xiang , Aoran Shen , Jiacheng Hu , Junliang Du

Do the rich representations of multi-modal diffusion transformers (DiTs) exhibit unique properties that enhance their interpretability? We introduce ConceptAttention, a novel method that leverages the expressive power of DiT attention…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Alec Helbling , Tuna Han Salih Meral , Ben Hoover , Pinar Yanardag , Duen Horng Chau

Eye gaze that reveals human observational patterns has increasingly been incorporated into solutions for vision tasks. Despite recent explorations on leveraging gaze to aid deep networks, few studies exploit gaze as an efficient annotation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Yuan Zhong , Chenhui Tang , Yumeng Yang , Ruoxi Qi , Kang Zhou , Yuqi Gong , Pheng Ann Heng , Janet H. Hsiao , Qi Dou

High-quality pixel-level annotations of medical images are essential for supervised segmentation tasks, but obtaining such annotations is costly and requires medical expertise. To address this challenge, we propose a novel coarse-to-fine…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Anghong Du , Nay Aung , Theodoros N. Arvanitis , Stefan K. Piechnik , Joao A C Lima , Steffen E. Petersen , Le Zhang

Weakly supervised medical image segmentation (MIS) using generative models is crucial for clinical diagnosis. However, the accuracy of the segmentation results is often limited by insufficient supervision and the complex nature of medical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Zhihao Shuai , Yinan Chen , Shunqiang Mao , Yihan Zho , Xiaohong Zhang

Aside from offering state-of-the-art performance in medical image generation, denoising diffusion probabilistic models (DPM) can also serve as a representation learner to capture semantic information and potentially be used as an image…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Chun-Mei Feng

Most existing approaches to referring segmentation achieve strong performance only through fine-tuning or by composing multiple pre-trained models, often at the cost of additional training and architectural modifications. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Anna Kukleva , Enis Simsar , Alessio Tonioni , Muhammad Ferjad Naeem , Federico Tombari , Jan Eric Lenssen , Bernt Schiele

Pixel-wise segmentation is one of the most data and annotation hungry tasks in our field. Providing representative and accurate annotations is often mission-critical especially for challenging medical applications. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Simon Reiß , Constantin Seibold , Alexander Freytag , Erik Rodner , Rainer Stiefelhagen

Deep learning-based segmentation methods have been widely employed for automatic glaucoma diagnosis and prognosis. In practice, fundus images obtained by different fundus cameras vary significantly in terms of illumination and intensity.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Qianbi Yu , Dongnan Liu , Chaoyi Zhang , Xinwen Zhang , Weidong Cai

Based on the Denoising Diffusion Probabilistic Model (DDPM), medical image segmentation can be described as a conditional image generation task, which allows to compute pixel-wise uncertainty maps of the segmentation and allows an implicit…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Xutao Guo , Yanwu Yang , Chenfei Ye , Shang Lu , Yang Xiang , Ting Ma

The advent of foundation models signals a new era in artificial intelligence. The Segment Anything Model (SAM) is the first foundation model for image segmentation. In this study, we evaluate SAM's ability to segment features from eye…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marcus Nyström , Enkelejda Kasneci

Deep learning-based image generation has seen significant advancements with diffusion models, notably improving the quality of generated images. Despite these developments, generating images with unseen characteristics beneficial for…

Clustering tabular data remains a significant open challenge in data analysis and machine learning. Unlike for image data, similarity between tabular records often varies across datasets, making the definition of clusters highly…

Machine Learning · Computer Science 2025-10-27 Patryk Marszałek , Tomasz Kuśmierczyk , Witold Wydmański , Jacek Tabor , Marek Śmieja

Successive proposals of several self-supervised training schemes continue to emerge, taking one step closer to developing a universal foundation model. In this process, the unsupervised downstream tasks are recognized as one of the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Sonal Kumar , Arijit Sur , Rashmi Dutta Baruah