English
Related papers

Related papers: Exploring Generalizable Distillation for Efficient…

200 papers

Contrastive learning has shown great promise over annotation scarcity problems in the context of medical image segmentation. Existing approaches typically assume a balanced class distribution for both labeled and unlabeled medical images.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Chenyu You , Weicheng Dai , Yifei Min , Lawrence Staib , James S. Duncan

Instance-aware embeddings predicted by deep neural networks have revolutionized biomedical instance segmentation, but its resource requirements are substantial. Knowledge distillation offers a solution by transferring distilled knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Xiaoyu Liu , Yueyi Zhang , Zhiwei Xiong , Wei Huang , Bo Hu , Xiaoyan Sun , Feng Wu

The universality of deep neural networks across different modalities and their generalization capabilities to unseen domains play an essential role in medical image segmentation. The recent segment anything model (SAM) has demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Qing Xu , Jiaxuan Li , Xiangjian He , Chenxin Li , Fiseha B. Tesem , Wenting Duan , Zhen Chen , Rong Qu , Jonathan M. Garibaldi , Chang Wen Chen

Generalising deep models to new data from new centres (termed here domains) remains a challenge. This is largely attributed to shifts in data statistics (domain shifts) between source and unseen domains. Recently, gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xiao Liu , Spyridon Thermos , Alison O'Neil , Sotirios A. Tsaftaris

Single-source domain generalization (SDG) in medical image segmentation remains a significant challenge, particularly for images with varying color distributions and qualities. Previous approaches often struggle when models trained on…

Image and Video Processing · Electrical Eng. & Systems 2025-02-12 Ravi Shah , Atsushi Fukuda , Quan Huu Cap

Knowledge distillation (KD) has been widely applied in semantic segmentation to compress large models, but conventional approaches primarily preserve in-domain accuracy while neglecting out-of-domain generalization, which is essential under…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Chonghua Lv , Dong Zhao , Shuang Wang , Dou Quan , Ning Huyan , Nicu Sebe , Zhun Zhong

Distilling knowledge from huge pre-trained networks to improve the performance of tiny networks has favored deep learning models to be used in many real-time and mobile applications. Several approaches that demonstrate success in this field…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Kaushal Bhogale

Domain shifts in medical image segmentation, particularly when data comes from different centers, pose significant challenges. Intra-center variability, such as differences in scanner models or imaging protocols, can cause domain shifts as…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jin Hong , Bo Liu

Domain generalization is the task of learning models that generalize to unseen target domains. We propose a simple yet effective method for domain generalization, named cross-domain ensemble distillation (XDED), that learns domain-invariant…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Kyungmoon Lee , Sungyeon Kim , Suha Kwak

Accurate medical image segmentation is essential for effective diagnosis and treatment planning but is often challenged by domain shifts caused by variations in imaging devices, acquisition conditions, and patient-specific attributes.…

Image and Video Processing · Electrical Eng. & Systems 2024-12-06 Jie Bao , Zhixin Zhou , Wen Jung Li , Rui Luo

Domain Adaptation is a technique to address the lack of massive amounts of labeled data in unseen environments. Unsupervised domain adaptation is proposed to adapt a model to new modalities using solely labeled source data and unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Thong Vo , Naimul Khan

Semantic segmentation requires a holistic understanding of the physical world, as it assigns semantic labels to spatially continuous and structurally coherent objects rather than to isolated pixels. However, existing data-free knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hongxuan Sun , Tao Wu

Deep learning methods show promising results for overlapping cervical cell instance segmentation. However, in order to train a model with good generalization ability, voluminous pixel-level annotations are demanded which is quite expensive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Yanning Zhou , Hao Chen , Huangjing Lin , Pheng-Ann Heng

Deep neural networks (DNN) have demonstrated unprecedented success for medical imaging applications. However, due to the issue of limited dataset availability and the strict legal and ethical requirements for patient privacy protection, the…

Machine Learning · Computer Science 2023-09-19 Chris Xing Tian , Haoliang Li , Yufei Wang , Shiqi Wang

Background: Image classification can be considered one of the key pillars of medical image analysis. Deep learning (DL) faces challenges that prevent its practical applications despite the remarkable improvement in medical image…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Shahabedin Nabavi , Kian Anvari Hamedani , Mohsen Ebrahimi Moghaddam , Ahmad Ali Abin , Alejandro F. Frangi

Beyond the complexity of CNNs that require training on large annotated datasets, the domain shift between design and operational data has limited the adoption of CNNs in many real-world applications. For instance, in person…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Le Thanh Nguyen-Meidine , Atif Belal , Madhu Kiran , Jose Dolz , Louis-Antoine Blais-Morin , Eric Granger

A deep learning model trained on some labeled data from a certain source domain generally performs poorly on data from different target domains due to domain shifts. Unsupervised domain adaptation methods address this problem by alleviating…

Image and Video Processing · Electrical Eng. & Systems 2019-08-30 Junlin Yang , Nicha C. Dvornek , Fan Zhang , Julius Chapiro , MingDe Lin , James S. Duncan

Accurate 3D medical image segmentation is vital for diagnosis and treatment planning, but state-of-the-art models are often too large for clinics with limited computing resources. Lightweight architectures typically suffer significant…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Qizhen Lan , Yu-Chun Hsu , Nida Saddaf Khan , Xiaoqian Jiang

The domain gap caused mainly by variable medical image quality renders a major obstacle on the path between training a segmentation model in the lab and applying the trained model to unseen clinical data. To address this issue, domain…

Image and Video Processing · Electrical Eng. & Systems 2022-09-27 Shishuai Hu , Zehui Liao , Jianpeng Zhang , Yong Xia

Convolutional neural network (CNN), in particular the Unet, is a powerful method for medical image segmentation. To date Unet has demonstrated state-of-art performance in many complex medical image segmentation tasks, especially under the…

Image and Video Processing · Electrical Eng. & Systems 2019-10-31 Wenjun Yan , Yuanyuan Wang , Shengjia Gu , Lu Huang , Fuhua Yan , Liming Xia , Qian Tao