English
Related papers

Related papers: Exploring Generalizable Distillation for Efficient…

200 papers

Deploying medical image segmentation models in routine clinical workflows is often constrained by on-premises infrastructure, where computational resources are fixed and cloud-based inference may be restricted by governance and security…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Qizhen Lan , Aaron Choi , Jun Ma , Bo Wang , Zhaogming Zhao , Xiaoqian Jiang , Yu-Chun Hsu

Large-scale pre-trained models, such as Vision Foundation Models (VFMs), have demonstrated impressive performance across various downstream tasks by transferring generalized knowledge, especially when target data is limited. However, their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Pengchen Liang , Haishan Huang , Bin Pu , Jianguo Chen , Xiang Hua , Jing Zhang , Weibo Ma , Zhuangzhuang Chen , Yiwei Li , Qing Chang

Both accuracy and efficiency are of significant importance to the task of semantic segmentation. Existing deep FCNs suffer from heavy computations due to a series of high-resolution feature maps for preserving the detailed knowledge in…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Tong He , Chunhua Shen , Zhi Tian , Dong Gong , Changming Sun , Youliang Yan

Deep learning-based medical image segmentation faces significant challenges arising from limited labeled data and domain shifts. While prior approaches have primarily addressed these issues independently, their simultaneous occurrence is…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Zanting Ye , Ke Wang , Wenbing Lv , Qianjin Feng , Lijun Lu

Recently, we have witnessed great progress in the field of medical imaging classification by adopting deep neural networks. However, the recent advanced models still require accessing sufficiently large and representative datasets for…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Haoliang Li , YuFei Wang , Renjie Wan , Shiqi Wang , Tie-Qiang Li , Alex C. Kot

This thesis aims to investigate the feasibility of knowledge transfer between neural networks for medical image segmentation tasks, specifically focusing on the transfer from a larger multi-task "Teacher" network to a smaller "Student"…

Image and Video Processing · Electrical Eng. & Systems 2024-06-06 Risab Biswas

U-shaped networks and its variants have demonstrated exceptional results for medical image segmentation. In this paper, we propose a novel dual self-distillation (DSD) framework in U-shaped networks for volumetric medical image…

Image and Video Processing · Electrical Eng. & Systems 2025-05-05 Soumyanil Banerjee , Nicholas Summerfield , Ming Dong , Carri Glide-Hurst

Foundation Models (FMs) have demonstrated strong generalization across diverse vision tasks. However, their deployment in federated settings is hindered by high computational demands, substantial communication overhead, and significant…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Hanwen Zhang , Qiaojin Shen , Yuxi Liu , Yuesheng Zhu , Guibo Luo

Multi-modal learning is typically performed with network architectures containing modality-specific layers and shared layers, utilizing co-registered images of different modalities. We propose a novel learning scheme for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Qi Dou , Quande Liu , Pheng Ann Heng , Ben Glocker

The balance between high accuracy and high speed has always been a challenging task in semantic image segmentation. Compact segmentation networks are more widely used in the case of limited resources, while their performances are…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Yingchao Feng , Xian Sun , Wenhui Diao , Jihao Li , Xin Gao

Disentangled representation is a powerful technique to tackle domain shift problem in medical image analysis in unsupervised domain adaptation setting.However, previous methods only focus on exacting domain-invariant feature and ignore…

Image and Video Processing · Electrical Eng. & Systems 2023-03-07 Shuai Wang , Rui Li

Due to the cross-domain distribution shift aroused from diverse medical imaging systems, many deep learning segmentation methods fail to perform well on unseen data, which limits their real-world applicability. Recent works have shown the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Shangqi Gao , Hangqi Zhou , Yibo Gao , Xiahai Zhuang

The success of automated medical image analysis depends on large-scale and expert-annotated training sets. Unsupervised domain adaptation (UDA) has been raised as a promising approach to alleviate the burden of labeled data collection.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Jianan Fan , Dongnan Liu , Hang Chang , Heng Huang , Mei Chen , Weidong Cai

Single-source domain generalization (SDG) aims to learn a model from a single source domain that can generalize well on unseen target domains. This is an important task in computer vision, particularly relevant to medical imaging where…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Boqi Chen , Yuanzhi Zhu , Yunke Ao , Sebastiano Caprara , Reto Sutter , Gunnar Rätsch , Ender Konukoglu , Anna Susmelj

Medical image segmentation poses challenges due to domain gaps, data modality variations, and dependency on domain knowledge or experts, especially for low- and middle-income countries (LMICs). Whereas for humans, given a few exemplars…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Chen Xu , Qiming Huang , Yuqi Hou , Jiangxing Wu , Fan Zhang , Hyung Jin Chang , Jianbo Jiao

Recent advances in deep learning for medical image segmentation demonstrate expert-level accuracy. However, in clinically realistic environments, such methods have marginal performance due to differences in image domains, including…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Ling Zhang , Xiaosong Wang , Dong Yang , Thomas Sanford , Stephanie Harmon , Baris Turkbey , Holger Roth , Andriy Myronenko , Daguang Xu , Ziyue Xu

Generalization capabilities of learning-based medical image segmentation across domains are currently limited by the performance degradation caused by the domain shift, particularly for ultrasound (US) imaging. The quality of US images…

Image and Video Processing · Electrical Eng. & Systems 2024-02-07 Yuan Bi , Zhongliang Jiang , Ricarda Clarenbach , Reza Ghotbi , Angelos Karlas , Nassir Navab

While achieving remarkable success for medical image segmentation, deep convolution neural networks (DCNNs) often fail to maintain their robustness when confronting test data with the novel distribution. To address such a drawback, the…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Yuxin Kang , Hansheng Li , Xuan Zhao , Dongqing Hu , Feihong Liu , Lei Cui , Jun Feng , Lin Yang

Domain Generalization (DG), a crucial research area, seeks to train models across multiple domains and test them on unseen ones. In this paper, we introduce a novel approach, namely, Selective Cross-Modality Distillation for Domain…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Jixuan Leng , Yijiang Li , Haohan Wang

We tackle the challenging problem of single-source domain generalization (DG) for medical image segmentation, where we train a network on one domain (e.g., CT) and directly apply it to a different domain (e.g., MR) without adapting the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Franz Thaler , Martin Urschler , Mateusz Kozinski , Matthias AF Gsell , Gernot Plank , Darko Stern