English
Related papers

Related papers: Soft-Label Anonymous Gastric X-ray Image Distillat…

200 papers

In medical imaging, developing generalized segmentation models that can handle multiple organs and lesions is crucial. However, the scarcity of fully annotated datasets and strict privacy regulations present significant barriers to data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Pochuan Wang , Chen Shen , Masahiro Oda , Chiou-Shann Fuh , Kensaku Mori , Weichung Wang , Holger R. Roth

Domain adaptive person re-identification (re-ID) is a challenging task due to the large discrepancy between the source domain and the target domain. To reduce the domain discrepancy, existing methods mainly attempt to generate pseudo labels…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Junhui Yin , Jiayan Qiu , Siqing Zhang , Zhanyu Ma , Jun Guo

We propose a novel medical image classification method that integrates dual-model weight selection with self-knowledge distillation (SKD). In real-world medical settings, deploying large-scale models is often limited by computational…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Ayaka Tsutsumi , Guang Li , Ren Togo , Takahiro Ogawa , Satoshi Kondo , Miki Haseyama

The introduction of data analytics into medicine has changed the nature of patient treatment. In this, patients are asked to disclose personal information such as genetic markers, lifestyle habits, and clinical history. This data is then…

Cryptography and Security · Computer Science 2017-10-17 Z. Berkay Celik , David Lopez-Paz , Patrick McDaniel

While medical image segmentation is an important task for computer aided diagnosis, the high expertise requirement for pixelwise manual annotations makes it a challenging and time consuming task. Since conventional data augmentations do not…

Image and Video Processing · Electrical Eng. & Systems 2021-06-21 Dwarikanath Mahapatra , Ankur Singh

Dataset distillation aims to create a small and highly representative synthetic dataset that preserves the essential information of a larger real dataset. Beyond reducing storage and computational costs, related approaches offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Zhe Li , Hadrien Reynaud , Bernhard Kainz

Medical image segmentation is crucial in the field of medical imaging, aiding in disease diagnosis and surgical planning. Most established segmentation methods rely on supervised deep learning, in which clean and precise labels are…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Jiahua Dong , Yue Zhang , Qiuli Wang , Ruofeng Tong , Shihong Ying , Shaolin Gong , Xuanpu Zhang , Lanfen Lin , Yen-Wei Chen , S. Kevin Zhou

Recent work on distilling Whisper's knowledge into small models using pseudo-labels shows promising performance while reducing the size by up to 50%. This results in small, efficient, and dedicated models. However, a critical step of…

Computation and Language · Computer Science 2025-05-16 Abdul Waheed , Karima Kadaoui , Bhiksha Raj , Muhammad Abdul-Mageed

Knowledge distillation allows transferring knowledge from a pre-trained model to another. However, it suffers from limitations, and constraints related to the two models need to be architecturally similar. Knowledge distillation addresses…

Image and Video Processing · Electrical Eng. & Systems 2020-09-03 Sajjad Abbasi , Mohsen Hajabdollahi , Pejman Khadivi , Nader Karimi , Roshanak Roshandel , Shahram Shirani , Shadrokh Samavi

Obtaining pixel-level annotations in the medical domain is both expensive and time-consuming, often requiring close collaboration between clinical experts and developers. Semi-supervised medical image segmentation aims to leverage limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Lin Xi , Yingliang Ma , Cheng Wang , Sandra Howell , Aldo Rinaldi , Kawal S. Rhode

Knowledge distillation (KD) has been a popular and effective method for model compression. One important assumption of KD is that the original training dataset is always available. However, this is not always the case due to privacy…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Logan Frank , Jim Davis

Surgical scene understanding is a key prerequisite for contextaware decision support in the operating room. While deep learning-based approaches have already reached or even surpassed human performance in various fields, the task of…

In this study, we introduce a generative model that can synthesize a large number of radiographical image/label pairs, and thus is asymptotically favorable to downstream activities such as segmentation in bio-medical image analysis.…

Image and Video Processing · Electrical Eng. & Systems 2023-04-20 Pham Ngoc Huy , Tran Minh Quan

Medical image classification plays a crucial role in computer-aided clinical diagnosis. While deep learning techniques have significantly enhanced efficiency and reduced costs, the privacy-sensitive nature of medical imaging data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Sufen Ren , Yule Hu , Shengchao Chen , Guanjun Wang

Automated multi-label chest X-rays (CXR) image classification has achieved substantial progress in clinical diagnosis via utilizing sophisticated deep learning approaches. However, most deep models have high computational demands, which…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Chakkrit Termritthikun , Ayaz Umer , Suwichaya Suwanwimolkul , Feng Xia , Ivan Lee

In medical organizations large amount of personal data are collected and analyzed by the data miner or researcher, for further perusal. However, the data collected may contain sensitive information such as specific disease of a patient and…

Cryptography and Security · Computer Science 2012-03-19 Pawan R Bhaladhare , Devesh Jinwala

It is essential but challenging to share medical image datasets due to privacy issues, which prohibit building foundation models and knowledge transfer. In this paper, we propose a novel dataset distillation method to condense the original…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Zhen Yu , Yang Liu , Qingchao Chen

Knowledge distillation with unlabeled examples is a powerful training paradigm for generating compact and lightweight student models in applications where the amount of labeled data is limited but one has access to a large pool of unlabeled…

Machine Learning · Computer Science 2023-06-12 Vasilis Kontonis , Fotis Iliopoulos , Khoa Trinh , Cenk Baykal , Gaurav Menghani , Erik Vee

The field of medical image segmentation is hindered by the scarcity of large, publicly available annotated datasets. Not all datasets are made public for privacy reasons, and creating annotations for a large dataset is time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Iira Häkkinen , Iaroslav Melekhov , Erik Englesson , Hossein Azizpour , Juho Kannala

With the rapid advancement of artificial intelligence and deep learning, medical image analysis has become a critical tool in modern healthcare, significantly improving diagnostic accuracy and efficiency. However, AI-based methods also…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew , Hui Tian