English
Related papers

Related papers: EchoDFKD: Data-Free Knowledge Distillation for Car…

200 papers

Echocardiography plays a critical role in the diagnosis and monitoring of cardiovascular diseases as a non-invasive real-time assessment of cardiac structure and function. However, the growing scale of echocardiographic video data presents…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zhe Li , Hadrien Reynaud , Alberto Gomez , Bernhard Kainz

Data-free knowledge distillation (DFKD) is a widely-used strategy for Knowledge Distillation (KD) whose training data is not available. It trains a lightweight student model with the aid of a large pretrained teacher model without any…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jingru Li , Sheng Zhou , Liangcheng Li , Haishuai Wang , Zhi Yu , Jiajun Bu

Data-free knowledge distillation (DFKD) has emerged as a pivotal technique in the domain of model compression, substantially reducing the dependency on the original training data. Nonetheless, conventional DFKD methods that employ…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Muquan Li , Dongyang Zhang , Tao He , Xiurui Xie , Yuan-Fang Li , Ke Qin

Data-free knowledge distillation (DFKD) has recently been attracting increasing attention from research communities, attributed to its capability to compress a model only using synthetic data. Despite the encouraging results achieved,…

Machine Learning · Computer Science 2022-02-28 Gongfan Fang , Kanya Mo , Xinchao Wang , Jie Song , Shitao Bei , Haofei Zhang , Mingli Song

High-quality, large-scale data is essential for robust deep learning models in medical applications, particularly ultrasound image analysis. Diffusion models facilitate high-fidelity medical image generation, reducing the costs associated…

Image and Video Processing · Electrical Eng. & Systems 2024-04-01 Pooria Ashrafian , Milad Yazdani , Moein Heidari , Dena Shahriari , Ilker Hacihaliloglu

Synthetic data generation represents a significant advancement in boosting the performance of machine learning (ML) models, particularly in fields where data acquisition is challenging, such as echocardiography. The acquisition and labeling…

Machine Learning · Computer Science 2025-08-28 Nima Kondori , Hanwen Liang , Hooman Vaseli , Bingyu Xie , Christina Luong , Purang Abolmaesumi , Teresa Tsang , Renjie Liao

Electrocardiogram (ECG) monitoring in Internet of Medical Things (IoMT) networks is constrained by strict data-sharing regulations and privacy concerns. Federated learning (FL) enables collaborative learning by keeping raw ECG data on…

Artificial Intelligence · Computer Science 2026-05-15 Zixuan Shu , Tiancheng Cao , Hen-Wei Huang

Data-free knowledge distillation (DFKD) aims to obtain a lightweight student model without original training data. Existing works generally synthesize data from the pre-trained teacher model to replace the original training data for student…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Shiya Luo , Defang Chen , Can Wang

Accurate identification of End-Diastolic (ED) and End-Systolic (ES) frames is key for cardiac function assessment through echocardiography. However, traditional methods face several limitations: they require extensive amounts of data,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Zhenyu Bu , Yang Liu , Jiayu Huo , Jingjing Peng , Kaini Wang , Guangquan Zhou , Rachel Sparks , Prokar Dasgupta , Alejandro Granados , Sebastien Ourselin

Data-Free Knowledge Distillation (DFKD) is a novel task that aims to train high-performance student models using only the pre-trained teacher network without original training data. Most of the existing DFKD methods rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yuzheng Wang , Zhaoyu Chen , Jie Zhang , Dingkang Yang , Zuhao Ge , Yang Liu , Siao Liu , Yunquan Sun , Wenqiang Zhang , Lizhe Qi

Data-free knowledge distillation (DFKD) is a promising approach for addressing issues related to model compression, security privacy, and transmission restrictions. Although the existing methods exploiting DFKD have achieved inspiring…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Renrong Shao , Wei Zhang , Jianhua Yin , Jun Wang

Data-Free Knowledge Distillation (KD) allows knowledge transfer from a trained neural network (teacher) to a more compact one (student) in the absence of original training data. Existing works use a validation set to monitor the accuracy of…

Machine Learning · Computer Science 2024-07-30 Kuluhan Binici , Shivam Aggarwal , Nam Trung Pham , Karianto Leman , Tulika Mitra

Deep learning-based speech enhancement (SE) models have recently outperformed traditional techniques, yet their deployment on resource-constrained devices remains challenging due to high computational and memory demands. This paper…

Sound · Computer Science 2025-02-10 Xihao Yuan , Siqi Liu , Hanting Chen , Lu Zhou , Jian Li , Jie Hu

Histopathology can help clinicians make accurate diagnoses, determine disease prognosis, and plan appropriate treatment strategies. As deep learning techniques prove successful in the medical domain, the primary challenges become limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Zhe Li , Bernhard Kainz

The success of deep convolutional neural networks is partially attributed to the massive amount of annotated training data. However, in practice, medical data annotations are usually expensive and time-consuming to be obtained. Considering…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Kang Li , Lequan Yu , Shujun Wang , Pheng-Ann Heng

Purpose: Advances in surgical phase recognition are generally led by training deeper networks. Rather than going further with a more complex solution, we believe that current models can be exploited better. We propose a self-knowledge…

Image and Video Processing · Electrical Eng. & Systems 2023-06-16 Jinglu Zhang , Santiago Barbarisi , Abdolrahim Kadkhodamohammadi , Danail Stoyanov , Imanol Luengo

We propose a novel pipeline for the generation of synthetic ultrasound images via Denoising Diffusion Probabilistic Models (DDPMs) guided by cardiac semantic label maps. We show that these synthetic images can serve as a viable substitute…

Image and Video Processing · Electrical Eng. & Systems 2023-08-16 David Stojanovski , Uxio Hermida , Pablo Lamata , Arian Beqiri , Alberto Gomez

Accurate analysis of 3D myocardium deformation using high-resolution computerized tomography (CT) datasets with ground truth (GT) annotations is crucial for advancing cardiovascular imaging research. However, the scarcity of such datasets…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Shahar Zuler , Dan Raviv

Coronary artery disease is a leading cause of mortality, underscoring the critical importance of precise diagnosis through X-ray angiography. Manual coronary artery segmentation from these images is time-consuming and inefficient, prompting…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Mingfeng Lin

Conditional video diffusion models (CDM) have shown promising results for video synthesis, potentially enabling the generation of realistic echocardiograms to address the problem of data scarcity. However, current CDMs require a paired…

Image and Video Processing · Electrical Eng. & Systems 2024-09-09 Van Phi Nguyen , Tri Nhan Luong Ha , Huy Hieu Pham , Quoc Long Tran
‹ Prev 1 2 3 10 Next ›