English
Related papers

Related papers: PACD-Net: Pseudo-Augmented Contrastive Distillatio…

200 papers

In this paper, we propose a simple yet effective contrastive knowledge distillation framework that achieves sample-wise logit alignment while preserving semantic consistency. Conventional knowledge distillation approaches exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Wencheng Zhu , Xin Zhou , Pengfei Zhu , Yu Wang , Qinghua Hu

Understanding how biomarker distributions evolve over time is a central challenge in digital health and chronic disease monitoring. In diabetes, changes in the distribution of glucose measurements can reveal patterns of disease progression…

Machine Learning · Statistics 2026-03-26 Antonio Álvarez-López , Marcos Matabuena

Purpose: In curriculum learning, the idea is to train on easier samples first and gradually increase the difficulty, while in self-paced learning, a pacing function defines the speed to adapt the training progress. While both methods…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Mobarakol Islam , Lalithkumar Seenivasan , S. P. Sharan , V. K. Viekash , Bhavesh Gupta , Ben Glocker , Hongliang Ren

Continual learning (CL) has shown promising results and comparable performance to learning at once in a fully supervised manner. However, CL strategies typically require a large number of labeled samples, making their real-life deployment…

Machine Learning · Computer Science 2025-01-15 Yan Fan , Yu Wang , Pengfei Zhu , Qinghua Hu

Data-driven models for glucose level forecast often do not provide meaningful insights despite accurate predictions. Yet, context understanding in medicine is crucial, in particular for diabetes management. In this paper, we introduce…

Machine Learning · Computer Science 2021-11-16 Quentin Blampey , Mehdi Rahim

A task of vital clinical importance, within Diabetes management, is the prevention of hypo/hyperglycemic events. Increasingly adopted Continuous Glucose Monitoring (CGM) devices offer detailed, non-intrusive and real time insights into a…

Machine Learning · Computer Science 2023-03-09 Jakub J. Dylag

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

Machine Learning · Computer Science 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

Cross-modal Knowledge Distillation has demonstrated promising performance on paired modalities with strong semantic connections, referred to as Symmetric Cross-modal Knowledge Distillation (SCKD). However, implementing SCKD becomes…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Riling Wei , Kelu Yao , Chuanguang Yang , Jin Wang , Zhuoyan Gao , Chao Li

Large-scale contrastive learning models can learn very informative sentence embeddings, but are hard to serve online due to the huge model size. Therefore, they often play the role of "teacher", transferring abilities to small "student"…

Artificial Intelligence · Computer Science 2023-01-31 Chaochen Gao , Xing Wu , Peng Wang , Jue Wang , Liangjun Zang , Zhongyuan Wang , Songlin Hu

Intelligent fault diagnosis has made extraordinary advancements currently. Nonetheless, few works tackle class-incremental learning for fault diagnosis under limited fault data, i.e., imbalanced and long-tailed fault diagnosis, which brings…

Machine Learning · Computer Science 2023-02-14 Peng Peng , Hanrong Zhang , Mengxuan Li , Gongzhuang Peng , Hongwei Wang , Weiming Shen

Cognitive diagnosis is a fundamental yet critical research task in the field of intelligent education, which aims to discover the proficiency level of different students on specific knowledge concepts. Despite the effectiveness of existing…

Computers and Society · Computer Science 2022-10-18 Shanshan Wang , Zhen Zeng , Xun Yang , Xingyi Zhang

In this study, we presented two innovative methods, which are Threshold-Based Derivative (TBD) and Adaptive Derivative Peak Detection(ADPD), that enhance the accuracy of Learning models for blood glucose estimation using Mid-Infrared (MIR)…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Saeed Mansourlakouraj , Hadi Barati , Mehdi Fardmanesh

Knowledge distillation aims to transfer representation ability from a teacher model to a student model. Previous approaches focus on either individual representation distillation or inter-sample similarity preservation. While we argue that…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Jinguo Zhu , Shixiang Tang , Dapeng Chen , Shijie Yu , Yakun Liu , Aijun Yang , Mingzhe Rong , Xiaohua Wang

Sustained high levels of blood glucose in type 2 diabetes (T2DM) can have disastrous long-term health consequences. An essential component of clinical interventions for T2DM is monitoring dietary intake to keep plasma glucose levels within…

Quantitative Methods · Quantitative Biology 2022-06-24 Zepeng Huo , Bobak J. Mortazavi , Theodora Chaspari , Nicolaas Deutz , Laura Ruebush , Ricardo Gutierrez-Osuna

Temporal Betweenness Centrality (TBC) measures how often a node appears on optimal temporal paths, reflecting its importance in temporal networks. However, exact computation is highly expensive, and real-world TBC distributions are…

Machine Learning · Computer Science 2025-06-18 Tianming Zhang , Renbo Zhang , Zhengyi Yang , Yunjun Gao , Bin Cao , Jing Fan

Precise glucose level monitoring is critical for people with diabetes to avoid serious complications. While there are several methods for continuous glucose level monitoring, research on maintenance devices is limited. To mitigate the gap,…

Machine Learning · Computer Science 2024-06-10 Azmine Toushik Wasi

Managing Type 1 Diabetes (T1D) demands constant vigilance as individuals strive to regulate their blood glucose levels and avoid dysglycemia, including hyperglycemia and hypoglycemia. Despite advances in automated insulin delivery (AID)…

Machine Learning · Computer Science 2026-02-26 Saman Khamesian , Asiful Arefeen , Maria Adela Grando , Bithika M. Thompson , Hassan Ghasemzadeh

In the UK, approximately 400,000 people with type 1 diabetes (T1D) rely on insulin delivery due to insufficient pancreatic insulin production. Managing blood glucose (BG) levels is crucial, with continuous glucose monitoring (CGM) playing a…

Machine Learning · Computer Science 2023-12-21 Chengzhe Piao , Ken Li

Contrastive learning, as a self-supervised learning paradigm, becomes popular for Multivariate Time-Series (MTS) classification. It ensures the consistency across different views of unlabeled samples and then learns effective…

Machine Learning · Computer Science 2024-01-11 Yucheng Wang , Yuecong Xu , Jianfei Yang , Min Wu , Xiaoli Li , Lihua Xie , Zhenghua Chen

Continuous glucose monitoring (CGM) has been increasingly used in US hospitals for the care of patients with diabetes. Time in range (TIR), which measures the percent of time over a specified time window with glucose values within a target…

Methodology · Statistics 2024-10-07 Qi Yu , Guillermo E. Umpierrez , Limin Peng