English
Related papers

Related papers: Hybrid Attention Model Using Feature Decomposition…

200 papers

In the knowledge distillation literature, feature-based methods have dominated due to their ability to effectively tap into extensive teacher models. In contrast, logit-based approaches, which aim to distill "dark knowledge" from teachers,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Md. Ismail Hossain , M M Lutfe Elahi , Sameera Ramasinghe , Ali Cheraghian , Fuad Rahman , Nabeel Mohammed , Shafin Rahman

Convolutional neural networks (CNNs) are extensively beneficial for medical image processing. Medical images are plentiful, but there is a lack of annotated data. Transfer learning is used to solve the problem of lack of labeled data and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Sajjad Abbasi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi , Shahram Shirani

To avoid serious diabetic complications, people with type 1 diabetes must keep their blood glucose levels (BGLs) as close to normal as possible. Insulin dosages and carbohydrate consumption are important considerations in managing BGLs.…

Machine Learning · Computer Science 2021-05-19 Jeremy Beauchamp , Razvan Bunescu , Cindy Marling , Zhongen Li , Chang Liu

Diabetes is a prevalent chronic condition that compromises the health of millions of people worldwide. Minimally invasive methods are needed to prevent and control diabetes but most devices for measuring glucose levels are invasive and not…

Accurately detecting hypoglycemia without invasive glucose sensors remains a critical challenge in diabetes management, particularly in regions where continuous glucose monitoring (CGM) is prohibitively expensive or clinically inaccessible.…

Human-Computer Interaction · Computer Science 2026-02-12 Lawrence Obiuwevwi , Krzysztof J. Rechowicz , Vikas Ashok , Sampath Jayarathna

Type 1 diabetes (T1D) is a highly metabolically heterogeneous disease that cannot be adequately characterized by conventional biomarkers such as glycated hemoglobin (HbA1c). This study proposes an explainable deep learning framework that…

Machine Learning · Computer Science 2026-01-09 Pir Bakhsh Khokhar , Carmine Gravino , Fabio Palomba , Sule Yildrim Yayilgan , Sarang Shaikh

Continuous glucose monitoring (CGM) is a minimally invasive technology that measures blood glucose every few minutes for weeks or months at a time. CGM data are often collected in the free-living environment and is strongly related to…

Methodology · Statistics 2025-09-04 Marcos Matabuena , Ciprian M. Crainiceanu

In this study, we present a non-invasive glucose prediction system that integrates Near-Infrared (NIR) spectroscopy and millimeter-wave (mm-wave) sensing. We employ a Mixed Linear Model (MixedLM) to analyze the association between mm-wave…

Machine Learning · Computer Science 2024-09-12 Yuyang Sun , Panagiotis Kosmas

Lung cancer is a leading cause of cancer-related deaths globally, where early detection and accurate diagnosis are critical for improving survival rates. While deep learning, particularly convolutional neural networks (CNNs), has…

Image and Video Processing · Electrical Eng. & Systems 2025-05-15 Sadman Sakib Alif , Nasim Anzum Promise , Fiaz Al Abid , Aniqua Nusrat Zereen

Recently Transformer-based hyperspectral image (HSI) change detection methods have shown remarkable performance. Nevertheless, existing attention mechanisms in Transformers have limitations in local feature representation. To address this…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Ziyi Wang , Feng Gao , Junyu Dong , Qian Du

Artificial intelligence (AI) is increasingly used in every stage of drug development. Continuing breakthroughs in AI-based methods for drug discovery require the creation, improvement, and refinement of drug discovery data. We posit a new…

Machine Learning · Computer Science 2024-05-08 Bing Hu , Ashish Saragadam , Anita Layton , Helen Chen

Blood glucose value prediction is an important task in diabetes management. While it is reported that glucose concentration is sensitive to social context such as mood, physical activity, stress, diet, alongside the influence of diabetes…

Machine Learning · Statistics 2019-09-05 Mohammad Akbari , Rumi Chunara

The dead-in-bed syndrome describes the sudden and unexplained death of young individuals with Type 1 Diabetes (T1D) without prior long-term complications. One leading hypothesis attributes this phenomenon to nocturnal hypoglycemia (NH), a…

Machine Learning · Computer Science 2025-04-15 Marco Voegeli , Sonia Laguna , Heike Leutheuser , Marc Pfister , Marie-Anne Burckhardt , Julia E Vogt

Time series forecasting requires capturing patterns across multiple temporal scales while maintaining computational efficiency. This paper introduces AWGformer, a novel architecture that integrates adaptive wavelet decomposition with…

Machine Learning · Computer Science 2026-01-29 Wei Li

Accurately forecasting the bursty and non-stationary power demand of AI data centers has become increasingly important, as abrupt workload-driven variations at the GPU-node level can affect real-time operational efficiency, power…

Systems and Control · Electrical Eng. & Systems 2026-05-04 Lei Wang , Jiahao Chen , Fanping Sui , Ying Zhang , Di Shi

This work focuses on the efficiency of the knowledge distillation approach in generating a lightweight yet powerful BERT based model for natural language processing applications. After the model creation, we applied the resulting model,…

Computation and Language · Computer Science 2024-11-04 Ahmed Akib Jawad Karim , Kazi Hafiz Md. Asad , Md. Golam Rabiul Alam

Knowledge distillation can lead to deploy-friendly networks against the plagued computational complexity problem, but previous methods neglect the feature hierarchy in detectors. Motivated by this, we propose a general framework for…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Yangyang Qin , Hefei Ling , Zhenghai He , Yuxuan Shi , Lei Wu

Integrating deep learning applications into agricultural IoT systems faces a serious challenge of balancing the high accuracy of Vision Transformers (ViTs) with the efficiency demands of resource-constrained edge devices. Large transformer…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Stanley Mugisha , Rashid Kisitu , Florence Tushabe

In the case of diabetes, fingertip pricking for a blood sample is inconvenient for glucose measurement. Invasive approaches like laboratory test and one-touch glucometer enhance the risk of blood-related infections. To mitigate this…

Signal Processing · Electrical Eng. & Systems 2021-06-28 Prateek Jain , Amit M. Joshi , Saraju P. Mohanty

Although the convolutional neural network (CNN) has achieved excellent performance in vision tasks by extracting the intra-sample representation, it will take a higher training expense because of stacking numerous convolutional layers.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ziheng Jiao , Hongyuan Zhang , Xuelong Li