English
Related papers

Related papers: Query-based Knowledge Transfer for Heterogeneous L…

200 papers

The rapid growth of industrial Internet of Things (IIoT) systems has created new challenges for anomaly detection in high-dimensional, multivariate time-series, where privacy, scalability, and communication efficiency are critical.…

Machine Learning · Computer Science 2025-11-05 Kuan-Cheng Chen , Samuel Yen-Chi Chen , Chen-Yu Liu , Kin K. Leung

Although deep learning (DL) has already become a state-of-the-art technology for various data processing tasks, data security and computational overload problems often arise due to their high data and computational power dependency. To…

Quantum Physics · Physics 2022-04-08 Yunseok Kwak , Won Joon Yun , Jae Pyoung Kim , Hyunhee Cho , Minseok Choi , Soyi Jung , Joongheon Kim

Deep neural networks, while achieving remarkable success across diverse tasks, demand significant resources, including computation, GPU memory, bandwidth, storage, and energy. Network quantization, as a standard compression and acceleration…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Minghao Fu , Hao Yu , Jie Shao , Junjie Zhou , Ke Zhu , Jianxin Wu

Beyond 5G and 6G networks are expected to support new and challenging use cases and applications that depend on a certain level of Quality of Service (QoS) to operate smoothly. Predicting the QoS in a timely manner is of high importance,…

Networking and Internet Architecture · Computer Science 2025-02-19 Nikolaos Koursioumpas , Lina Magoula , Ioannis Stavrakakis , Nancy Alonistioti , M. A. Gutierrez-Estevez , Ramin Khalili

Modelling student knowledge is a key challenge when leveraging AI in education, with major implications for personalised learning. The Knowledge Tracing (KT) task aims to predict how students will respond to educational questions in…

Computation and Language · Computer Science 2026-01-27 Max Norris , Kobi Gal , Sahan Bulathwela

Concerned with user data privacy, this paper presents a new federated learning (FL) method that trains machine learning models on edge devices without accessing sensitive data. Traditional FL methods, although privacy-protective, fail to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-03 Duy Phuong Nguyen , Sixing Yu , J. Pablo Muñoz , Ali Jannesari

Recently Data-Free Knowledge Distillation (DFKD) has garnered attention and can transfer knowledge from a teacher neural network to a student neural network without requiring any access to training data. Although diffusion models are adept…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Xiaohua Qi , Renda Li , Long Peng , Qiang Ling , Jun Yu , Ziyi Chen , Peng Chang , Mei Han , Jing Xiao

While sequential recommendation achieves significant progress on capturing user-item transition patterns, transferring such large-scale recommender systems remains challenging due to the disjoint user and item groups across domains. In this…

Information Retrieval · Computer Science 2024-11-05 Zhenrui Yue , Huimin Zeng , Yang Zhang , Julian McAuley , Dong Wang

Knowledge tracing (KT) refers to the problem of predicting future learner performance given their past performance in educational applications. Recent developments in KT using flexible deep neural network-based models excel at this task.…

Machine Learning · Computer Science 2020-07-27 Aritra Ghosh , Neil Heffernan , Andrew S. Lan

Institutions in highly regulated domains such as finance and healthcare often have restrictive rules around data sharing. Federated learning is a distributed learning framework that enables multi-institutional collaborations on…

Machine Learning · Computer Science 2023-05-24 Shivam Kalra , Junfeng Wen , Jesse C. Cresswell , Maksims Volkovs , Hamid R. Tizhoosh

Transfer learning aims to faciliate learning tasks in a label-scarce target domain by leveraging knowledge from a related source domain with plenty of labeled data. Often times we may have multiple domains with little or no labeled data as…

Machine Learning · Computer Science 2017-11-10 Tianchun Wang

Quantum Federated Learning (QFL) is an emerging interdisciplinary field that merges the principles of Quantum Computing (QC) and Federated Learning (FL), with the goal of leveraging quantum technologies to enhance privacy, security, and…

Machine Learning · Computer Science 2024-08-20 Chao Ren , Rudai Yan , Huihui Zhu , Han Yu , Minrui Xu , Yuan Shen , Yan Xu , Ming Xiao , Zhao Yang Dong , Mikael Skoglund , Dusit Niyato , Leong Chuan Kwek

As large language models (LLMs) demonstrate unparalleled performance and generalization ability, LLMs are widely used and integrated into various applications. When it comes to sensitive domains, as commonly described in federated learning…

Cryptography and Security · Computer Science 2024-05-24 Haoran Li , Xinyuan Zhao , Dadi Guo , Hanlin Gu , Ziqian Zeng , Yuxing Han , Yangqiu Song , Lixin Fan , Qiang Yang

Knowledge Distillation is an effective method to transfer the learning across deep neural networks. Typically, the dataset originally used for training the Teacher model is chosen as the "Transfer Set" to conduct the knowledge transfer to…

Machine Learning · Computer Science 2020-11-19 Gaurav Kumar Nayak , Konda Reddy Mopuri , Anirban Chakraborty

Knowledge Tracing (KT) is a critical technique for modeling student knowledge to support personalized learning. However, most KT systems focus on binary correctness prediction and cannot diagnose the underlying conceptual misunderstandings…

Computation and Language · Computer Science 2026-03-26 Yu-Chen Kang , Yu-Chien Tang , An-Zi Yen

There has been a surge of interest in continual learning and federated learning, both of which are important in deep neural networks in real-world scenarios. Yet little research has been done regarding the scenario where each client learns…

Machine Learning · Computer Science 2021-06-15 Jaehong Yoon , Wonyong Jeong , Giwoong Lee , Eunho Yang , Sung Ju Hwang

The contribution focuses on the problem of exploration within the task of knowledge transfer. Knowledge transfer refers to the useful application of the knowledge gained while learning the source task in the target task. The intended…

Machine Learning · Computer Science 2024-07-16 Adam Jedlička , Tatiana Valentine Guy

Quantum Federated Learning (QFL) promises to revolutionize distributed machine learning by combining the computational power of quantum devices with collaborative model training. Yet, privacy of both data and models remains a critical…

Cryptography and Security · Computer Science 2025-12-04 Dev Gurung , Shiva Raj Pokhrel

With the rapid development in online education, knowledge tracing (KT) has become a fundamental problem which traces students' knowledge status and predicts their performance on new questions. Questions are often numerous in online…

Artificial Intelligence · Computer Science 2020-09-15 Yang Yang , Jian Shen , Yanru Qu , Yunfei Liu , Kerong Wang , Yaoming Zhu , Weinan Zhang , Yong Yu

Quantum machine learning (QML) has emerged as a promising field that leans on the developments in quantum computing to explore large complex machine learning problems. Recently, some purely quantum machine learning models were proposed such…

Quantum Physics · Physics 2021-06-02 Mahdi Chehimi , Walid Saad