English
Related papers

Related papers: Feature Fusion for Online Mutual Knowledge Distill…

200 papers

Federated Learning (FL) is an innovative distributed machine learning paradigm that enables neural network training across devices without centralizing data. While this addresses issues of information sharing and data privacy, challenges…

Machine Learning · Computer Science 2024-12-09 Jiayu Liu , Yong Wang , Nianbin Wang , Jing Yang , Xiaohui Tao

Federated learning (FL) is a paradigm where many clients collaboratively train a model under the coordination of a central server, while keeping the training data locally stored. However, heterogeneous data distributions over different…

Machine Learning · Computer Science 2022-05-27 Yaqi Sun , Shijing Si , Jianzong Wang , Yuhan Dong , Zhitao Zhu , Jing Xiao

The aim of this paper is to introduce a quantum fusion mechanism for multimodal learning and to establish its theoretical and empirical potential. The proposed method, called the Quantum Fusion Layer (QFL), replaces classical fusion schemes…

Quantum Physics · Physics 2025-10-09 Tuyen Nguyen , Trong Nghia Hoang , Phi Le Nguyen , Hai L. Vu , Truong Cong Thang

Transferring knowledge from a teacher neural network pretrained on the same or a similar task to a student neural network can significantly improve the performance of the student neural network. Existing knowledge transfer approaches match…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Sungsoo Ahn , Shell Xu Hu , Andreas Damianou , Neil D. Lawrence , Zhenwen Dai

Fine-grained image classification has emerged as a significant challenge because objects in such images have small inter-class visual differences but with large variations in pose, lighting, and viewpoints, etc. Most existing work focuses…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Xuelu Li , Vishal Monga

Continual learning and machine unlearning are crucial challenges in machine learning, typically addressed separately. Continual learning focuses on adapting to new knowledge while preserving past information, whereas unlearning involves…

Machine Learning · Computer Science 2024-12-30 Romit Chatterjee , Vikram Chundawat , Ayush Tarun , Ankur Mali , Murari Mandal

In this paper, to deal with the heterogeneity in federated learning (FL) systems, a knowledge distillation (KD) driven training framework for FL is proposed, where each user can select its neural network model on demand and distill…

Machine Learning · Computer Science 2023-03-14 Xiucheng Wang , Nan Cheng , Longfei Ma , Ruijin Sun , Rong Chai , Ning Lu

In this paper, we investigate the problem of decentralized federated learning (DFL) in Internet of things (IoT) systems, where a number of IoT clients train models collectively for a common task without sharing their private training data…

Machine Learning · Computer Science 2021-05-13 Chengxi Li , Gang Li , Pramod K. Varshney

Developing effective multimodal data fusion strategies has become increasingly essential for improving the predictive power of statistical machine learning methods across a wide range of applications, from autonomous driving to medical…

Machine Learning · Computer Science 2025-07-29 Ziyi Liang , Annie Qu , Babak Shahbaba

To eliminate the requirement of fully-labeled data for supervised model training in traditional Federated Learning (FL), extensive attention has been paid to the application of Self-supervised Learning (SSL) approaches on FL to tackle the…

Machine Learning · Computer Science 2022-11-15 Yi Liu , Song Guo , Jie Zhang , Qihua Zhou , Yingchun Wang , Xiaohan Zhao

In the realm of real-world devices, centralized servers in Federated Learning (FL) present challenges including communication bottlenecks and susceptibility to a single point of failure. Additionally, contemporary devices inherently exhibit…

Machine Learning · Computer Science 2024-08-15 Yasser H. Khalil , Amir H. Estiri , Mahdi Beitollahi , Nader Asadi , Sobhan Hemati , Xu Li , Guojun Zhang , Xi Chen

Federated Learning (FL) is a very promising approach for improving decentralized Machine Learning (ML) models by exchanging knowledge between participating clients without revealing private data. Nevertheless, FL is still not tailored to…

Artificial Intelligence · Computer Science 2020-05-15 Thomas Hiessl , Daniel Schall , Jana Kemnitz , Stefan Schulte

In 2016, Google proposed Federated Learning (FL) as a novel paradigm to train Machine Learning (ML) models across the participants of a federation while preserving data privacy. Since its birth, Centralized FL (CFL) has been the most used…

Federated Learning (FL) is an emerging paradigm that allows a model to be trained across a number of participants without sharing data. Recent works have begun to consider the effects of using pre-trained models as an initialization point…

Machine Learning · Computer Science 2023-11-07 Gwen Legate , Nicolas Bernier , Lucas Caccia , Edouard Oyallon , Eugene Belilovsky

Federated learning (FL) enables learning from decentralized privacy-sensitive data, with computations on raw data confined to take place at edge clients. This paper introduces mixed FL, which incorporates an additional loss term calculated…

Machine Learning · Computer Science 2022-06-28 Sean Augenstein , Andrew Hard , Lin Ning , Karan Singhal , Satyen Kale , Kurt Partridge , Rajiv Mathews

Federated Learning (FL) has emerged as a pivotal framework for the development of effective global models (global FL) or personalized models (personalized FL) across clients with heterogeneous, non-iid data distribution. A key challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Seongyoon Kim , Minchan Jeong , Sungnyun Kim , Sungwoo Cho , Sumyeong Ahn , Se-Young Yun

Federated learning (FL) is a novel distributed machine learning paradigm that enables participants to collaboratively train a centralized model with privacy preservation by eliminating the requirement of data sharing. In practice, FL often…

Machine Learning · Computer Science 2024-03-05 Wei Guo , Fuzhen Zhuang , Xiao Zhang , Yiqi Tong , Jin Dong

Suffering from the semantic insufficiency and domain-shift problems, most of existing state-of-the-art methods fail to achieve satisfactory results for Zero-Shot Learning (ZSL). In order to alleviate these problems, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Hongxin Xiang , Cheng Xie , Ting Zeng , Yun Yang

Federated learning (FL) is a promising approach for enhancing data privacy preservation, particularly for authentication systems. However, limited round communications, scarce representation, and scalability pose significant challenges to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Hansol Kim , Youngjun Kwak , Minyoung Jung , Jinho Shin , Youngsung Kim , Changick Kim

Continual learning (CL) for Foundation Models (FMs) is an essential yet underexplored challenge, especially in Federated Continual Learning (FCL), where each client learns from a private, evolving task stream under strict data and…

Machine Learning · Computer Science 2025-08-14 Hao Yu , Xin Yang , Boyang Fan , Xuemei Cao , Hanlin Gu , Lixin Fan , Qiang Yang