中文
相关论文

相关论文: A distillation-based approach integrating continua…

200 篇论文

In continual learning, there is a serious problem of catastrophic forgetting, in which previous knowledge is forgotten when a model learns new tasks. Various methods have been proposed to solve this problem. Replay methods which replay data…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Kotaro Nagata , Hiromu Ono , Kazuhiro Hotta

In the growing world of artificial intelligence, federated learning is a distributed learning framework enhanced to preserve the privacy of individuals' data. Federated learning lays the groundwork for collaborative research in areas where…

机器学习 · 计算机科学 2023-11-21 Elaheh Jafarigol , Theodore Trafalis , Talayeh Razzaghi , Mona Zamankhani

Federated learning is an emerging technique for training models from decentralized data sets. In many applications, data owners participating in the federated learning system hold not only the data but also a set of domain knowledge. Such…

机器学习 · 计算机科学 2022-08-17 Zhenan Fan , Zirui Zhou , Jian Pei , Michael P. Friedlander , Jiajie Hu , Chengliang Li , Yong Zhang

Federated Learning (FL) is a pioneering approach in distributed machine learning, enabling collaborative model training across multiple clients while retaining data privacy. However, the inherent heterogeneity due to imbalanced resource…

机器学习 · 计算机科学 2024-11-18 Suraj Racha , Shubh Gupta , Humaira Firdowse , Aastik Solanki , Ganesh Ramakrishnan , Kshitij S. Jadhav

Training models continually to detect and classify objects, from new classes and new domains, remains an open problem. In this work, we conduct a thorough analysis of why and how object detection models forget catastrophically. We focus on…

计算机视觉与模式识别 · 计算机科学 2022-10-10 Eli Verwimp , Kuo Yang , Sarah Parisot , Hong Lanqing , Steven McDonagh , Eduardo Pérez-Pellitero , Matthias De Lange , Tinne Tuytelaars

One of the major limitations of deep learning models is that they face catastrophic forgetting in an incremental learning scenario. There have been several approaches proposed to tackle the problem of incremental learning. Most of these…

机器学习 · 计算机科学 2021-02-04 Vinod K Kurmi , Badri N. Patro , Venkatesh K. Subramanian , Vinay P. Namboodiri

Federated Learning (FL) enables the training of Deep Learning models without centrally collecting possibly sensitive raw data. The most used algorithms for FL are parameter-averaging based schemes (e.g., Federated Averaging) that, however,…

机器学习 · 计算机科学 2025-04-08 Alessio Mora , Irene Tenison , Paolo Bellavista , Irina Rish

A fundamental and challenging problem in deep learning is catastrophic forgetting, i.e. the tendency of neural networks to fail to preserve the knowledge acquired from old tasks when learning new tasks. This problem has been widely…

计算机视觉与模式识别 · 计算机科学 2022-05-23 Guanglei Yang , Enrico Fini , Dan Xu , Paolo Rota , Mingli Ding , Moin Nabi , Xavier Alameda-Pineda , Elisa Ricci

Histopathology can help clinicians make accurate diagnoses, determine disease prognosis, and plan appropriate treatment strategies. As deep learning techniques prove successful in the medical domain, the primary challenges become limited…

计算机视觉与模式识别 · 计算机科学 2024-07-11 Zhe Li , Bernhard Kainz

Personalization in federated learning (FL) functions as a coordinator for clients with high variance in data or behavior. Ensuring the convergence of these clients' models relies on how closely users collaborate with those with similar…

机器学习 · 计算机科学 2023-02-24 Eunjeong Jeong , Marios Kountouris

Data privacy and silos are nontrivial and greatly challenging in many real-world applications. Federated learning is a decentralized approach to training models across multiple local clients without the exchange of raw data from client…

机器学习 · 计算机科学 2024-03-01 Xin Yang , Hao Yu , Xin Gao , Hao Wang , Junbo Zhang , Tianrui Li

Federated learning provides a privacy-preserving manner to collaboratively train models on data distributed over multiple local clients via the coordination of a global server. In this paper, we focus on label distribution skew in federated…

机器学习 · 计算机科学 2024-09-23 Jianghu Lu , Shikun Li , Kexin Bao , Pengju Wang , Zhenxing Qian , Shiming Ge

Federated Learning (FL) seeks to train a model collaboratively without sharing private training data from individual clients. Despite its promise, FL encounters challenges such as high communication costs for large-scale models and the…

机器学习 · 计算机科学 2024-04-15 Lin Li , Jianping Gou , Baosheng Yu , Lan Du , Zhang Yiand Dacheng Tao

In medical imaging, developing generalized segmentation models that can handle multiple organs and lesions is crucial. However, the scarcity of fully annotated datasets and strict privacy regulations present significant barriers to data…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Pochuan Wang , Chen Shen , Masahiro Oda , Chiou-Shann Fuh , Kensaku Mori , Weichung Wang , Holger R. Roth

The growth of the Internet of Things has amplified the need for secure data interactions in cloud-edge ecosystems, where sensitive information is constantly processed across various system layers. Intrusion detection systems are commonly…

密码学与安全 · 计算机科学 2025-04-16 Soad Almabdy , Amjad Ullah

Diffusion models are powerful generative models that achieve state-of-the-art performance in image synthesis. However, training them demands substantial amounts of data and computational resources. Continual learning would allow for…

机器学习 · 计算机科学 2025-03-05 Sergi Masip , Pau Rodriguez , Tinne Tuytelaars , Gido M. van de Ven

Federated learning (FL) is a promising paradigm to enable privacy-preserving deep learning from distributed data. Most previous works are based on federated average (FedAvg), which, however, faces several critical issues, including a high…

机器学习 · 计算机科学 2022-03-15 Lumin Liu , Jun Zhang , S. H. Song , Khaled B. Letaief

The dramatic success of deep learning is largely due to the availability of data. Data samples are often acquired on edge devices, such as smart phones, vehicles and sensors, and in some cases cannot be shared due to privacy considerations.…

信号处理 · 电气工程与系统科学 2022-05-18 Tomer Gafni , Nir Shlezinger , Kobi Cohen , Yonina C. Eldar , H. Vincent Poor

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

机器学习 · 计算机科学 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

Clustered Federated Learning (CFL) addresses the challenges posed by non-IID data by training multiple group- or cluster-specific expert models. However, existing methods often overlook the shared information across clusters, which…

机器学习 · 计算机科学 2025-06-26 Zeqi Leng , Chunxu Zhang , Guodong Long , Riting Xia , Bo Yang