中文
相关论文

相关论文: Neural Collapse based Deep Supervised Federated Le…

200 篇论文

This paper studies decentralized federated learning algorithms in wireless IoT networks. The traditional parameter server architecture for federated learning faces some problems such as low fault tolerance, large communication overhead and…

分布式、并行与集群计算 · 计算机科学 2022-01-19 Shuzhen Chen , Dongxiao Yu , Yifei Zou , Jiguo Yu , Xiuzhen Cheng

Although deep neural networks achieve tremendous success on various classification tasks, the generalization ability drops sheer when training datasets exhibit long-tailed distributions. One of the reasons is that the learned…

机器学习 · 计算机科学 2023-02-27 Xuantong Liu , Jianfeng Zhang , Tianyang Hu , He Cao , Lujia Pan , Yuan Yao

Neural Collapse (NC) gives a precise description of the representations of classes in the final hidden layer of classification neural networks. This description provides insights into how these networks learn features and generalize well…

机器学习 · 计算机科学 2023-08-08 Liam Parker , Emre Onal , Anton Stengel , Jake Intrater

New technological advancements in wireless networks have enlarged the number of connected devices. The unprecedented surge of data volume in wireless systems empowered by artificial intelligence (AI) opens up new horizons for providing…

网络与互联网体系结构 · 计算机科学 2023-03-01 Mohammad Al-Quraan , Lina Mohjazi , Lina Bariah , Anthony Centeno , Ahmed Zoha , Sami Muhaidat , Mérouane Debbah , Muhammad Ali Imran

The conventional model aggregation-based federated learning (FL) approach requires all local models to have the same architecture, which fails to support practical scenarios with heterogeneous local models. Moreover, frequent model exchange…

信号处理 · 电气工程与系统科学 2023-03-23 Zhixiong Chen , Wenqiang Yi , Yuanwei Liu , Arumugam Nallanathan

Neural collapse (NC) is a phenomenon that emerges at the terminal phase of the training (TPT) of deep neural networks (DNNs). The features of the data in the same class collapse to their respective sample means and the sample means exhibit…

机器学习 · 统计学 2024-09-09 Wanli Hong , Shuyang Ling

Although Deep Learning (DL) methods becoming increasingly popular in vulnerability detection, their performance is seriously limited by insufficient training data. This is mainly because few existing software organizations can maintain a…

软件工程 · 计算机科学 2024-11-26 Peiheng Zhou , Ming Hu , Xingrun Quan , Yawen Peng , Xiaofei Xie , Yanxin Yang , Chengwei Liu , Yueming Wu , Mingsong Chen

Federated learning (FL) is a popular framework for training an AI model using distributed mobile data in a wireless network. It features data parallelism by distributing the learning task to multiple edge devices while attempting to…

机器学习 · 计算机科学 2022-02-08 Dingzhu Wen , Ki-Jun Jeon , Kaibin Huang

In Federated Learning (FL), with parameter aggregated by a central node, the communication overhead is a substantial concern. To circumvent this limitation and alleviate the single point of failure within the FL framework, recent studies…

机器学习 · 计算机科学 2024-04-01 Zhigang Yan , Dong Li

Federated learning (FL), as an effective decentralized distributed learning approach, enables multiple institutions to jointly train a model without sharing their local data. However, the domain feature shift caused by different acquisition…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Meng Wang , Kai Yu , Chun-Mei Feng , Yiming Qian , Ke Zou , Lianyu Wang , Rick Siow Mong Goh , Yong Liu , Huazhu Fu

Over-the-air federated learning (FL), i.e., AirFL, leverages computing primitively over multiple access channels. A long-standing challenge in AirFL is to achieve coherent signal alignment without relying on expensive channel estimation and…

信息论 · 计算机科学 2024-11-21 Haifeng Wen , Nicolò Michelusi , Osvaldo Simeone , Hong Xing

To address the communication burden and privacy concerns associated with the centralized server in Federated Learning (FL), Decentralized Federated Learning (DFL) has emerged, which discards the server with a peer-to-peer (P2P)…

机器学习 · 计算机科学 2023-10-10 Qinglun Li , Miao Zhang , Nan Yin , Quanjun Yin , Li Shen

Federated learning (FL) has recently emerged as an important and promising learning scheme in IoT, enabling devices to jointly learn a model without sharing their raw data sets. However, as the training data in FL is not collected and…

机器学习 · 计算机科学 2021-05-04 Shuo Wan , Jiaxun Lu , Pingyi Fan , Yunfeng Shao , Chenghui Peng , Khaled B. letaief

Among many mysteries behind the success of deep networks lies the exceptional discriminative power of their learned representations as manifested by the intriguing Neural Collapse (NC) phenomenon, where simple feature structures emerge at…

机器学习 · 计算机科学 2025-10-27 Hancheng Min , Zhihui Zhu , René Vidal

Decentralized Federated Learning (DFL) enables collaborative model training without a central server but faces challenges in efficiency, stability, and trustworthiness due to communication and computational limitations among distributed…

机器学习 · 计算机科学 2025-03-18 Shan Sha , Shenglong Zhou , Lingchen Kong , Geoffrey Ye Li

Ensuring reliable and predictable communications is one of the main goals in modern industrial systems that rely on Wi-Fi networks, especially in scenarios where continuity of operation and low latency are required. In these contexts, the…

网络与互联网体系结构 · 计算机科学 2025-12-02 Gabriele Formis , Amanda Ericson , Stefan Forsstrom , Kyi Thar , Gianluca Cena , Stefano Scanzio

Data heterogeneity is an inherent challenge that hinders the performance of federated learning (FL). Recent studies have identified the biased classifiers of local models as the key bottleneck. Previous attempts have used classifier…

机器学习 · 计算机科学 2023-08-29 Zexi Li , Xinyi Shang , Rui He , Tao Lin , Chao Wu

Federated Learning (FL) has been proved to be an effective learning framework when data cannot be centralized due to privacy, communication costs, and regulatory restrictions. When training deep learning models under an FL setting, people…

机器学习 · 计算机科学 2021-01-05 Chaoyang He , Murali Annavaram , Salman Avestimehr

In this paper, a deep convolutional neural network-based symbol detection and demodulation is proposed for generalized frequency division multiplexing with index modulation (GFDM-IM) scheme in order to improve the error performance of the…

信号处理 · 电气工程与系统科学 2022-02-08 Merve Turhan , Ersin Öztürk , Hakan Ali Çırpan

The rapid development of the Internet and smart devices trigger surge in network traffic making its infrastructure more complex and heterogeneous. The predominated usage of mobile phones, wearable devices and autonomous vehicles are…