中文
相关论文

相关论文: Robustness of Decentralised Learning to Nodes and …

200 篇论文

Distributed learning paradigms, such as federated or decentralized learning, allow a collection of agents to solve global learning and optimization problems through limited local interactions. Most such strategies rely on a mixture of local…

机器学习 · 计算机科学 2023-10-27 Christian A. Schroth , Stefan Vlaski , Abdelhak M. Zoubir

In the expanding field of machine learning, federated learning has emerged as a pivotal methodology for distributed data environments, ensuring privacy while leveraging decentralized data sources. However, the heterogeneity of client data…

机器学习 · 计算机科学 2025-01-28 Alice Smith , Bob Johnson , Michael Geller

Recent developments in AI have made it ubiquitous, every industry is trying to adopt some form of intelligent processing of their data. Despite so many advances in the field, AIs full capability is yet to be exploited by the industry.…

机器学习 · 计算机科学 2021-11-10 Vishal Rajput

Multimodal learning robust to missing modality has attracted increasing attention due to its practicality. Existing methods tend to address it by learning a common subspace representation for different modality combinations. However, we…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Shicai Wei , Yang Luo , Yuji Wang , Chunbo Luo

The dramatic success of deep learning is largely due to the availability of data. Data samples are often acquired on edge devices, such as smart phones, vehicles and sensors, and in some cases cannot be shared due to privacy considerations.…

信号处理 · 电气工程与系统科学 2022-05-18 Tomer Gafni , Nir Shlezinger , Kobi Cohen , Yonina C. Eldar , H. Vincent Poor

Underpinning the past decades of work on the design, initialization, and optimization of neural networks is a seemingly innocuous assumption: that the network is trained on a \textit{stationary} data distribution. In settings where this…

机器学习 · 计算机科学 2024-03-01 Clare Lyle , Zeyu Zheng , Khimya Khetarpal , Hado van Hasselt , Razvan Pascanu , James Martens , Will Dabney

Deep learning based methods for image reconstruction are state-of-the-art for a variety of imaging tasks. However, neural networks often perform worse if the training data differs significantly from the data they are applied to. For…

图像与视频处理 · 电气工程与系统科学 2024-08-08 Kang Lin , Reinhard Heckel

Machine learning models offer the capability to forecast future energy production or consumption and infer essential unknown variables from existing data. However, legal and policy constraints within specific energy sectors render the data…

机器学习 · 计算机科学 2024-06-10 Lei Xu , Yulong Chen , Yuntian Chen , Longfeng Nie , Xuetao Wei , Liang Xue , Dongxiao Zhang

Federated Learning (FL) facilitates collaborative training of a global model whose performance is boosted by private data owned by distributed clients, without compromising data privacy. Yet the wide applicability of FL is hindered by…

分布式、并行与集群计算 · 计算机科学 2024-12-31 Xinyuan Zhao , Hanlin Gu , Lixin Fan , Yuxing Han , Qiang Yang

Decentralized training of large language models has emerged as an effective way to democratize this technology. However, the potential threats associated with this approach have not been carefully discussed, which would hinder the…

机器学习 · 计算机科学 2023-12-05 Lin Lu , Chenxi Dai , Wangcheng Tao , Binhang Yuan , Yanan Sun , Pan Zhou

Decentralized coordination is one of the fundamental challenges for societies and organizations. While extensively explored from a variety of perspectives, one issue which has received limited attention is human coordination in the presence…

社会与信息网络 · 计算机科学 2018-08-06 Chen Hajaj , Sixie Yu , Zlatko Joveski , Yevgeniy Vorobeychik

Many complex systems in the real world can be characterized by attributed networks. To mine the potential information in these networks, deep embedded clustering, which obtains node representations and clusters simultaneously, has been paid…

机器学习 · 计算机科学 2022-05-31 Yimei Zheng , Caiyan Jia , Jian Yu , Xuanya Li

Federated Learning is an emerging privacy-preserving distributed machine learning approach to building a shared model by performing distributed training locally on participating devices (clients) and aggregating the local models into a…

机器学习 · 计算机科学 2021-04-15 Sreya Francis , Irene Tenison , Irina Rish

Wider coverage and a better solution to a latency reduction in 5G necessitate its combination with multi-access edge computing (MEC) technology. Decentralized deep learning (DDL) such as federated learning and swarm learning as a promising…

分布式、并行与集群计算 · 计算机科学 2022-03-23 Yuwei Sun , Hideya Ochiai , Hiroshi Esaki

Modern deep learning models, growing larger and more complex, have demonstrated exceptional generalization and accuracy due to training on huge datasets. This trend is expected to continue. However, the increasing size of these models poses…

机器学习 · 计算机科学 2024-05-24 Anirudh Rajiv Menon , Unnikrishnan Menon , Kailash Ahirwar

We consider the problem of persistent client dropout in asynchronous Decentralized Federated Learning (DFL). Asynchronicity and decentralization obfuscate information about model updates among federation peers, making recovery from a client…

机器学习 · 计算机科学 2025-08-05 Ignacy Stępka , Nicholas Gisolfi , Kacper Trębacz , Artur Dubrawski

Continual learning, the ability of a model to adapt to an ongoing sequence of tasks without forgetting earlier ones, is a central goal of artificial intelligence. To better understand its underlying mechanisms, we study the limitations of…

机器学习 · 统计学 2026-04-21 Hossein Taheri , Avishek Ghosh , Arya Mazumdar

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

机器学习 · 计算机科学 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

In Location-based Social Networks, Point-of-Interest (POI) recommendation helps users discover interesting places. There is a trend to move from the cloud-based model to on-device recommendations for privacy protection and reduced server…

信息检索 · 计算机科学 2024-01-26 Ruiqi Zheng , Liang Qu , Tong Chen , Lizhen Cui , Yuhui Shi , Hongzhi Yin

To address the shortcomings of real-world datasets, robust learning algorithms have been designed to overcome arbitrary and indiscriminate data corruption. However, practical processes of gathering data may lead to patterns of data…

机器学习 · 计算机科学 2024-05-02 Lunjia Hu , Charlotte Peale , Judy Hanwen Shen