English
Related papers

Related papers: ELM-Based Distributed Cooperative Learning Over Ne…

200 papers

Mixture of experts method is a neural network based ensemble learning that has great ability to improve the overall classification accuracy. This method is based on the divide and conquer principle, in which the problem space is divided…

Machine Learning · Computer Science 2021-05-26 Laleh Armi , Elham Abbasi , Jamal Zarepour-Ahmadabadi

The demand for artificial intelligence has grown significantly over the last decade and this growth has been fueled by advances in machine learning techniques and the ability to leverage hardware acceleration. However, in order to increase…

Machine Learning · Computer Science 2022-11-28 Joost Verbraeken , Matthijs Wolting , Jonathan Katzy , Jeroen Kloppenburg , Tim Verbelen , Jan S. Rellermeyer

We systematically study various network Expectation-Maximization (EM) algorithms for the Gaussian mixture model within the framework of decentralized federated learning. Our theoretical investigation reveals that directly extending the…

Machine Learning · Statistics 2024-11-11 Shuyuan Wu , Bin Du , Xuetong Li , Hansheng Wang

Extreme Learning Machines (ELMs) have become a popular tool in the field of Artificial Intelligence due to their very high training speed and generalization capabilities. Another advantage is that they have a single hyper-parameter that…

Machine Learning · Computer Science 2019-12-05 Nicolás Nieto , Francisco Ibarrola , Victoria Peterson , Hugo Rufiner , Ruben Spies

Federated learning (FL) enables distributed model training from local data collected by users. In distributed systems with constrained resources and potentially high dynamics, e.g., mobile edge networks, the efficiency of FL is an important…

Machine Learning · Computer Science 2022-12-19 Shiqiang Wang , Jake Perazzone , Mingyue Ji , Kevin S. Chan

Deep learning has emerged as a technique of choice for rapid feature extraction across imaging disciplines, allowing rapid conversion of the data streams to spatial or spatiotemporal arrays of features of interest. However, applications of…

Data Analysis, Statistics and Probability · Physics 2021-01-25 Ayana Ghosh , Bobby G. Sumpter , Ondrej Dyck , Sergei V. Kalinin , Maxim Ziatdinov

Unlike theoretical distributed learning (DL), DL over wireless edge networks faces the inherent dynamics/uncertainty of wireless connections and edge nodes, making DL less efficient or even inapplicable under the highly dynamic wireless…

Networking and Internet Architecture · Computer Science 2021-03-10 Nguyen Van Huynh , Dinh Thai Hoang , Diep N. Nguyen , Eryk Dutkiewicz

Continual learning aims to enable machine learning models to continually learn from a shifting data distribution without forgetting what has already been learned. Such shifting distributions can be broken into disjoint subsets of related…

Machine Learning · Computer Science 2024-07-29 Carter Blair , Ben Armstrong , Kate Larson

Federated Learning is a new learning scheme for collaborative training a shared prediction model while keeping data locally on participating devices. In this paper, we study a new model of multiple federated learning services at the…

Machine Learning · Computer Science 2020-12-01 Minh N. H. Nguyen , Nguyen H. Tran , Yan Kyaw Tun , Zhu Han , Choong Seon Hong

Federated Learning (FL) is a distributed machine learning technique, where each device contributes to the learning model by independently computing the gradient based on its local training data. It has recently become a hot research topic,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-28 Afaf Taïk , Soumaya Cherkaoui

Conventional extreme learning machines solve a Moore-Penrose generalized inverse of hidden layer activated matrix and analytically determine the output weights to achieve generalized performance, by assuming the same loss from different…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Lei Zhang , David Zhang

Modern networked systems are increasingly reconfigurable, enabling demand-aware infrastructures whose resources can be adjusted according to the workload they currently serve. Such dynamic adjustments can be exploited to improve network…

Data Structures and Algorithms · Computer Science 2019-04-12 Monika Henzinger , Stefan Neumann , Stefan Schmid

Vertical distributed learning exploits the local features collected by multiple learning workers to form a better global model. However, the exchange of data between the workers and the model aggregator for parameter training incurs a heavy…

Networking and Internet Architecture · Computer Science 2022-09-07 Idan Achituve , Wenbo Wang , Ethan Fetaya , Amir Leshem

Nowadays, machine learning algorithms continue to grow in complexity and require a substantial amount of computational resources and energy. For these reasons, there is a growing awareness of the development of new green algorithms and…

While supervised federated learning approaches have enjoyed significant success, the domain of unsupervised federated learning remains relatively underexplored. Several federated EM algorithms have gained popularity in practice, however,…

Machine Learning · Statistics 2025-04-18 Ye Tian , Haolei Weng , Yang Feng

Federated learning (FL) aims to train machine learning (ML) models collaboratively using decentralized data, bypassing the need for centralized data aggregation. Standard FL models often assume that all data come from the same unknown…

Machine Learning · Computer Science 2025-03-25 Wen Bai , Yi Wong , Xiao Qiao , Chin Pang Ho

In this paper, we consider partitioned edge learning (PARTEL), which implements parameter-server training, a well known distributed learning method, in a wireless network. Thereby, PARTEL leverages distributed computation resources at edge…

Information Theory · Computer Science 2021-03-19 Dingzhu Wen , Ki-Jun Jeon , Mehdi Bennis , Kaibin Huang

Diffusion language models (DLMs) enable parallel, non-autoregressive text generation, yet existing DLM mixture-of-experts (MoE) models inherit token-choice (TC) routing from autoregressive systems, leading to load imbalance and rigid…

Consider learning a policy purely on the basis of demonstrated behavior -- that is, with no access to reinforcement signals, no knowledge of transition dynamics, and no further interaction with the environment. This *strictly batch…

Machine Learning · Statistics 2021-01-15 Daniel Jarrett , Ioana Bica , Mihaela van der Schaar

This letter proposes two novel proactive cooperative caching approaches using deep learning (DL) to predict users' content demand in a mobile edge caching network. In the first approach, a (central) content server takes responsibilities to…

Networking and Internet Architecture · Computer Science 2018-12-14 Yuris Mulya Saputra , Dinh Thai Hoang , Diep N. Nguyen , Eryk Dutkiewicz , Dusit Niyato , Dong In Kim