中文
相关论文

相关论文: Epidemic Learning: Boosting Decentralized Learning…

200 篇论文

Entity Linking (EL), the task of mapping textual entity mentions to their corresponding entries in knowledge bases, constitutes a fundamental component of natural language understanding. Recent advancements in Large Language Models (LLMs)…

计算与语言 · 计算机科学 2025-11-19 Jiajun Hou , Chenyu Zhang , Rui Meng

Distributed machine learning (ML) at network edge is a promising paradigm that can preserve both network bandwidth and privacy of data providers. However, heterogeneous and limited computation and communication resources on edge servers (or…

分布式、并行与集群计算 · 计算机科学 2020-04-24 Qing Han , Shusen Yang , Xuebin Ren , Cong Zhao , Jingqi Zhang , Xinyu Yang

ELM (Extreme Learning Machine) is a single hidden layer feed-forward network, where the weights between input and hidden layer are initialized randomly. ELM is efficient due to its utilization of the analytical approach to compute weights…

机器学习 · 计算机科学 2016-06-21 Qiuyan Yan , Qifa Sun , Xinming Yan

With the rapid growth in mobile computing, massive amounts of data and computing resources are now located at the edge. To this end, Federated learning (FL) is becoming a widely adopted distributed machine learning (ML) paradigm, which aims…

分布式、并行与集群计算 · 计算机科学 2021-06-15 Li Chou , Zichang Liu , Zhuang Wang , Anshumali Shrivastava

Distributed learning techniques such as federated learning have enabled multiple workers to train machine learning models together to reduce the overall training time. However, current distributed training algorithms (centralized or…

机器学习 · 计算机科学 2020-02-25 Zhenheng Tang , Shaohuai Shi , Xiaowen Chu

Decentralized learning enables collaborative training of models across naturally distributed data without centralized coordination or maintenance of a global model. Instead, devices are organized in arbitrary communication topologies, in…

机器学习 · 计算机科学 2025-05-20 Mansi Sakarvadia , Nathaniel Hudson , Tian Li , Ian Foster , Kyle Chard

The inverse-free extreme learning machine (ELM) algorithm proposed in [4] was based on an inverse-free algorithm to compute the regularized pseudo-inverse, which was deduced from an inverse-free recursive algorithm to update the inverse of…

机器学习 · 计算机科学 2019-11-13 Hufei Zhu , Chenghao Wei

The ever-growing volume and decentralized nature of data, coupled with the need to harness it and extract knowledge, have led to the extensive use of distributed deep learning (DDL) techniques for training. These techniques rely on local…

We introduce a rapid and precise analytical approach for analyzing cerebral blood flow (CBF) using Diffuse Correlation Spectroscopy (DCS) with the application of the Extreme Learning Machine (ELM). Our evaluation of ELM and existing…

机器学习 · 计算机科学 2024-02-02 Xi Chen , Zhenya Zang , Xingda Li

Federated learning involves training machine learning models over devices or data silos, such as edge processors or data warehouses, while keeping the data local. Training in heterogeneous and potentially massive networks introduces bias…

机器学习 · 计算机科学 2021-06-18 Zichen Ma , Yu Lu , Zihan Lu , Wenye Li , Jinfeng Yi , Shuguang Cui

This work concerns receiver design for light emitting diode (LED) communications where the LED nonlinearity can severely degrade the performance of communications. We propose extreme learning machine (ELM) based non-iterative receivers and…

信号处理 · 电气工程与系统科学 2020-12-30 Dawei Gao , Qinghua Guo , Jun Tong , Nan Wu , Jiangtao Xi , Yanguang Yu

The Extreme Learning Machine (ELM) technique is a machine learning approach for constructing feed-forward neural networks with a single hidden layer and their models. The ELM model can be constructed while being trained by concurrently…

最优化与控制 · 数学 2024-01-30 Muideen Adegoke , Lateef O. Jolaoso , Mardiyyah Oduwole

Optimizing distributed learning systems is an art of balancing between computation and communication. There have been two lines of research that try to deal with slower networks: {\em communication compression} for low bandwidth networks,…

机器学习 · 计算机科学 2019-02-04 Hanlin Tang , Shaoduo Gan , Ce Zhang , Tong Zhang , Ji Liu

Electroencephalography (EEG) signals are frequently used for various Brain-Computer Interface (BCI) tasks. While Deep Learning (DL) techniques have shown promising results, they are hindered by the substantial data requirements. By…

信号处理 · 电气工程与系统科学 2024-05-24 Bruna Junqueira , Bruno Aristimunha , Sylvain Chevallier , Raphael Y. de Camargo

Decentralized optimization methods enable on-device training of machine learning models without a central coordinator. In many scenarios communication between devices is energy demanding and time consuming and forms the bottleneck of the…

最优化与控制 · 数学 2020-11-04 Dmitry Kovalev , Anastasia Koloskova , Martin Jaggi , Peter Richtarik , Sebastian U. Stich

Nowadays, large and complex deep learning (DL) models are increasingly trained in a distributed manner across multiple worker machines, in which extensive communications between workers pose serious scaling problems. In this article, we…

分布式、并行与集群计算 · 计算机科学 2020-11-10 Shaohuai Shi , Zhenheng Tang , Xiaowen Chu , Chengjian Liu , Wei Wang , Bo Li

We introduce Explanatory Learning (EL), a framework to let machines use existing knowledge buried in symbolic sequences -- e.g. explanations written in hieroglyphic -- by autonomously learning to interpret them. In EL, the burden of…

Accurate and efficient recognition of emotional states is critical for human social functioning, and impairments in this ability are associated with significant psychosocial difficulties. While electroencephalography (EEG) offers a powerful…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Shengyu Gong , Yueyang Li , Zijian Kang , Bo Chai , Weiming Zeng , Hongjie Yan , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

Decentralized learning (DL) is an emerging technique that allows nodes on the web to collaboratively train machine learning models without sharing raw data. Dealing with stragglers, i.e., nodes with slower compute or communication than…

分布式、并行与集群计算 · 计算机科学 2025-02-04 Sayan Biswas , Anne-Marie Kermarrec , Alexis Marouani , Rafael Pires , Rishi Sharma , Martijn de Vos

In decentralized learning, operator splitting methods using a primal-dual formulation (e.g., the Edge-Consensus Learning (ECL)) has been shown to be robust to heterogeneous data and has attracted significant attention in recent years.…

机器学习 · 计算机科学 2022-05-10 Yuki Takezawa , Kenta Niwa , Makoto Yamada