中文
相关论文

相关论文: Energy-Efficient Distributed Learning Algorithms f…

200 篇论文

Decentralized strategies are of interest for learning from large-scale data over networks. This paper studies learning over a network of geographically distributed nodes/agents subject to quantization. Each node possesses a private local…

系统与控制 · 电气工程与系统科学 2025-01-13 Mohammadreza Doostmohammadian , Muhammad I. Qureshi , Mohammad Hossein Khalesi , Hamid R. Rabiee , Usman A. Khan

Motivated by the need for distributed learning and optimization algorithms with low communication cost, we study communication efficient algorithms for distributed mean estimation. Unlike previous works, we make no probabilistic assumptions…

机器学习 · 计算机科学 2017-09-26 Ananda Theertha Suresh , Felix X. Yu , Sanjiv Kumar , H. Brendan McMahan

We investigate resource allocation scheme to reduce the energy consumption of federated learning (FL) in the integrated fog-cloud computing enabled Internet-of-things (IoT) networks. In the envisioned system, IoT devices are connected with…

信号处理 · 电气工程与系统科学 2021-07-09 Mohammed S. Al-Abiad , Md. Zoheb Hassan , Md. Jahangir Hossain

Distributed architectures are gaining prominence in quantum machine learning as a means to overcome hardware limitations and enable scalable quantum information processing. In this context, we analyze the design and performance of…

Federated Learning (FL) allows devices to train a global machine learning model without sharing data. In the context of wireless networks, the inherently unreliable nature of the transmission channel introduces delays and errors that…

网络与互联网体系结构 · 计算机科学 2024-08-05 Renan R. de Oliveira , Kleber V. Cardoso , Antonio Oliveira-Jr

The use of deep learning (DL) on Internet of Things (IoT) and mobile devices offers numerous advantages over cloud-based processing. However, such devices face substantial energy constraints to prolong battery-life, or may even operate…

机器学习 · 计算机科学 2025-05-20 Josh Millar , Hamed Haddadi , Anil Madhavapeddy

We consider distributed optimization over orthogonal collision channels in spatial random access networks. Users are spatially distributed and each user is in the interference range of a few other users. Each user is allowed to transmit…

网络与互联网体系结构 · 计算机科学 2016-10-26 Kobi Cohen , Angelia Nedich , R. Srikant

In this paper, we investigate a distributed learning scheme for a broad class of stochastic optimization problems and games that arise in signal processing and wireless communications. The proposed algorithm relies on the method of matrix…

信息论 · 计算机科学 2017-04-05 Panayotis Mertikopoulos , E. Veronica Belmega , Romain Negrel , Luca Sanguinetti

Federated Learning (FL) allows collaborative training among multiple devices without data sharing, thus enabling privacy-sensitive applications on mobile or Internet of Things (IoT) devices, such as mobile health and asset tracking.…

机器学习 · 计算机科学 2025-06-10 Phung Lai , Xiaopeng Jiang , Hai Phan , Cristian Borcea , Khang Tran , An Chen , Vijaya Datta Mayyuri , Ruoming Jin

Distributed adaptive signal processing has attracted much attention in the recent decade owing to its effectiveness in many decentralized real-time applications in networked systems. Because many natural signals are highly sparse with most…

最优化与控制 · 数学 2017-11-22 Xuanyu Cao , K. J. Ray Liu

In recent years, long-term evolution (LTE) and 5G NR (5th Generation New Radio) technologies have showed great potential to utilize Machine Learning (ML) algorithms in optimizing their operations, both thanks to the availability of…

网络与互联网体系结构 · 计算机科学 2021-10-18 Pedro Enrique Iturria Rivera , Melike Erol-Kantarci

Minimizing energy consumption of low-power wireless nodes is a persistent challenge from the constrained Internet of Things (IoT). In this paper, we start from the observation that constrained IoT devices have largely different hardware…

网络与互联网体系结构 · 计算机科学 2025-08-14 Michel Rottleuthner , Thomas C. Schmidt , Matthias Wählisch

Improving the efficiency of inference in Large Language Models (LLMs) is a critical area of research. Post-training Quantization (PTQ) is a popular technique, but it often faces challenges at low-bit levels, particularly in downstream…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Wenjin Ke , Zhe Li , Dong Li , Lu Tian , Emad Barsoum

Distributed consensus has been widely studied for sensor network applications. Whereas the asymptotic convergence rate has been extensively explored in prior work, other important and practical issues, including energy efficiency and link…

网络与互联网体系结构 · 计算机科学 2013-04-10 Lei Chen , Jeff Frolik

In this paper we study the distributed average consensus problem in multi-agent systems with directed communication links that are subject to quantized information flow. Specifically, we present and analyze a distributed averaging algorithm…

系统与控制 · 电气工程与系统科学 2021-03-10 Apostolos I. Rikos , Christoforos N. Hadjicostis , Karl H. Johansson

There have been significant issues given the IoT, with heterogeneity of billions of devices and with a large amount of data. This paper proposed an innovative design of the Internet of Things (IoT) Environment Intrusion Detection System (or…

In this letter, we propose an energy-efficient split learning (SL) framework for fine-tuning large language models (LLMs) using geo-distributed personal data at the network edge, where LLMs are split and alternately across massive mobile…

机器学习 · 计算机科学 2025-01-15 Zuguang Li , Shaohua Wu , Liang Li , Songge Zhang

Communication-efficient distributed training algorithms have received considerable interest recently due to their benefits for training Large Language Models (LLMs) in bandwidth-constrained settings, such as across datacenters and over the…

机器学习 · 计算机科学 2025-11-07 Amir Sarfi , Benjamin Thérien , Joel Lidin , Eugene Belilovsky

Due to its efficiency and ease to implement, stochastic gradient descent (SGD) has been widely used in machine learning. In particular, SGD is one of the most popular optimization methods for distributed learning. Recently, quantized SGD…

机器学习 · 计算机科学 2019-01-11 Shen-Yi Zhao , Hao Gao , Wu-Jun Li

In this paper, we investigate the age-of-information (AoI) of a power domain non-orthogonal multiple access (NOMA) network, where multiple internet-of-things (IoT) devices transmit to a common gateway in a grant-free random fashion. More…

信号处理 · 电气工程与系统科学 2025-02-10 Felippe Moraes Pereira , Jamil de Araujo Farhat , João Luiz Rebelatto , Glauber Brante , Richard Demo Souza