English
Related papers

Related papers: On reducing the communication cost of the diffusio…

200 papers

Dealing with broadcast scenarios has become a relevant topic in the scientific community. Because of interference, resource management presents a challenge, specially when spatial diversity is introduced. Many researches presented…

Signal Processing · Electrical Eng. & Systems 2020-07-17 Pol Henarejos

Both the training and use of Large Language Models (LLMs) require large amounts of energy. Their increasing popularity, therefore, raises critical concerns regarding the energy efficiency and sustainability of data centers that host them.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Grant Wilkins , Srinivasan Keshav , Richard Mortier

As a key component of low-altitude economic networks, aerial base stations (AeBSs) provide flexible and reliable wireless coverage to support 6G ultra-reliable and low-latency communication (URLLC) services. However, limited spectrum…

Networking and Internet Architecture · Computer Science 2025-07-08 Xudong Wang , Lei Feng , Jiacheng Wang , Hongyang Du , Changyuan Zhao , Wenjing Li , Zehui Xiong , Dusit Niyato , Ping Zhang

Part I of this work [2] developed the exact diffusion algorithm to remove the bias that is characteristic of distributed solutions for deterministic optimization problems. The algorithm was shown to be applicable to a larger set of…

Optimization and Control · Mathematics 2017-12-27 Kun Yuan , Bicheng Ying , Xiaochuan Zhao , Ali H. Sayed

With the increasing popularity of Internet-based services and applications, power efficiency is becoming a major concern for data center operators, as high electricity consumption not only increases greenhouse gas emissions, but also…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-19 Dmytro Dyachuk , Michele Mazzucco

This work poses a distributed multi-resource allocation scheme for minimizing the weighted sum of latency and energy consumption in the on-device distributed federated learning (FL) system. Each mobile device in the system engages the model…

Systems and Control · Electrical Eng. & Systems 2022-11-02 Yulan Gao , Ziqiang Ye , Han Yu , Zehui Xiong , Yue Xiao , Dusit Niyato

Training of large language models (LLMs) is typically distributed across a large number of accelerators to reduce training time. Since internal states and parameter gradients need to be exchanged at each and every single gradient step, all…

Large language models have been used to simulate human society using multi-agent systems. Most current social simulation research emphasizes interactive behaviors in fixed environments, ignoring information opacity, relationship…

Multiagent Systems · Computer Science 2025-05-21 Yiwen Zhang , Yifu Wu , Wenyue Hua , Xiang Lu , Xuming Hu

Sampling from a distribution $p(x) \propto e^{-\mathcal{E}(x)}$ known up to a normalising constant is an important and challenging problem in statistics. Recent years have seen the rise of a new family of amortised sampling algorithms,…

Machine Learning · Computer Science 2026-05-29 Arran Carter , Sanghyeok Choi , Kirill Tamogashev , Víctor Elvira , Esmeralda S. Whitammer

Predictive models trained on imbalanced data tend to produce biased results. This problem is exacerbated when there is not just one output label, but a set of them. This is the case for multilabel learning (MLL) algorithms used to classify…

Machine Learning · Computer Science 2025-01-22 Francisco Charte , Miguel Ángel Dávila , María Dolores Pérez-Godoy , María José del Jesus

We propose a simple, stable and distributed algorithm which directly optimizes the nonconvex maximum likelihood criterion for sensor network localization, with no need to tune any free parameter. We reformulate the problem to obtain a…

Optimization and Control · Mathematics 2015-09-24 Claudia Soares , Joao Xavier , Joao Gomes

Resource-constrained systems are prevalent in communications. Such a system is composed of many components but only some of them can be allocated with resources such as time slots. According to the amount of information about the system,…

Information Theory · Computer Science 2014-04-02 Albert Y. S. Lam , Yanhui Geng , Victor O. K. Li

Machine Learning has proven useful in the recent years as a way to achieve failure prediction for industrial systems. However, the high computational resources necessary to run learning algorithms are an obstacle to its widespread…

Artificial Intelligence · Computer Science 2020-01-22 Nicolas Aussel , Sophie Chabridon , Yohan Petetin

Recent approaches to distributed model fitting rely heavily on consensus ADMM, where each node solves small sub-problems using only local data. We propose iterative methods that solve {\em global} sub-problems over an entire distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-04-10 Tom Goldstein , Gavin Taylor , Kawika Barabin , Kent Sayre

Generative diffusion models, famous for their performance in image generation, are popular in various cross-domain applications. However, their use in the communication community has been mostly limited to auxiliary tasks like data modeling…

Networking and Internet Architecture · Computer Science 2025-03-11 Ruihuai Liang , Bo Yang , Zhiwen Yu , Bin Guo , Xuelin Cao , Mérouane Debbah , H. Vincent Poor , Chau Yuen

Antenna selection in Massive MIMO (Multiple Input Multiple Output) communication systems enables reduction of complexity, cost and power while keeping the channel capacity high and retaining the diversity, interference reduction, spatial…

Information Theory · Computer Science 2018-05-15 Harun Siljak , Irene Macaluso , Nicola Marchetti

The recent success of large language models (LLMs) has spurred their application in various fields. In particular, there have been efforts to integrate LLMs into various aspects of wireless communication systems. The use of LLMs in wireless…

Signal Processing · Electrical Eng. & Systems 2024-08-07 Woongsup Lee , Jeonghun Park

We investigate the consensus problem in a network where nodes communicate via diffusion-based molecular communication (DbMC). In DbMC, messages are conveyed via the variation in the concentration of molecules in the medium. Every node…

Information Theory · Computer Science 2011-03-03 Arash Einolghozati , Mohsen Sardari , Ahmad Beirami , Faramarz Fekri

Data center operators are typically faced with three significant problems when running their data centers, i.e., rising electricity bills, growing carbon footprints and unexpected power outages. To mitigate these issues, running data…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-02 Liang Yu , Tao Jiang , Yulong Zou

Driven by the need to solve increasingly complex optimization problems in signal processing and machine learning, there has been increasing interest in understanding the behavior of gradient-descent algorithms in non-convex environments.…

Optimization and Control · Mathematics 2019-07-04 Stefan Vlaski , Ali H. Sayed