English
Related papers

Related papers: NOMAD: Non-locking, stOchastic Multi-machine algor…

200 papers

We propose a fast sequential algorithm for the fundamental problem of estimating frequencies and amplitudes of a noisy mixture of sinusoids. The algorithm is a natural generalization of Orthogonal Matching Pursuit (OMP) to the continuum…

Information Theory · Computer Science 2016-08-24 Babak Mamandipoor , Dinesh Ramasamy , Upamanyu Madhow

The alternating direction method of multipliers (ADMM) has been popular for solving many signal processing problems, convex or nonconvex. In this paper, we study an asynchronous implementation of the ADMM for solving a nonconvex nonsmooth…

Information Theory · Computer Science 2014-12-19 Mingyi Hong

A variety of problems in distributed control involve a networked system of autonomous agents cooperating to carry out some complex task in a decentralized fashion, e.g., orienting a flock of drones, or aggregating data from a network of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-01 Bernadette Charron-Bost , Patrick Lambein-Monette

In this paper we analyze the problem of optimal task scheduling for data centers. Given the available resources and tasks, we propose a fast distributed iterative algorithm which operates over a large scale network of nodes and allows each…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-08 Apostolos I. Rikos , Andreas Grammenos , Evangelia Kalyvianaki , Christoforos N. Hadjicostis , Themistoklis Charalambous , Karl H. Johansson

The increasing demand for rich multimedia services and the emergence of the Internet-of-Things (IoT) pose challenging requirements for the next generation vehicular networks. Such challenges are largely related to high spectral efficiency…

Signal Processing · Electrical Eng. & Systems 2019-06-17 Sanjeev Gurugopinath , Paschalis C. Sofotasios , Yousof Al-Hammadi , Sami Muhaidat

Non-orthogonal multiple access (NOMA) technique is important for achieving a high data rate in next-generation wireless communications. A key challenge to fully utilizing the effectiveness of the NOMA technique is the optimization of the…

Information Theory · Computer Science 2024-10-28 Teppei Otsuka , Aohan Li , Hiroki Takesue , Kensuke Inaba , Kazuyuki Aihara , Mikio Hasegawa

The MultiNoC system implements a programmable on-chip multiprocessing platform built on top of an efficient, low area overhead intra-chip interconnection scheme. The employed interconnection structure is a Network on Chip, or NoC. NoCs are…

Hardware Architecture · Computer Science 2011-11-09 Aline Mello , Leandro Moller , Ney Calazans , Fernando Moraes

Public blockchains are decentralized networks where each participating node executes the same decision-making process. This form of decentralization does not scale well because the same data are stored on each network node, and because all…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-30 M. Toulouse , H. K. Dai , Q. L. Nguyen

Neutral atom quantum computing's great scaling potential has resulted in it emerging as a popular modality in recent years. For state preparation, atoms are loaded stochastically and have to be detected and rearranged at runtime to create a…

Emerging Technologies · Computer Science 2025-09-16 Jonas Winklmann , Martin Schulz

Semantic communication serves as a novel paradigm and attracts the broad interest of researchers. One critical aspect of it is the multi-user semantic communication theory, which can further promote its application to the practical network…

Signal Processing · Electrical Eng. & Systems 2023-11-21 Weizhi Li , Haotai Liang , Chen Dong , Xiaodong Xu , Ping Zhang , Kaijun Liu

We currently see a steady rise in the usage and size of multiprocessor systems, and so the community is evermore interested in developing fast parallel processing algorithms. However, most algorithms require a synchronization mechanism,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-12 Arya Tanmay Gupta

An important capability of autonomous multi-robot systems is to prevent collision among the individual robots. One approach to this problem is to plan conflict-free trajectories and let each of the robots follow its pre-planned trajectory.…

Robotics · Computer Science 2014-09-09 Michal Čáp , Peter Novák , Alexander Kleiner , Martin Selecký

Non-orthogonal multiple access (NOMA) is an interesting technology that enables massive connectivity as required in future 5G and 6G networks. While purely linear processing already achieves good performance in NOMA systems, in certain…

Signal Processing · Electrical Eng. & Systems 2022-06-14 Daniel Schäufele , Guillermo Marcus , Nikolaus Binder , Matthias Mehlhose , Alexander Keller , Sławomir Stańczak

Backpropagation algorithm is indispensable for the training of feedforward neural networks. It requires propagating error gradients sequentially from the output layer all the way back to the input layer. The backward locking in…

Machine Learning · Computer Science 2018-07-24 Zhouyuan Huo , Bin Gu , Qian Yang , Heng Huang

Decentralized optimization has emerged as a critical paradigm for distributed learning, enabling scalable training while preserving data privacy through peer-to-peer collaboration. However, existing methods often suffer from communication…

Machine Learning · Computer Science 2026-01-06 Yijie Zhou , Shi Pu

We present DM$^3$-Nav, a fully decentralized multi-agent semantic navigation system supporting multimodal open-vocabulary goal specification and multi-object missions. In our setting, decentralization implies operation without a central…

Multiagent Systems · Computer Science 2026-04-27 Amin Kashiri , Atharva Jamsandekar , Yasin Yazıcıoğlu

This paper addresses the problem of nonconvex nonsmooth decentralised optimisation in multi-agent networks with undirected connected communication graphs. Our contribution lies in introducing an algorithmic framework designed for the…

Optimization and Control · Mathematics 2023-12-08 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

In this era of large-scale data, distributed systems built on top of clusters of commodity hardware provide cheap and reliable storage and scalable processing of massive data. Here, we review recent work on developing and implementing…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-28 Jiyan Yang , Xiangrui Meng , Michael W. Mahoney

A closed-form analytical expression is derived for the limiting empirical squared singular value density of a spreading (signature) matrix corresponding to sparse low-density code-domain (LDCD) non-orthogonal multiple-access (NOMA) with…

Information Theory · Computer Science 2017-05-10 Ori Shental , Benjamin M. Zaidel , Shlomo Shamai

We analyze the convergence of gradient-based optimization algorithms that base their updates on delayed stochastic gradient information. The main application of our results is to the development of gradient-based distributed optimization…

Optimization and Control · Mathematics 2011-05-02 Alekh Agarwal , John C. Duchi