English
Related papers

Related papers: Decentralized Eigenvalue Algorithms for Distribute…

200 papers

We consider the problem of identifying the signal shared between two one-dimensional target variables, in the presence of additional multivariate observations. Canonical Correlation Analysis (CCA)-based methods have traditionally been used…

Machine Learning · Computer Science 2023-06-28 Alexander Rakowski , Christoph Lippert

Distributed change-point detection has been a fundamental problem when performing real-time monitoring using sensor-networks. We propose a distributed detection algorithm, where each sensor only exchanges CUSUM statistic with their…

Signal Processing · Electrical Eng. & Systems 2019-01-09 Qinghua Liu , Rui Zhang , Yao Xie

Loop scheduling techniques aim to achieve load-balanced executions of scientific applications. Dynamic loop self-scheduling (DLS) libraries for distributed-memory systems are typically MPI-based and employ a centralized chunk calculation…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-19 Ahmed Eleliemy , Florina M. Ciorba

Decentralized optimization is widely used in large scale and privacy preserving machine learning and various distributed control and sensing systems. It is assumed that every agent in the network possesses a local objective function, and…

Optimization and Control · Mathematics 2023-01-31 Savelii Chezhegov , Anton Novitskii , Alexander Rogozin , Sergei Parsegov , Pavel Dvurechensky , Alexander Gasnikov

We introduce Constr-DRKM, a deep kernel method for the unsupervised learning of disentangled data representations. We propose augmenting the original deep restricted kernel machine formulation for kernel PCA by orthogonality constraints on…

Machine Learning · Computer Science 2020-12-01 Francesco Tonin , Panagiotis Patrinos , Johan A. K. Suykens

Intelligent wireless networks have long been expected to have self-configuration and self-optimization capabilities to adapt to various environments and demands. In this paper, we develop a novel distributed hierarchical deep reinforcement…

Signal Processing · Electrical Eng. & Systems 2023-12-06 Kaiwen Yu , Chonghao Zhao , Gang Wu , Geoffrey Ye Li

This study develops an algorithm for distributed computing of linear programming problems of huge-scales. Global consensus with single common variable, multiblocks, and augmented Lagrangian are adopted. The consensus is used to partition…

Optimization and Control · Mathematics 2025-08-07 Luoyi Tao

The Lanczos method is one of the most powerful and fundamental techniques for solving an extremal symmetric eigenvalue problem. Convergence-based error estimates depend heavily on the eigenvalue gap. In practice, this gap is often…

Numerical Analysis · Mathematics 2020-09-17 John C. Urschel

This paper considers convex optimization problems where nodes of a network have access to summands of a global objective. Each of these local objectives is further assumed to be an average of a finite set of functions. The motivation for…

Optimization and Control · Mathematics 2015-06-16 Aryan Mokhtari , Alejandro Ribeiro

This chapter deals with decentralized learning algorithms for in-network processing of graph-valued data. A generic learning problem is formulated and recast into a separable form, which is iteratively minimized using the…

Optimization and Control · Mathematics 2015-04-01 Georgios B. Giannakis , Qing Ling , Gonzalo Mateos , Ioannis D. Schizas , Hao Zhu

Decentralized learning and optimization is a central problem in control that encompasses several existing and emerging applications, such as federated learning. While there exists a vast literature on this topic and most methods centered…

Machine Learning · Computer Science 2023-03-21 Vishnu Pandi Chellapandi , Antesh Upadhyay , Abolfazl Hashemi , Stanislaw H /. Zak

In this paper, we consider nonconvex decentralised optimisation and learning over a network of distributed agents. We develop an ADMM algorithm based on the Randomised Block Coordinate Douglas-Rachford splitting method which enables agents…

Optimization and Control · Mathematics 2025-07-31 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

Measures of node centrality that describe the importance of a node within a network are crucial for understanding the behavior of social networks and graphs. In this paper, we address the problems of distributed estimation and control of…

Systems and Control · Computer Science 2020-07-07 Eduardo Montijano , Gabriele Oliva , Andrea Gasparri

Decentralized learning strategies allow a collection of agents to learn efficiently from local data sets without the need for central aggregation or orchestration. Current decentralized learning paradigms typically rely on an averaging…

Machine Learning · Computer Science 2025-01-24 Muyun Li , Aaron Fainman , Stefan Vlaski

The distribution of the eigenvalues of a Hermitian matrix (or of a Hermitian matrix pencil) reveals important features of the underlying problem, whether a Hamiltonian system in physics, or a social network in behavioral sciences. However,…

Numerical Analysis · Mathematics 2017-06-22 Yuanzhe Xi , Ruipeng Li , Yousef Saad

This paper investigates the problem of distributed stochastic approximation in multi-agent systems. The algorithm under study consists of two steps: a local stochastic approximation step and a diffusion step which drives the network to a…

Multiagent Systems · Computer Science 2014-10-28 Gemma Morral , Pascal Bianchi , Gersende Fort

Distance metric learning is successful in discovering intrinsic relations in data. However, most algorithms are computationally demanding when the problem size becomes large. In this paper, we propose a discriminative metric learning…

Machine Learning · Computer Science 2019-05-15 Jun Li , Xun Lin , Xiaoguang Rui , Yong Rui , Dacheng Tao

Distributed adaptive signal processing has attracted much attention in the recent decade owing to its effectiveness in many decentralized real-time applications in networked systems. Because many natural signals are highly sparse with most…

Optimization and Control · Mathematics 2017-11-22 Xuanyu Cao , K. J. Ray Liu

We investigate the problem of jointly testing two hypotheses and estimating a random parameter based on data that is observed sequentially by sensors in a distributed network. In particular, we assume the data to be drawn from a Gaussian…

Signal Processing · Electrical Eng. & Systems 2020-03-04 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

In recent work, we proposed a distributed Banach-Picard iteration (DBPI) that allows a set of agents, linked by a communication network, to find a fixed point of a locally contractive (LC) map that is the average of individual maps held by…

Optimization and Control · Mathematics 2022-01-27 Francisco L. Andrade , Mário A. T. Figueiredo , João Xavier
‹ Prev 1 4 5 6 7 8 10 Next ›