English
Related papers

Related papers: Finite-Time In-Network Computation of Linear Trans…

200 papers

Graph transformers are a recent advancement in machine learning, offering a new class of neural network models for graph-structured data. The synergy between transformers and graph learning demonstrates strong performance and versatility…

Machine Learning · Computer Science 2025-12-23 Ahsan Shehzad , Feng Xia , Shagufta Abid , Ciyuan Peng , Shuo Yu , Dongyu Zhang , Karin Verspoor

In this paper, we consider the problem of distributed reachable set computation for multi-agent systems (MASs) interacting over an undirected, stationary graph. A full state-feedback control input for such MASs depends no only on the…

Systems and Control · Electrical Eng. & Systems 2024-10-11 Omanshu Thapliyal , Shanelle Clarke , Inseok Hwang

We study strongly convex distributed optimization problems where a set of agents are interested in solving a separable optimization problem collaboratively. In this paper, we propose and study a two time-scale decentralized gradient descent…

Optimization and Control · Mathematics 2022-08-16 Hadi Reisizadeh , Behrouz Touri , Soheil Mohajer

Linear time-invariant systems are very popular models in system theory and applications. A fundamental problem in system identification that remains rather unaddressed in extant literature is to leverage commonalities amongst related linear…

Machine Learning · Statistics 2024-01-03 Aditya Modi , Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

The paper introduces a novel algorithm for computing the output admissible set of linear discrete-time systems subject to input saturation. The proposed method takes advantage of the piecewise-affine dynamics to propagate the output…

Optimization and Control · Mathematics 2023-11-29 Yaashia Gautam , Marco M. Nicotra

In this paper it is established that any jointly controllable, jointly observable, multi-channel, discrete or continuous time linear system with a strongly connected neighbor (communication) graph can be exponentially stabilized with any…

Systems and Control · Electrical Eng. & Systems 2022-12-02 Fengjiao Liu , Lili Wang , Daniel Fullmer , A. Stephen Morse

Graph-based representations underlie a wide range of scientific problems. Graph connectivity is typically represented as a sparse matrix in the Compressed Sparse Row format. Large-scale graphs rely on distributed storage, allocating…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-14 Bruno Magalhaes , Felix Schürmann

In this study, we propose a design methodology of distributed controllers for multi-agent systems on a class of directed interaction networks by extending the gradient-flow method. Although the gradient-flow method is a common design tool…

Systems and Control · Electrical Eng. & Systems 2024-03-05 Yuto Watanabe , Kazunori Sakurama , Hyo-Sung Ahn

While the relationship of time and space is an established topic in traditional centralised complexity theory, this is not the case in distributed computing. We aim to remedy this by studying the time and space complexity of algorithms in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-11 Tuomo Lempiäinen , Jukka Suomela

In this paper we investigate how standard nonlinear programming algorithms can be used to solve constrained optimization problems in a distributed manner. The optimization setup consists of a set of agents interacting through a…

Optimization and Control · Mathematics 2017-07-18 Ion Matei , John S. Baras

Dynamic networks reflect temporal changes occurring to the graph's structure and are used to model a wide variety of problems in many application fields. We investigate the design space of dynamic graph visualization along two major…

Human-Computer Interaction · Computer Science 2022-09-07 Velitchko Filipov , Alessio Arleo , Markus Bögl , Silvia Miksch

This paper considers nonconvex distributed constrained optimization over networks, modeled as directed (possibly time-varying) graphs. We introduce the first algorithmic framework for the minimization of the sum of a smooth nonconvex…

Optimization and Control · Mathematics 2018-09-05 Gesualdo Scutari , Ying Sun

In this document, some novel theoretical and computational techniques for constrained approximation of data-driven systems, are presented. The motivation for the development of these techniques came from structure-preserving matrix…

Optimization and Control · Mathematics 2019-07-22 Fredy Vides

Distributed optimization for resource allocation problems is investigated and a sub-optimal continuous-time algorithm is proposed. Our algorithm has lower order dynamics than others to reduce burdens of computation and communication, and is…

Optimization and Control · Mathematics 2020-02-13 Shu Liang , Xianlin Zeng , Guanpu Chen , Yiguang Hong

In distributed optimization and machine learning, multiple nodes coordinate to solve large problems. To do this, the nodes need to compress important algorithm information to bits so that it can be communicated over a digital channel. The…

Optimization and Control · Mathematics 2020-12-02 Sindri Magnússon , Hossein Shokri-Ghadikolaei , Na Li

Expectation propagation is a general approach to fast approximate inference for graphical models. The existing literature treats models separately when it comes to deriving and coding expectation propagation inference algorithms. This comes…

Methodology · Statistics 2018-01-17 Wilson Y. Chen , Matt P. Wand

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

This work bridges the gap between distributed and centralised models of computing in the context of sublinear-time graph algorithms. A priori, typical centralised models of computing (e.g., parallel decision trees or centralised local…

Data Structures and Algorithms · Computer Science 2015-12-18 Mika Göös , Juho Hirvonen , Reut Levi , Moti Medina , Jukka Suomela

Recent work has shown the effectiveness of tensor network methods for computing large deviation functions in constrained stochastic models in the infinite time limit. Here we show that these methods can also be used to study the statistics…

Statistical Mechanics · Physics 2022-03-08 Luke Causer , Mari Carmen Bañuls , Juan P. Garrahan

In this paper we study the realizability question for commuting graphs of finite groups: Given an undirected graph $X$ is it the commuting graph of a group $G$? And if so, to determine such a group. We seek efficient algorithms for this…

Group Theory · Mathematics 2022-06-03 V. Arvind , Peter. J. Cameron