English
Related papers

Related papers: Intelligence and Cooperative Search by Coupled Loc…

200 papers

In decentralized optimization, nodes cooperate to minimize an overall objective function that is the sum (or average) of per-node private objective functions. Algorithms interleave local computations with communication among all or a subset…

Optimization and Control · Mathematics 2018-01-16 Angelia Nedić , Alex Olshevsky , Michael G. Rabbat

Competitive non-cooperative online decision-making agents whose actions increase congestion of scarce resources constitute a model for widespread modern large-scale applications. To ensure sustainable resource behavior, we introduce a novel…

Optimization and Control · Mathematics 2020-10-22 Ezra Tampubolon , Holger Boche

We study non-atomic congestion games on parallel-link networks with affine cost functions. We investigate the power of machine-learned predictions in the design of coordination mechanisms aimed at minimizing the impact of selfishness. Our…

Computer Science and Game Theory · Computer Science 2025-07-11 George Christodoulou , Vasilis Christoforidis , Alkmini Sgouritsa , Ioannis Vlachos

Synchronization, in which individual dynamical units keep in pace with each other in a decentralized fashion, depends both on the dynamical units and on the properties of the interaction network. Yet, the role played by the network has…

Disordered Systems and Neural Networks · Physics 2010-06-15 Takashi Nishikawa , Adilson E. Motter

A power constrained sensor network that consists of multiple sensor nodes and a fusion center (FC) is considered, where the goal is to estimate a random parameter of interest. In contrast to the distributed framework, the sensor nodes may…

Information Theory · Computer Science 2012-07-03 Swarnendu Kar , Pramod K. Varshney

Efficient probabilistic inference by variable elimination in graphical models requires an optimal elimination order. However, finding an optimal order is a challenging combinatorial optimisation problem for models with a large number of…

Artificial Intelligence · Computer Science 2025-03-13 Sagad Hamid , Tanya Braun

The Internet of Things requires intelligent decision making in many scenarios. To this end, resources available at the individual nodes for sensing or computing, or both, can be leveraged. This results in approaches known as participatory…

Machine Learning · Computer Science 2025-03-31 Alessandro Buratto , Elia Guerra , Marco Miozzo , Paolo Dini , Leonardo Badia

For solving combinatorial optimisation problems with metaheuristics, different search operators are applied for sampling new solutions in the neighbourhood of a given solution. It is important to understand the relationship between…

Artificial Intelligence · Computer Science 2023-05-05 Jiyuan Pei , Hao Tong , Jialin Liu , Yi Mei , Xin Yao

In this paper, we consider decentralized optimization problems where agents have individual cost functions to minimize subject to subspace constraints that require the minimizers across the network to lie in low-dimensional subspaces. This…

Optimization and Control · Mathematics 2023-08-01 Roula Nassif , Stefan Vlaski , Marco Carpentiero , Vincenzo Matta , Marc Antonini , Ali H. Sayed

In this Rapid Communication we investigate spatially constrained networks that realize optimal synchronization properties. After arguing that spatial constraints can be imposed by limiting the amount of `wire' available to connect nodes…

Adaptation and Self-Organizing Systems · Physics 2015-05-18 Markus Brede

There is a long history in machine learning of model ensembling, beginning with boosting and bagging and continuing to the present day. Much of this history has focused on combining models for classification and regression, but recently…

Machine Learning · Computer Science 2024-05-28 Ira Globus-Harris , Varun Gupta , Michael Kearns , Aaron Roth

In this paper, we present a distributed algorithm for solving convex, constraint-coupled, optimization problems over peer-to-peer networks. We consider a network of processors that aim to cooperatively minimize the sum of local cost…

Optimization and Control · Mathematics 2021-04-14 Andrea Camisa , Alessia Benevento , Giuseppe Notarstefano

The (constrained) minimization of a ratio of set functions is a problem frequently occurring in clustering and community detection. As these optimization problems are typically NP-hard, one uses convex or spectral relaxations in practice.…

Machine Learning · Statistics 2013-06-17 Thomas Bühler , Syama Sundar Rangapuram , Simon Setzer , Matthias Hein

In this work, a heterogeneous set of wireless devices sharing a common access point collaborates to perform a set of tasks. Using the Map-Reduce distributed computing framework, the tasks are optimally distributed amongst the nodes with the…

Signal Processing · Electrical Eng. & Systems 2019-03-07 Antoine Paris , Hamed Mirghasemi , Ivan Stupia , Luc Vandendorpe

Often times, individuals working together as a team can solve hard problems beyond the capability of any individual in the team. Cooperative optimization is a newly proposed general method for attacking hard optimization problems inspired…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Xiaofei Huang

In decentralized consensus optimization, a connected network of agents collaboratively minimize the sum of their local objective functions over a common decision variable, where their information exchange is restricted between the…

Optimization and Control · Mathematics 2015-06-16 Wei Shi , Qing Ling , Kun Yuan , Gang Wu , Wotao Yin

This work poses a distributed multi-resource allocation scheme for minimizing the weighted sum of latency and energy consumption in the on-device distributed federated learning (FL) system. Each mobile device in the system engages the model…

Systems and Control · Electrical Eng. & Systems 2022-11-02 Yulan Gao , Ziqiang Ye , Han Yu , Zehui Xiong , Yue Xiao , Dusit Niyato

The distributed optimization problem has become increasingly relevant recently. It has a lot of advantages such as processing a large amount of data in less time compared to non-distributed methods. However, most distributed approaches…

Optimization and Control · Mathematics 2024-03-27 Daniil Medyakov , Gleb Molodtsov , Aleksandr Beznosikov , Alexander Gasnikov

This paper studies a class of distributed optimization problems with coupled equality constraints in networked systems. Many existing distributed algorithms rely on solving local subproblems via the $\operatorname{argmin}$ operator in each…

Optimization and Control · Mathematics 2025-11-26 Chenyang Qiu , Zongli Lin

This paper proposes a new framework for providing approximation guarantees of local search algorithms. Local search is a basic algorithm design technique and is widely used for various combinatorial optimization problems. To analyze local…

Data Structures and Algorithms · Computer Science 2020-06-03 Kaito Fujii