English
Related papers

Related papers: Intelligence and Cooperative Search by Coupled Loc…

200 papers

Ising formulations are widely utilized to solve combinatorial optimization problems, and a variety of quantum or semiconductor-based hardware has recently been made available. In combinatorial optimization problems, the existence of local…

Applied Physics · Physics 2024-03-15 Yoshiki Sato , Makiko Konoshima , Hirotaka Tamura , Jun Ohkubo

We consider two optimization problems on synchronization of oscillator networks: maximization of synchronizability and minimization of synchronization cost. We first develop an extension of the well-known master stability framework to the…

Disordered Systems and Neural Networks · Physics 2007-05-23 Takashi Nishikawa , Adilson E. Motter

Distributed algorithms for solving additive or consensus optimization problems commonly rely on first-order or proximal splitting methods. These algorithms generally come with restrictive assumptions and at best enjoy a linear convergence…

Optimization and Control · Mathematics 2017-05-11 Sina Khoshfetrat Pakazad , Christian A. Naesseth , Fredrik Lindsten , Anders Hansson

LLM agents in markets present algorithmic collusion risks. While prior work shows LLM agents reach supracompetitive prices through tacit coordination, existing research focuses on hand-crafted prompts. The emerging paradigm of prompt…

Artificial Intelligence · Computer Science 2026-04-21 Yingtao Tian

Federated learning (FL) aims to minimize the communication complexity of training a model over heterogeneous data distributed across many clients. A common approach is local methods, where clients take multiple optimization steps over local…

Machine Learning · Computer Science 2023-04-18 Charlie Hou , Kiran K. Thekumparampil , Giulia Fanti , Sewoong Oh

Decentralized optimization methods enable on-device training of machine learning models without a central coordinator. In many scenarios communication between devices is energy demanding and time consuming and forms the bottleneck of the…

Optimization and Control · Mathematics 2020-11-04 Dmitry Kovalev , Anastasia Koloskova , Martin Jaggi , Peter Richtarik , Sebastian U. Stich

Federated Learning (FL) algorithms commonly sample a random subset of clients to address the straggler issue and improve communication efficiency. While recent works have proposed various client sampling methods, they have limitations in…

Machine Learning · Computer Science 2024-05-15 Jiaxiang Geng , Yanzhao Hou , Xiaofeng Tao , Juncheng Wang , Bing Luo

Single- and multi-layer complex networks have been proven as a powerful tool to study the dynamics within social, technological,or natural systems. An often observed common goal there is to optimize these systems for specific purposes by…

Physics and Society · Physics 2021-02-11 Tanja Holstein , Marc Wiedermann , Jürgen Kurths

Interconnecting multiple sensor networks is a relatively new research field which has emerged in the Wireless Sensor Network domain. Wireless Sensor Networks (WSNs) have typically been seen as logically separate, and few works have…

Networking and Internet Architecture · Computer Science 2015-03-20 Sougata Pal , Simon Oechsner , Boris Bellalta , Miquel Oliver

Multi-agent systems can be extremely efficient when solving a team-wide task in a concurrent manner. However, without proper synchronization, the correctness of the combined behavior is hard to guarantee, such as to follow a specific…

Robotics · Computer Science 2024-04-10 Zesen Liu , Meng Guo , Zhongkui Li

In this paper, we consider the problems of minimizing sum power and maximizing sum rate for multi-cell networks with load coupling, where coupling relation occurs among cells due to inter-cell interference. This coupling relation is…

Information Theory · Computer Science 2017-07-04 Zhaohui Yang , Cunhua Pan , Wei Xu , Hao Xu , Ming Chen

"Weakly coupled dynamic program" describes a broad class of stochastic optimization problems in which multiple controlled stochastic processes evolve independently but subject to a set of linking constraints imposed on the controls. One…

Optimization and Control · Mathematics 2014-05-15 Fan Ye , Helin Zhu , Enlu Zhou

Foraging, either solitarily or collectively, is a necessary behavior for survival that is demonstrated by many organisms. Foraging can be collectively optimized by utilizing communication between the organisms. Examples of such…

Biological Physics · Physics 2018-10-17 Noriyuki P. Tani , Alan Blatt , David A. Quint , Ajay Gopinathan

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

Recently proposed neural network activation functions such as rectified linear, maxout, and local winner-take-all have allowed for faster and more effective training of deep neural architectures on large and complex datasets. The common…

Neural and Evolutionary Computing · Computer Science 2015-04-13 Rupesh Kumar Srivastava , Jonathan Masci , Faustino Gomez , Jürgen Schmidhuber

Sharing forecasts of network timeseries data, such as cellular or electricity load patterns, can improve independent control applications ranging from traffic scheduling to power generation. Typically, forecasts are designed without…

Machine Learning · Computer Science 2021-10-06 Jiangnan Cheng , Marco Pavone , Sachin Katti , Sandeep Chinchali , Ao Tang

This paper demonstrates the usefulness of distributed local verification of proofs, as a tool for the design of self-stabilizing algorithms.In particular, it introduces a somewhat generalized notion of distributed local proofs, and utilizes…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-25 Amos Korman , Shay Kutten , Toshimitsu Masuzawa

In this paper, we consider an approach to the parallelizing of the algorithms realizing the modified probability changigng method with adaptation and partial rollback procedure for constrained pseudo-Boolean optimization problems. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-03 Lev Kazakovtsev

Large Language Models (LLMs) demonstrate exceptional reasoning abilities, enabling strong generalization across diverse tasks such as commonsense reasoning and instruction following. However, as LLMs scale, inference costs become…

Computation and Language · Computer Science 2025-02-06 Rhea Sanjay Sukthanker , Benedikt Staffler , Frank Hutter , Aaron Klein

Imitation is widely observed in populations of decision-making agents. Using our recent convergence results for asynchronous imitation dynamics on networks, we consider how such networks can be efficiently driven to a desired equilibrium…

Computer Science and Game Theory · Computer Science 2017-04-17 James Riehl , Pouria Ramazi , Ming Cao