English
Related papers

Related papers: A Gradient Descent Method for Optimization of Mode…

200 papers

Probabilistic message-passing algorithms are developed for routing transmissions in multi-wavelength optical communication networks, under node and edge-disjoint routing constraints and for various objective functions. Global routing…

Physics and Society · Physics 2022-04-25 Yi-Zhi Xu , Ho Fai Po , Chi Ho Yeung , David Saad

The goal of this paper is to debunk and dispel the magic behind black-box optimizers and stochastic optimizers. It aims to build a solid foundation on how and why the techniques work. This manuscript crystallizes this knowledge by deriving…

Machine Learning · Computer Science 2024-01-15 Jun Lu

We propose an optimization approach to design cost-effective electrical power transmission networks. That is, we aim to select both the network structure and the line conductances (line sizes) so as to optimize the trade-off between network…

Optimization and Control · Mathematics 2016-11-15 Jason K. Johnson , Michael Chertkov

Part I of this paper considered optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network…

Multiagent Systems · Computer Science 2019-07-01 Roula Nassif , Stefan Vlaski , Ali H. Sayed

Due to network operation and maintenance relying heavily on network traffic monitoring, traffic matrix analysis has been one of the most crucial issues for network management related tasks. However, it is challenging to reliably obtain the…

Networking and Internet Architecture · Computer Science 2024-12-02 Xinyu Yuan , Yan Qiao , Zhenchun Wei , Zeyu Zhang , Minyue Li , Pei Zhao , Rongyao Hu , Wenjing Li

In this paper we investigate the numerical approximation of an analogue of the Wasserstein distance for optimal transport on graphs that is defined via a discrete modification of the Benamou--Brenier formula. This approach involves the…

Numerical Analysis · Mathematics 2017-07-24 Matthias Erbar , Martin Rumpf , Bernhard Schmitzer , Stefan Simon

Finding coarse-grained, low-dimensional descriptions is an important task in the analysis of complex, stochastic models of gene regulatory networks. This task involves (a) identifying observables that best describe the state of these…

Quantitative Methods · Quantitative Biology 2015-06-26 Radek Erban , Thomas A. Frewen , Xiao Wang , Timothy C. Elston , Ronald Coifman , Boaz Nadler , Ioannis G. Kevrekidis

Motivated by emerging applications in wireless sensor networks and large-scale data processing, we consider distributed optimization over directed networks where the agents communicate their information locally to their neighbors to…

Optimization and Control · Mathematics 2021-03-22 Farzad Yousefian

This paper studies reduced-order modeling of dynamic networks with strongly connected topology. Given a graph clustering of an original complex network, we construct a quotient graph with less number of vertices, where the edge weights are…

Optimization and Control · Mathematics 2020-03-10 Xiaodong Cheng , Lanlin Yu , Dingchao Ren , Jacquelien M. A. Scherpen

We propose a new model for the emergence of blood capillary networks. We assimilate the tissue and extra cellular matrix as a porous medium, using Darcy's law for describing both blood and intersticial fluid flows. Oxygen obeys a…

Cell Behavior · Quantitative Biology 2018-12-27 P. Aceves-Sanchez , B. Aymard , D. Peurichard , P. Kennel , A. Lorsignol , F. Plouraboue , L. Casteilla , P. Degond

We propose an adaptive diffusion mechanism to optimize a global cost function in a distributed manner over a network of nodes. The cost function is assumed to consist of a collection of individual components. Diffusion adaptation allows the…

Optimization and Control · Mathematics 2015-06-03 Jianshu Chen , Ali H. Sayed

Optimal transport distances are powerful tools to compare probability distributions and have found many applications in machine learning. Yet their algorithmic complexity prevents their direct use on large scale datasets. To overcome this…

Machine Learning · Statistics 2021-10-14 Kilian Fatras , Younes Zine , Rémi Flamary , Rémi Gribonval , Nicolas Courty

Information exchange over networks can be affected by various forms of delay. This causes challenges for using the network by a multi-agent system to solve a distributed optimisation problem. Distributed optimisation schemes, however,…

Optimization and Control · Mathematics 2021-05-25 Adrian Redder , Arunselvan Ramaswamy , Holger Karl

The aim of this work is to develop a fully-distributed algorithmic framework for training graph convolutional networks (GCNs). The proposed method is able to exploit the meaningful relational structure of the input data, which are collected…

Machine Learning · Computer Science 2022-12-21 Simone Scardapane , Indro Spinelli , Paolo Di Lorenzo

Multiplex networks are a common modeling framework for interconnected systems and multimodal data, yet we still lack fundamental insights for how multiplexity affects stochastic processes. We introduce a novel ``Markov chains of Markov…

Physics and Society · Physics 2020-08-05 Dane Taylor

This paper proposes a multi-scale method to design a continuous-time distributed algorithm for constrained convex optimization problems by using multi-agents with Markov switched network dynamics and noisy inter-agent communications. Unlike…

Optimization and Control · Mathematics 2021-03-02 Wei Ni , Xiaoli Wang

We consider a multi agent optimization problem where a set of agents collectively solves a global optimization problem with the objective function given by the sum of locally known convex functions. We focus on the case when information…

Optimization and Control · Mathematics 2016-03-14 Ali Makhdoumi , Asuman Ozdaglar

Network flows often exhibit a hierarchical tree-like structure that can be attributed to the minimisation of dissipation. The common feature of such systems is a single source and multiple sinks (or vice versa). In contrast, here we study…

Tissues and Organs · Quantitative Biology 2020-05-27 Julius B. Kirkegaard , Kim Sneppen

We study the training dynamics of shallow neural networks, in a two-timescale regime in which the stepsizes for the inner layer are much smaller than those for the outer layer. In this regime, we prove convergence of the gradient flow to a…

Optimization and Control · Mathematics 2023-10-26 Pierre Marion , Raphaël Berthier

Optimal transport has recently been brought forward as a tool for modeling and efficiently solving a variety of flow problems, such as origin-destination problems and multi-commodity flow problems. Although the framework has shown to be…

Optimization and Control · Mathematics 2025-07-29 Anqi Dong , Karl Henrik Johansson , Johan Karlsson