English
Related papers

Related papers: Centralized and Distributed Newton Methods for Net…

200 papers

We consider the consensual distributed optimization problem in the Riemannian context. Specifically, the minimization of a sum of functions form is studied where each individual function in the sum is located at the node of a network. An…

Optimization and Control · Mathematics 2020-09-08 Suhail M. Shah

We present a distributed quasi-Newton (DQN) method, which enables a group of agents to compute an optimal solution of a separable multi-agent optimization problem locally using an approximation of the curvature of the aggregate objective…

Optimization and Control · Mathematics 2024-09-30 Ola Shorinwa , Mac Schwager

This paper presents a distributed optimization scheme over a network of agents in the presence of cost uncertainties and over switching communication topologies. Inspired by recent advances in distributed convex optimization, we propose a…

Optimization and Control · Mathematics 2016-11-15 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

Multilayer networks provide a more comprehensive framework for exploring real-world and engineering systems than traditional single-layer networks, consisting of multiple interacting networks. However, despite significant research in…

Optimization and Control · Mathematics 2024-11-12 C. D. Rodríguez-Camargo , A. F. Urquijo-Rodríguez , E. A. Mojica-Nava

Small cell enchantment is emerging as the key technique for wireless network evolution. One challenging problem for small cell enhancement is how to achieve high data rate with as-low-as-possible control and computation overheads. As a…

Networking and Internet Architecture · Computer Science 2014-02-12 Shuqin Li , Liyu Cai

The impact of different linearisation and iterative solution strategies for fully-coupled pressure-based algorithms for compressible flows at all speeds is studied, with the aim of elucidating their impact on the performance of the…

Computational Physics · Physics 2018-07-16 Fabian Denner

Null space Newton algorithms are efficient in solving the nonlinear equations arising in hydraulic analysis of water distribution networks. In this article, we propose and evaluate an inexact Newton method that relies on partial updates of…

Systems and Control · Computer Science 2016-02-09 Edo Abraham , Ivan Stoianov

Finding roots of equations is at the heart of most computational science. A well-known and widely used iterative algorithm is the Newton's method. However, its convergence depends heavily on the initial guess, with poor choices often…

Numerical Analysis · Mathematics 2020-04-09 Ankush Aggarwal , Sanjay Pant

We propose two variants of Newton method for solving unconstrained minimization problem. Our method leverages optimization techniques such as penalty and augmented Lagrangian method to generate novel variants of the Newton method namely the…

Optimization and Control · Mathematics 2022-05-24 Md Sarowar Morshed

We derive a monotonicity property for general, transient flows of a commodity transferred throughout a network, where the flow is characterized by density and mass flux dynamics on the edges with density continuity and mass balance…

Optimization and Control · Mathematics 2016-03-31 Anatoly Zlotnik , Sidhant Misra , Marc Vuffray , Michael Chertkov

Large scale optimization problems are ubiquitous in machine learning and data analysis and there is a plethora of algorithms for solving such problems. Many of these algorithms employ sub-sampling, as a way to either speed up the…

Optimization and Control · Mathematics 2016-02-29 Farbod Roosta-Khorasani , Michael W. Mahoney

The ability to differentiate through optimization problems has unlocked numerous applications, from optimization-based layers in machine learning models to complex design problems formulated as bilevel programs. It has been shown that…

Optimization and Control · Mathematics 2024-03-05 Lucas Fuentes Valenzuela , Robin Brown , Marco Pavone

Designing networks with specified collective properties is useful in a variety of application areas, enabling the study of how given properties affect the behavior of network models, the downscaling of empirical networks to workable sizes,…

Optimization and Control · Mathematics 2017-06-20 Chrysanthos E. Gounaris , Karthikeyan Rajendran , Ioannis G. Kevrekidis , Christodoulos A. Floudas

Finding the set of nodes, which removed or (de)activated can stop the spread of (dis)information, contain an epidemic or disrupt the functioning of a corrupt/criminal organization is still one of the key challenges in network science. In…

Social and Information Networks · Computer Science 2019-03-26 Xiao-Long Ren , Niels Gleinig , Dirk Helbing , Nino Antulov-Fantulin

Motivated by broad applications in various fields of engineering, we study a network resource allocation problem where the goal is to optimally allocate a fixed quantity of resources over a network of nodes. We consider large scale networks…

Optimization and Control · Mathematics 2018-08-06 Thinh T. Doan , Carolyn L. Beck

We consider the problem of reserving link capacity in a network in such a way that any of a given set of flow scenarios can be supported. In the optimal capacity reservation problem, we choose the reserved link capacities to minimize the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-03 Nicholas Moehle , Xinyue Shen , Zhi-Quan Luo , Stephen Boyd

Motivated by emerging applications in wireless sensor networks and large-scale data processing, we consider distributed optimization over directed networks where the agents communicate their information locally to their neighbors to…

Optimization and Control · Mathematics 2021-03-22 Farzad Yousefian

We propose an algorithm for distributed optimization over time-varying communication networks. Our algorithm uses an optimized ratio between the number of rounds of communication and gradient evaluations to achieve fast convergence. The…

Optimization and Control · Mathematics 2020-01-08 Bryan Van Scoy , Laurent Lessard

We consider multi-commodity network design models, where capacity can be added to the arcs of the network using multiples of facilities that may have different capacities. This class of mixed-integer optimization models appears frequently…

Optimization and Control · Mathematics 2020-06-30 Alper Atamturk , Oktay Gunluk

Despite their high computation and communication costs, Newton-type methods remain an appealing option for distributed training due to their robustness against ill-conditioned convex problems. In this work, we study ommunication compression…

Machine Learning · Computer Science 2022-06-09 Rustem Islamov , Xun Qian , Slavomír Hanzely , Mher Safaryan , Peter Richtárik