English
Related papers

Related papers: Decentralized Inference for Spatial Data Using Low…

200 papers

With increased reliance on cyber infrastructure, large scale power networks face new challenges owing to computational scalability. In this paper we focus on developing an asynchronous decentralized solution framework for the Unit…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-15 Paritosh Ramanan , Murat Yildirim , Edmond Chow , Nagi Gebraeel

This work considers the decentralized successive convex approximation (SCA) method for minimizing stochastic non-convex objectives subject to convex constraints, along with possibly non-smooth convex regularizers. Although SCA has been…

Optimization and Control · Mathematics 2024-05-29 Basil M. Idrees , Shivangi Dubey Sharma , Ketan Rajawat

A power constrained sensor network that consists of multiple sensor nodes and a fusion center (FC) is considered, where the goal is to estimate a random parameter of interest. In contrast to the distributed framework, the sensor nodes may…

Information Theory · Computer Science 2012-07-03 Swarnendu Kar , Pramod K. Varshney

In many robotics problems, there is a significant gain in collaborative information sharing between multiple robots, for exploration, search and rescue, tracking multiple targets, or mapping large environments. One of the key implicit…

We propose novel randomized optimization methods for high-dimensional convex problems based on restrictions of variables to random subspaces. We consider oblivious and data-adaptive subspaces and study their approximation properties via…

Information Theory · Computer Science 2020-12-15 Jonathan Lacotte , Mert Pilanci

In all but the most trivial optimization problems, the structure of the solutions exhibit complex interdependencies between the input parameters. Decades of research with stochastic search techniques has shown the benefit of explicitly…

Neural and Evolutionary Computing · Computer Science 2017-03-23 Shumeet Baluja

The low-rank matrix approximation problems within a threshold are widely applied in information retrieval, image processing, background estimation of the video sequence problems and so on. This paper presents an adaptive randomized…

Numerical Analysis · Mathematics 2025-08-12 Qiaohua Liu , Yuejuan Yu

In this paper, we consider decentralized optimization problems where agents have individual cost functions to minimize subject to subspace constraints that require the minimizers across the network to lie in low-dimensional subspaces. This…

Optimization and Control · Mathematics 2023-08-01 Roula Nassif , Stefan Vlaski , Marco Carpentiero , Vincenzo Matta , Marc Antonini , Ali H. Sayed

Feedback optimization is an increasingly popular control paradigm to optimize dynamical systems, accounting for control objectives that concern the system operation at steady-state. Existing feedback optimization techniques heavily rely on…

Optimization and Control · Mathematics 2025-04-08 Amir Mehrnoosh , Gianluca Bianchin

Gradient tracking methods have emerged as one of the most popular approaches for solving decentralized optimization problems over networks. In this setting, each node in the network has a portion of the global objective function, and the…

Optimization and Control · Mathematics 2023-11-27 Albert S. Berahas , Raghu Bollapragada , Shagun Gupta

We propose a novel analysis framework for non-descent-type optimization methodologies in nonconvex scenarios based on the Kurdyka-Lojasiewicz property. Our framework allows covering a broad class of algorithms, including those commonly…

Optimization and Control · Mathematics 2024-06-05 Junwen Qiu , Bohao Ma , Xiao Li , Andre Milzarek

We consider the problem of decentralized optimization over time-varying directed networks. The network nodes can access only their local objectives, and aim to collaboratively minimize a global function by exchanging messages with their…

Systems and Control · Electrical Eng. & Systems 2021-12-03 Yiyue Chen , Abolfazl Hashemi , Haris Vikalo

Unsupervised integrative analysis of multiple data sources has become common place and scalable algorithms are necessary to accommodate ever increasing availability of data. Only few currently methods have estimation speed as their focus,…

Methodology · Statistics 2024-05-17 Felix Held

This paper introduces a novel method for eigenvalue computation using a distributed cooperative neural network framework. Unlike traditional techniques that face scalability challenges in large systems, our decentralized algorithm enables…

Machine Learning · Computer Science 2024-09-20 Ronald Katende

In this paper, a new one-parameter filled function approach is developed for nonlinear multi-objective optimization. Inspired by key filled function ideas from single-objective optimization, the proposed method is adapted to the…

Optimization and Control · Mathematics 2026-04-01 Bikram Adhikary , Md Abu Talhamainuddin Ansary

Rapid advances in data collection and processing capabilities have allowed for the use of increasingly complex models that give rise to nonconvex optimization problems. These formulations, however, can be arbitrarily difficult to solve in…

Multiagent Systems · Computer Science 2020-04-01 Stefan Vlaski , Ali H. Sayed

Decentralized optimization is well studied for smooth unconstrained problems. However, constrained problems or problems with composite terms are an open direction for research. We study structured (or composite) optimization problems, where…

Optimization and Control · Mathematics 2023-04-10 Alexander Rogozin , Anton Novitskii , Alexander Gasnikov

Decentralized optimization methods often entail information exchange between neighbors. Transmission failures can happen due to network congestion, hardware/software issues, communication outage, and other factors. In this paper, we…

Machine Learning · Computer Science 2024-01-05 Wenjing Yan , Xuanyu Cao

As the number of samples and dimensionality of optimization problems related to statistics an machine learning explode, block coordinate descent algorithms have gained popularity since they reduce the original problem to several smaller…

Machine Learning · Computer Science 2016-06-24 Rémi Flamary , Alain Rakotomamonjy , Gilles Gasso

This paper concerns models and convergence principles for dealing with stochasticity in a wide range of algorithms arising in nonlinear analysis and optimization in Hilbert spaces. It proposes a flexible geometric framework within which…

Optimization and Control · Mathematics 2026-02-17 Patrick L. Combettes , Javier I. Madariaga