English
Related papers

Related papers: Optimization of Graph Total Variation via Active-S…

200 papers

This paper considers a distributed stochastic non-convex optimization problem, where the nodes in a network cooperatively minimize a sum of $L$-smooth local cost functions with sparse gradients. By adaptively adjusting the stepsizes…

Optimization and Control · Mathematics 2024-04-01 Dongyu Han , Kun Liu , Yeming Lin , Yuanqing Xia

In this paper, we first introduce a preconditioned primal-dual gradient algorithm based on conjugate duality theory. This algorithm is designed to solve composite optimization problem whose objective function consists of two summands: a…

Optimization and Control · Mathematics 2023-09-27 Jiahong Guo , Xiao Wang , Xiantao Xiao

Distributed Optimization is an increasingly important subject area with the rise of multi-agent control and optimization. We consider a decentralized stochastic optimization problem where the agents on a graph aim to asynchronously optimize…

Optimization and Control · Mathematics 2021-10-22 Vyacheslav Kungurtsev , Mahdi Morafah , Tara Javidi , Gesualdo Scutari

The performance of optimization methods is often tied to the spectrum of the objective Hessian. Yet, conventional assumptions, such as smoothness, do often not enable us to make finely-grained convergence statements -- particularly not for…

Optimization and Control · Mathematics 2024-02-08 Nikita Doikov , Sebastian U. Stich , Martin Jaggi

Causal structure learning has been a challenging task in the past decades and several mainstream approaches such as constraint- and score-based methods have been studied with theoretical guarantees. Recently, a new approach has transformed…

Machine Learning · Computer Science 2019-11-19 Ignavier Ng , Shengyu Zhu , Zhitang Chen , Zhuangyan Fang

The parameters of a neural network are naturally organized in groups, some of which might not contribute to its overall performance. To prune out unimportant groups of parameters, we can include some non-differentiable penalty to the…

Machine Learning · Computer Science 2023-01-06 Tristan Deleu , Yoshua Bengio

Off-lattice agent-based models (or cell-based models) of multicellular systems are increasingly used to create in-silico models of in-vitro and in-vivo experimental setups of cells and tissues, such as cancer spheroids, neural crest cell…

Numerical Analysis · Mathematics 2026-02-23 Justin Steinman , Andreas Buttenschön

We consider the minimization problem with the truncated quadratic regularization with gradient operator, which is a nonsmooth and nonconvex problem. We cooperated the classical preconditioned iterations for linear equations into the…

Optimization and Control · Mathematics 2021-05-04 Shengxiang Deng , Hongpeng Sun

This paper considers a distributed convex optimization problem over a time-varying multi-agent network, where each agent has its own decision variables that should be set so as to minimize its individual objective subject to local…

Optimization and Control · Mathematics 2018-05-22 Chuanye Gu , Zhiyou Wu , Jueyou Li , Yaning Guo

In this paper, a gradient-free distributed algorithm is introduced to solve a set constrained optimization problem under a directed communication network. Specifically, at each time-step, the agents locally compute a so-called…

Optimization and Control · Mathematics 2021-09-06 Yipeng Pang , Guoqiang Hu

Primal-dual methods for solving convex optimization problems with functional constraints often exhibit a distinct two-stage behavior. Initially, they converge towards a solution at a sublinear rate. Then, after a certain point, the method…

Optimization and Control · Mathematics 2026-02-12 Mateo Díaz , Pedro Izquierdo Lehmann , Haihao Lu , Jinwen Yang

We consider a class of linear programs on graphs with total variation regularization and a budgetary constraint. For these programs, we give a characterization of basic solutions in terms of rooted spanning forests with orientation on the…

Optimization and Control · Mathematics 2026-05-20 Dominic Yang

Recognition of an adversary's objective is a core problem in physical security and cyber defense. Prior work on target recognition focuses on developing optimal inference strategies given the adversary's operating environment. However, the…

Optimization and Control · Mathematics 2025-08-19 Anakin Dey , Sam Ruggerio , Manav Vora , Melkior Ornik

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

In this paper we propose an adaptively extrapolated proximal gradient method, which is based on the accelerated proximal gradient method (also known as FISTA), however we locally optimize the extrapolation parameter by carrying out an exact…

Optimization and Control · Mathematics 2019-07-02 Peter Ochs , Thomas Pock

Many discrete optimization problems amount to selecting a feasible set of edges of least weight. We consider in this paper the context of spatial graphs where the positions of the vertices are uncertain and belong to known uncertainty sets.…

Data Structures and Algorithms · Computer Science 2022-09-27 Marin Bougeret , Jérémy Omer , Michael Poss

We present a new feasible proximal gradient method for constrained optimization where both the objective and constraint functions are given by the summation of a smooth, possibly nonconvex function and a convex simple function. The…

Optimization and Control · Mathematics 2024-02-01 Digvijay Boob , Qi Deng , Guanghui Lan

The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of…

Optimization and Control · Mathematics 2022-03-02 Boris S. Mordukhovich , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

We present an algorithm that efficiently computes nearly-optimal solutions to a class of combinatorial reconfiguration problems on weighted, undirected graphs. Inspired by societally relevant applications in networked infrastructure…

Optimization and Control · Mathematics 2025-10-29 Samuel Talkington , Dmitrii M. Ostrovskii , Daniel K. Molzahn

In this paper, we propose a new graph-based transform and illustrate its potential application to signal compression. Our approach relies on the careful design of a graph that optimizes the overall rate-distortion performance through an…

Information Theory · Computer Science 2019-07-31 Giulia Fracastoro , Dorina Thanou , Pascal Frossard