English
Related papers

Related papers: Prediction-Correction Splittings for Nonsmooth Tim…

200 papers

This paper proposes an algorithm for solving structured optimization problems, which covers both the backward-backward and the Douglas-Rachford algorithms as special cases, and analyzes its convergence. The set of fixed points of the…

Optimization and Control · Mathematics 2017-09-19 Nguyen Hieu Thao

The difference-of-convex (DC) program is an important model in nonconvex optimization due to its structure, which encompasses a wide range of practical applications. In this paper, we aim to tackle a generalized class of DC programs, where…

Optimization and Control · Mathematics 2025-05-29 Tan Nhat Pham , Minh N. Dao , Nima Amjady , Rakibuzzaman Shah

We propose a variational method to solve all three estimation problems for nonlinear stochastic dynamical systems: prediction, filtering, and smoothing. Our new approach is based upon a proper choice of cost function, termed the {\it…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Gregory L. Eyink

We analyze several generic proximal splitting algorithms well suited for large-scale convex nonsmooth optimization. We derive sublinear and linear convergence results with new rates on the function value suboptimality or distance to the…

Optimization and Control · Mathematics 2022-01-28 Laurent Condat , Grigory Malinovsky , Peter Richtárik

We present a stochastic setting for optimization problems with nonsmooth convex separable objective functions over linear equality constraints. To solve such problems, we propose a stochastic Alternating Direction Method of Multipliers…

Machine Learning · Computer Science 2013-01-23 Hua Ouyang , Niao He , Alexander Gray

In this paper, we develop a splitting algorithm incorporating Bregman distances to solve a broad class of linearly constrained composite optimization problems, whose objective function is the separable sum of possibly nonconvex nonsmooth…

Optimization and Control · Mathematics 2024-10-01 Tan Nhat Pham , Minh N. Dao , Andrew Eberhard , Nargiz Sultanova

The paper is devoted to the study of a new class of optimal control problems for nonsmooth dynamical systems governed by nonconvex discontinuous differential inclusions of the sweeping type with involving variable time into optimization. We…

Optimization and Control · Mathematics 2025-03-05 Tan H. Cao , Boris S. Mordukhovich , Dao Nguyen , Trang Nguyen , Nguyen N. Thieu

We propose a new approach for analyzing convergence of the Douglas-Rachford splitting method for solving convex composite optimization problems. The approach is based on a continuously differentiable function, the Douglas-Rachford Envelope…

Optimization and Control · Mathematics 2014-09-23 Panagiotis Patrinos , Lorenzo Stella , Alberto Bemporad

We consider the problem of non-smooth convex optimization with linear equality constraints, where the objective function is only accessible through its proximal operator. This problem arises in many different fields such as statistical…

Optimization and Control · Mathematics 2020-11-18 Anqi Fu , Junzi Zhang , Stephen Boyd

In this work, we consider methods for solving large-scale optimization problems with a possibly nonsmooth objective function. The key idea is to first specify a class of optimization algorithms using a generic iterative scheme involving…

Optimization and Control · Mathematics 2020-02-19 Sebastian Banert , Axel Ringh , Jonas Adler , Johan Karlsson , Ozan Öktem

This paper considers a time-varying optimization problem associated with a network of systems, with each of the systems shared by (and affecting) a number of individuals. The objective is to minimize cost functions associated with the…

Optimization and Control · Mathematics 2022-03-15 Ana M. Ospina , Andrea Simonetto , Emiliano Dall'Anese

This paper considers constrained linear dynamic games with quadratic objective functions, which can be cast as affine variational inequalities. By leveraging the problem structure, we apply the Douglas-Rachford splitting, which generates a…

Systems and Control · Electrical Eng. & Systems 2026-04-22 Reza Rahimi Baghbadorani , Emilio Benenati , Sergio Grammatico

We propose a continuous-time second-order optimization algorithm for solving unconstrained convex optimization problems with bounded Hessian. We show that this alternative algorithm has a comparable convergence rate to that of the…

Optimization and Control · Mathematics 2021-05-21 Hossein Moradian , Solmaz S. Kia

Optimization underpins many of the challenges that science and technology face on a daily basis. Recent years have witnessed a major shift from traditional optimization paradigms grounded on batch algorithms for medium-scale problems to…

Optimization and Control · Mathematics 2021-11-29 Andrea Simonetto , Emiliano Dall'Anese , Santiago Paternain , Geert Leus , Georgios B. Giannakis

We introduce an inertial variant of the forward-Douglas-Rachford splitting and analyze its convergence. We specify an instance of the proposed method to the three-composite convex minimization template. We provide practical guidance on the…

Optimization and Control · Mathematics 2019-05-01 Volkan Cevher , Bang Cong Vu , Alp Yurtsever

In this paper, we study a class of nonconvex and nonsmooth structured difference-of-convex (DC) programs, which contain in the convex part the sum of a nonsmooth linearly composed convex function and a differentiable function, and in the…

Optimization and Control · Mathematics 2025-05-06 Radu Ioan Bot , Rossen Nenov , Min Tao

We consider decentralized time-varying stochastic optimization problems where each of the functions held by the nodes has a finite sum structure. Such problems can be efficiently solved using variance reduction techniques. Our aim is to…

The deviation vectors provide additional degrees of freedom and effectively enhance the flexibility of algorithms. In the literature, the iterative schemes with deviations are constructed and their convergence analyses are performed on an…

Optimization and Control · Mathematics 2025-09-05 Yongyu Fu , Haowen Zheng , Qiao-Li Dong , Xiaolong Qin , Jing Zhao

This note is devoted to the distributed optimization problem of multi-agent systems with nonconvex velocity constraints, nonuniform position constraints and nonuniform stepsizes. Two distributed constrained algorithms with nonconvex…

Optimization and Control · Mathematics 2020-03-03 Peng Lin , Wei Ren , Chunhua Yang , Weihua Gui

The basic optimization problem of road design is quite challenging due to a objective function that is the sum of nonsmooth functions and the presence of set constraints. In this paper, we model and solve this problem by employing the…

Optimization and Control · Mathematics 2014-09-30 Heinz H. Bauschke , Valentin R. Koch , Hung M. Phan