English
Related papers

Related papers: Comparing Averaged Relaxed Cutters and Projection …

200 papers

In this paper, we present a variant of the circumcenter method for the Convex Feasibility Problem (CFP), ensuring finite convergence under a Slater assumption. The method replaces exact projections onto the convex sets with projections onto…

Optimization and Control · Mathematics 2024-10-10 Roger Behling , Yunier Bello-Cruz , Alfredo Iusem , Di Liu , Luiz-Rafael Santos

In this paper, we study the nonexpansive properties of metric resolvent, and present a convergence rate analysis for the associated fixed-point iterations (Banach-Picard and Krasnosel'skii-Mann types). Equipped with a variable metric, we…

Optimization and Control · Mathematics 2021-09-14 Feng Xue

Structured pruning is a standard tool for compressing deep neural networks, but its practical performance depends on how sparsity is allocated across layers. We propose FAIR-Pruner, a search-free framework for adaptive layer-wise structured…

Machine Learning · Computer Science 2026-05-21 Chenqing Lin , Mostafa Hussien , Chengyao Yu , Bingyi Jing , Ruixing Ming , Kim Khoa Nguyen , Mohamed Cheriet

The numerical properties of algorithms for finding the intersection of sets depend to some extent on the regularity of the sets, but even more importantly on the regularity of the intersection. The alternating projection algorithm of von…

Optimization and Control · Mathematics 2018-09-24 D. Russell Luke

In recent times the Douglas-Rachford algorithm has been observed empirically to solve a variety of nonconvex feasibility problems including those of a combinatorial nature. For many of these problems current theory is not sufficient to…

Optimization and Control · Mathematics 2017-07-24 Francisco J. Aragón Artacho , Jonathan M. Borwein , Matthew K. Tam

The elementary Euclidean concept of circumcenter has recently been employed to improve two aspects of the classical Douglas--Rachford method for projecting onto the intersection of affine subspaces. The so-called circumcentered-reflection…

Optimization and Control · Mathematics 2021-03-30 Roger Behling , J. -Yunier Bello-Cruz , Luiz-Rafael Santos

We consider the problem of estimating an additive regression function in an inverse regres- sion model with a convolution type operator. A smooth backfitting procedure is developed and asymptotic normality of the resulting estimator is…

Methodology · Statistics 2016-11-26 Nicolai Bissantz , Holger Dette , Thimo Hildebrandt

We study relaxations for linear programs with complementarity constraints, especially instances whose complementary pairs of variables are not independent. Our formulation is based on identifying vertex covers of the conflict graph of the…

Optimization and Control · Mathematics 2022-08-03 Alberto Del Pia , Jeff Linderoth , Haoran Zhu

Projection operators are important in Analysis, Optimization and Algorithm. It is well known that these operators are firmly nonexpansive. In this paper, we provide an exact result that sharpens this well-known result. We develop the theory…

Functional Analysis · Mathematics 2025-07-23 Shuang Song

Projection algorithms are well known for their simplicity and flexibility in solving feasibility problems. They are particularly important in practice due to minimal requirements for software implementation and maintenance. In this work, we…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

This work is devoted to establish the strong convergence results of an iterative algorithm generated by the shrinking projection method in Hilbert spaces. The proposed approximation sequence is used to find a common element in the set of…

Functional Analysis · Mathematics 2018-03-07 Abdul Ghaffar , Zafar Ullah , Muhammad Aqeel Ahmad Khan , Faisal Mumtaz

The Douglas-Rachford and Peaceman-Rachford algorithms have been successfully employed to solve convex optimization problems, or more generally find zeros of monotone inclusions. Recently, the behaviour of these methods in the inconsistent…

Optimization and Control · Mathematics 2024-05-28 Regina S. Burachik , Bethany I. Caldwell , C. Yalçın Kaya , Walaa M. Moursi , Matthew Saurette

In this paper we present two Douglas-Rachford inspired iteration schemes which can be applied directly to N-set convex feasibility problems in Hilbert space. Our main results are weak convergence of the methods to a point whose nearest…

Optimization and Control · Mathematics 2018-05-28 Jonathan M. Borwein , Matthew K. Tam

The proximal point algorithm is a widely used tool for solving a variety of convex optimization problems such as finding zeros of maximally monotone operators, fixed points of nonexpansive mappings, as well as minimizing convex functions.…

Optimization and Control · Mathematics 2018-04-19 Laurentiu Leustean , Adriana Nicolae , Andrei Sipos

Many high dimensional sparse learning problems are formulated as nonconvex optimization. A popular approach to solve these nonconvex optimization problems is through convex relaxations such as linear and semidefinite programming. In this…

Machine Learning · Statistics 2015-03-17 Zhaoran Wang , Quanquan Gu , Han Liu

We develop a cut finite element method (CutFEM) for convection-diffusion problems posed on mixed-dimensional domains, i.e., unions of manifolds of different dimensions arranged in a hierarchical structure where lower-dimensional components…

Numerical Analysis · Mathematics 2026-04-09 Erik Burman , Peter Hansbo , Mats G. Larson , Karl Larsson , Shantiram Mahata

Douglas-Rachford splitting and the alternating direction method of multipliers (ADMM) can be used to solve convex optimization problems that consist of a sum of two functions. Convergence rate estimates for these algorithms have received…

Optimization and Control · Mathematics 2015-03-04 Pontus Giselsson

Approximations of optimization problems arise in computational procedures and sensitivity analysis. The resulting effect on solutions can be significant, with even small approximations of components of a problem translating into large…

Optimization and Control · Mathematics 2022-08-10 Johannes O. Royset

Our study is motivated by the solution of Mixed-Integer Non-Linear Programming (MINLP) problems with separable non-convex functions via the Sequential Convex MINLP technique, an iterative method whose main characteristic is that of solving,…

Optimization and Control · Mathematics 2022-11-29 Renan Spencer Trindade , Claudia D'Ambrosio , Antonio Frangioni , Claudio Gentile

We study the applicability of the Peaceman-Rachford (PR) splitting method for solving nonconvex optimization problems. When applied to minimizing the sum of a strongly convex Lipschitz differentiable function and a proper closed function,…

Optimization and Control · Mathematics 2017-01-10 Guoyin Li , Tianxiang Liu , Ting Kei Pong