English
Related papers

Related papers: New inertial regularized algorithm for solving str…

200 papers

A method is suggested for treating those complicated physical problems for which exact solutions are not known but a few approximation terms of a calculational algorithm can be derived. The method permits one to answer the following rather…

High Energy Physics - Phenomenology · Physics 2009-10-31 V. I. Yukalov , E. P. Yukalova

We provide a general approach to Lipschitz regularity of solutions for a large class of vector-valued, nonautonomous variational problems exhibiting nonuniform ellipticity. The functionals considered here range amongst those with unbalanced…

Analysis of PDEs · Mathematics 2021-08-02 Cristiana De Filippis , Giuseppe Mingione

In this paper, by regarding the two-subspace Kaczmarz method [20] as an alternated inertial randomized Kaczmarz algorithm we present a new convergence rate estimate which is shown to be better than that in [20] under a mild condition.…

Numerical Analysis · Mathematics 2023-06-16 Songnian He , Ziting Wang , Qiao-Li Dong

We prove Lipschitz continuity results for solutions to a class of obstacle problems under standard growth conditions of $p$-type, $p \geq 2$. The main novelty is the use of a linearization technique going back to [28] in order to interpret…

Analysis of PDEs · Mathematics 2022-10-13 Carlo Benassi , Michele Caselli

We consider the problem of regularized Poisson Non-negative Matrix Factorization (NMF) problem, encompassing various regularization terms such as Lipschitz and relatively smooth functions, alongside linear constraints. This problem holds…

Machine Learning · Computer Science 2024-04-26 Nathanaël Perraudin , Adrien Teutrie , Cécile Hébert , Guillaume Obozinski

We propose a communication- and computation-efficient distributed optimization algorithm using second-order information for solving ERM problems with a nonsmooth regularization term. Current second-order and quasi-Newton methods for this…

Optimization and Control · Mathematics 2018-05-29 Ching-pei Lee , Cong Han Lim , Stephen J. Wright

Regularization is a core component of modern inverse problems, as it helps establish the well-posedness of the solution of interest. Popular regularization approaches include variational regularization and iterative regularization. The…

Optimization and Control · Mathematics 2025-08-08 Jie Gao , Cesare Molinari , Silvia Villa , Jingwei Liang

We propose a first order algorithm, a modified version of FISTA, to solve an optimization problem with an objective function that is a sum of a possibly nonconvex function, with Lipschitz continuous gradient, and a convex function which can…

Optimization and Control · Mathematics 2025-08-20 Chee-Khian Sim

In recent years, the development of multimodal autoencoders has gained significant attention due to their potential to handle multimodal complex data types and improve model performance. Understanding the stability and robustness of these…

Machine Learning · Computer Science 2026-03-27 Diyar Altinses , Andreas Schwung

One way of improving the behavior of finite element schemes for classical, time-dependent Maxwell's equations, is to render them from their hyperbolic character to elliptic form. This paper is devoted to the study of the stabilized linear…

Numerical Analysis · Mathematics 2024-09-23 M. Asadzadeh , L. Beilina

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

Optimization and Control · Mathematics 2022-10-17 Christian Kanzow , Theresa Lechner

This paper is devoted to the analysis of a finite horizon discrete-time stochastic optimal control problem, in presence of constraints. We study the regularity of the value function which comes from the dynamic programming algorithm. We…

Optimization and Control · Mathematics 2007-05-23 M. Papi , S. Sbaraglia

In large-scale applications, such as machine learning, it is desirable to design non-convex optimization algorithms with a high degree of parallelization. In this work, we study the adaptive complexity of finding a stationary point, which…

Optimization and Control · Mathematics 2025-05-15 Huanjian Zhou , Andi Han , Akiko Takeda , Masashi Sugiyama

We propose and analyze an accelerated iterative dual diagonal descent algorithm for the solution of linear inverse problems with general regularization and data-fit functions. In particular, we develop an inertial approach of which we…

Optimization and Control · Mathematics 2023-12-25 Luca Calatroni , Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

In this paper we are interested in integro-differential elliptic and parabolic equations involving nonlocal operators with order less than one, and a gradient term whose coercivity growth makes it the leading term in the equation. We obtain…

Analysis of PDEs · Mathematics 2015-05-13 Guy Barles , Erwin Topp

Recently, there were introduced important classes of relatively smooth, relatively continuous, and relatively strongly convex optimization problems. These concepts have significantly expanded the class of problems for which optimal…

Optimization and Control · Mathematics 2023-03-07 Oleg Savchuk , Fedor Stonyakin , Mohammad Alkousa , Rida Zabirova , Alexander Titov , Alexander Gasnikov

We consider non-smooth saddle point optimization problems. To solve these problems, we propose a zeroth-order method under bounded or Lipschitz continuous noise, possible adversarial. In contrast to the state-of-the-art algorithms, our…

Optimization and Control · Mathematics 2023-03-28 Darina Dvinskikh , Vladislav Tominin , Yaroslav Tominin , Alexander Gasnikov

We consider a regularized least squares problem, with regularization by structured sparsity-inducing norms, which extend the usual $\ell_1$ and the group lasso penalty, by allowing the subsets to overlap. Such regularizations lead to…

Optimization and Control · Mathematics 2012-09-04 Silvia Villa , Lorenzo Rosasco , Sofia Mosci , Alessandro Verri

Smoothness and low dimensional structures play central roles in improving generalization and stability in learning and statistics. This work combines techniques from semi-infinite constrained learning and manifold regularization to learn…

Machine Learning · Computer Science 2023-02-03 Juan Cervino , Luiz F. O. Chamon , Benjamin D. Haeffele , Rene Vidal , Alejandro Ribeiro

We study differentiable strongly quasiconvex functions for providing new properties for algorithmic and monotonicity purposes. Furthemore, we provide insights into the decreasing behaviour of strongly quasiconvex functions, applying this…

Optimization and Control · Mathematics 2024-10-07 Felipe Lara , Raúl T. Marcavillaca , Phan T. Vuong