English
Related papers

Related papers: Flexible Regularized Estimating Equations: Some Ne…

200 papers

Monotone inclusions have a wide range of applications, including minimization, saddle-point, and equilibria problems. We introduce new stochastic algorithms, with or without variance reduction, to estimate a root of the expectation of…

Optimization and Control · Mathematics 2024-05-24 Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

Building up on classical linear formulations, we posit that a broad class of problems in signal synthesis and in signal recovery are reducible to the basic task of finding a point in a closed convex subset of a Hilbert space that satisfies…

Optimization and Control · Mathematics 2021-05-18 Patrick L. Combettes , Zev C. Woodstock

In this work we establish the equivalence of algorithmic regularization and explicit convex penalization for generic convex losses. We introduce a geometric condition for the optimization path of a convex function, and show that if such a…

Optimization and Control · Mathematics 2019-09-10 Qian Qian , Xiaoyuan Qian

We propose a new algorithm that finds an $\varepsilon$-approximate fixed point of a smooth function from the $n$-dimensional $\ell_2$ unit ball to itself. We use the general framework of finding approximate solutions to a variational…

Computer Science and Game Theory · Computer Science 2025-01-22 Idan Attias , Yuval Dagan , Constantinos Daskalakis , Rui Yao , Manolis Zampetakis

Variational inequalities are a formalism that includes games, minimization, saddle point, and equilibrium problems as special cases. Methods for variational inequalities are therefore universal approaches for many applied tasks, including…

In this paper, we introduce and study a new extragradient iterative process for finding a common element of the set of fixed points of an infinite family of nonexpansive mappings and the set of solutions of a variational inequality for an…

Functional Analysis · Mathematics 2014-05-22 Ibrahim Karahan , Murat Ozdemir

Local solutions for variational and quasi-variational inequalities are usually the best type of solutions that could practically be obtained when in case of lack of convexity or else when available numerical techniques are too limited for…

Optimization and Control · Mathematics 2024-05-16 Didier Aussel , Parin Chaipunya

The article is devoted to some adaptive methods for variational inequalities with relatively smooth and relatively strongly monotone operators. Starting from the recently proposed proximal variant of the extragradient method for this class…

Optimization and Control · Mathematics 2023-08-02 S. S. Ablaev , F. S. Stonyakin , M. S. Alkousa , D. A. Pasechnyuk

Previous papers have shown the impact of partial convergence of discretized PDE on the accuracy of tangent and adjoint linearizations. A series of papers suggested linearization of the fixed point iteration used in the solution process as a…

Numerical Analysis · Mathematics 2022-02-24 Emmett Padway , Dimitri Mavriplis

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

This paper is concerned with recovering the solution of a final value problem associated with a parabolic equation involving a non linear source and a non-local term, which to the best of our knowledge has not been studied earlier. It is…

Numerical Analysis · Mathematics 2023-12-20 Subhankar Mondal

We consider finite element approximations of ill-posed elliptic problems with conditional stability. The notion of {\emph{optimal error estimates}} is defined including both convergence with respect to mesh parameter and perturbations in…

Numerical Analysis · Mathematics 2024-03-25 Erik Burman , Mihai Nechita , Lauri Oksanen

Fixed points represent equilibrium states, stability, and solutions to a range of problems. It has been an active field of research. In this paper, we provide an overview of the main branches of fixed point theory. We discuss the key…

History and Overview · Mathematics 2023-09-08 Firuz Kamalov , Ho Hon Leung

In this paper, we present a unified analysis of methods for such a wide class of problems as variational inequalities, which includes minimization problems and saddle point problems. We develop our analysis on the modified Extra-Gradient…

Optimization and Control · Mathematics 2023-04-18 Aleksandr Beznosikov , Alexander Gasnikov , Karina Zainulina , Alexander Maslovskiy , Dmitry Pasechnyuk

Most algorithms for solving optimization problems or finding saddle points of convex-concave functions are fixed-point algorithms. In this work we consider the generic problem of finding a fixed point of an average of operators, or an…

Machine Learning · Computer Science 2020-06-17 Grigory Malinovsky , Dmitry Kovalev , Elnur Gasanov , Laurent Condat , Peter Richtárik

We consider the problem of recovering a signal from nonlinear transformations, under convex constraints modeling a priori information. Standard feasibility and optimization methods are ill-suited to tackle this problem due to the…

Optimization and Control · Mathematics 2020-06-16 Patrick L. Combettes , Zev. C. Woodstock

The following paper compares a consistent Newton-Raphson and fixed-point iteration based solution strategy for a variational multiscale finite element formulation for incompressible Navier-Stokes. The main contributions of this work include…

Numerical Analysis · Computer Science 2008-06-24 D. Z. Turner , K. B. Nakshatrala , K. D. Hjelmstad

Many statistical estimation procedures lead to nonconvex optimization problems. Algorithms to solve these are often guaranteed to output a stationary point of the optimization problem. Oracle inequalities are an important theoretical…

Statistics Theory · Mathematics 2018-02-28 Andreas Elsener , Sara van de Geer

We introduce a new approach to obtaining pointwise estimates for solutions of elliptic boundary value problems when the operator being considered satisfies a certain type of weighted integral inequalities. The method is illustrated on…

Analysis of PDEs · Mathematics 2015-05-12 Guo Luo , Vladimir G. Maz'ya

Point processes are stochastic models generating interacting points or events in time, space, etc. Among characteristics of these models, first-order intensity and conditional intensity functions are often considered. We focus on…

Statistics Theory · Mathematics 2023-05-24 Jean-François Coeurjolly , Ismaïla Ba , Achmad Choiruddin