English
Related papers

Related papers: First-Order Least-Squares Method for the Obstacle …

200 papers

A simple third order compact finite element method is proposed for one-dimensional Sturm-Liouville boundary value problems. The key idea is based on the interpolation error estimate, which can be related to the source term. Thus, a simple…

Numerical Analysis · Mathematics 2021-08-17 Baiying Dong , Zhilin Li

In this paper we study a class of unconstrained and constrained bilevel optimization problems in which the lower level is a possibly nonsmooth convex optimization problem, while the upper level is a possibly nonconvex optimization problem.…

Optimization and Control · Mathematics 2024-03-08 Zhaosong Lu , Sanyou Mei

Finite element approximation to a decoupled formulation for the quad--curl problem is studied in this paper. The difficulty of constructing elements with certain conformity to the quad--curl problems has been greatly reduced. For convex…

Numerical Analysis · Mathematics 2021-12-09 Shuhao Cao , Long Chen , Xuehai Huang

Source conditions are a key tool in regularisation theory that are needed to derive error estimates and convergence rates for ill-posed inverse problems. In this paper, we provide a recipe to practically compute source condition elements as…

Numerical Analysis · Mathematics 2024-03-01 Martin Benning , Tatiana A. Bubba , Luca Ratti , Danilo Riccio

This article discusses nonconforming finite element methods for convex minimization problems and systematically derives dual mixed formulations. Duality relations lead to simple error estimates that avoid an explicit treatment of…

Numerical Analysis · Mathematics 2020-02-07 Sören Bartels

In this paper, we consider both first- and second-order techniques to address continuous optimization problems arising in machine learning. In the first-order case, we propose a framework of transition from deterministic or…

Machine Learning · Computer Science 2021-11-30 Sanae Lotfi , Tiphaine Bonniot de Ruisselet , Dominique Orban , Andrea Lodi

We consider the fundamental problem in non-convex optimization of efficiently reaching a stationary point. In contrast to the convex case, in the long history of this basic problem, the only known theoretical results on first-order…

Optimization and Control · Mathematics 2016-08-26 Zeyuan Allen-Zhu , Elad Hazan

This paper proposes novel algorithm for non-convex multimodal constrained optimisation problems. It is based on sequential solving restrictions of problem to sections of feasible set by random subspaces (in general, manifolds) of low…

Optimization and Control · Mathematics 2023-03-28 Dmitry A. Pasechnyuk , Alexander Gornov

It was recently shown [7, 9] that "properly built" linear and polyhedral estimates nearly attain minimax accuracy bounds in the problem of recovery of unknown signal from noisy observations of linear images of the signal when the signal set…

Optimization and Control · Mathematics 2023-12-25 Yannis Bekri , Anatoli Juditsky , Arkadi Nemirovski

We consider mixed finite element approximation of a singularly perturbed fourth-order elliptic problem with two different boundary conditions, and present a new measure of the error, whose components are balanced with respect to the…

Numerical Analysis · Mathematics 2016-09-16 Shaohong Du , Runchang Lin , Zhimin Zhang

We present a stationary iteration based upon a block splitting for a class of indefinite least squares problem. Convergence of the proposed method is investigated and optimal value of the involving parameter is used. The induced…

Numerical Analysis · Mathematics 2025-12-15 Davod Khojasteh Salkuyeh

In this paper, we consider first-order convergence theory and algorithms for solving a class of non-convex non-concave min-max saddle-point problems, whose objective function is weakly convex in the variables of minimization and weakly…

Optimization and Control · Mathematics 2021-07-08 Mingrui Liu , Hassan Rafique , Qihang Lin , Tianbao Yang

Inverse problems are in many cases solved with optimization techniques. When the underlying model is linear, first-order gradient methods are usually sufficient. With nonlinear models, due to nonconvexity, one must often resort to…

Numerical Analysis · Mathematics 2023-05-15 Arttu Arjas , Mikko J. Sillanpää , Andreas Hauptmann

In this paper, we study finite-sample properties of the least squares estimator in first order autoregressive processes. By leveraging a result from decoupling theory, we derive upper bounds on the probability that the estimate deviates by…

Statistics Theory · Mathematics 2020-05-26 Rodrigo A. González , Cristian R. Rojas

In this paper we propose a quantum algorithm to determine the Tikhonov regularization parameter and solve the ill-conditioned linear equations, for example, arising from the finite element discretization of linear or nonlinear inverse…

Quantum Physics · Physics 2018-12-27 Changpeng Shao , Hua Xiang

This work provides simple algorithms for multi-class (and multi-label) prediction in settings where both the number of examples n and the data dimension d are relatively large. These robust and parameter free algorithms are essentially…

Machine Learning · Computer Science 2013-10-22 Alekh Agarwal , Sham M. Kakade , Nikos Karampatziakis , Le Song , Gregory Valiant

Nonnegative (linear) least square problems are a fundamental class of problems that is well-studied in statistical learning and for which solvers have been implemented in many of the standard programming languages used within the machine…

Optimization and Control · Mathematics 2022-03-09 Jelena Diakonikolas , Chenghui Li , Swati Padmanabhan , Chaobing Song

This article introduces a novel residual-based a posteriori error estimators for the Modified Weak Galerkin (MWG) finite element method applied to the obstacle problem. To the best of the author's knowledge, this work represents the first…

Numerical Analysis · Mathematics 2025-02-10 Tanvi Wadhawan

We study the quadratic penalty method (QPM) for smooth nonconvex optimization problems with equality constraints. Assuming the constraint violation satisfies the PL condition near the feasible set, we derive sharper worst-case complexity…

Optimization and Control · Mathematics 2026-01-06 Florentin Goyens , Geovani N. Grapiglia

Most inverse optimization models impute unspecified parameters of an objective function to make an observed solution optimal for a given optimization problem with a fixed feasible set. We propose two approaches to impute unspecified…

Optimization and Control · Mathematics 2019-07-19 Timothy C. Y. Chan , Neal Kaw