English
Related papers

Related papers: Smoothed-adaptive perturbed inverse iteration for …

200 papers

In this work, we develop analysis and algorithms for a class of (stochastic) bilevel optimization problems whose lower-level (LL) problem is strongly convex and linearly constrained. Most existing approaches for solving such problems rely…

Optimization and Control · Mathematics 2025-04-08 Prashant Khanduri , Ioannis Tsaknakis , Yihua Zhang , Sijia Liu , Mingyi Hong

Near isometric orthogonal embeddings to lower dimensions are a fundamental tool in data science and machine learning. In this paper, we present the construction of such embeddings that minimizes the maximum distortion for a given set of…

Machine Learning · Statistics 2017-12-15 Kshiteej Sheth , Dinesh Garg , Anirban Dasgupta

We consider fully discrete embedded finite element approximations for a shallow water hyperbolic problem and its reduced-order model. Our approach is based on a fixed background mesh and an embedded reduced basis. The Shifted Boundary…

Numerical Analysis · Mathematics 2022-06-29 Xianyi Zeng , Giovanni Stabile , Efthymios N. Karatzas , Guglielmo Scovazzi , Gianluigi Rozza

We study the Inexact Restoration framework with random models for minimizing functions whose evaluation is subject to errors. We propose a constrained formulation that includes well-known stochastic problems and an algorithm applicable when…

Optimization and Control · Mathematics 2026-02-24 Benedetta Morini , Simone Rebegoldi

This paper proposes a new inexact manifold proximal linear (IManPL) algorithm for solving nonsmooth, nonconvex composite optimization problems over an embedded submanifold. At each iteration, IManPL solves a convex subproblem inexactly,…

Optimization and Control · Mathematics 2025-11-11 Zhong Zheng , Xin Yu , Shiqian Ma , Lingzhou Xue

In this paper, a new iterative two-level algorithm is presented for solving the finite element discretization for nonsymmetric or indefinite elliptic problems. The iterative two-level algorithm uses the same coarse space as the traditional…

Numerical Analysis · Mathematics 2023-01-05 Ming Tang , Xiaoqing Xing , Ying Yang , Liuqiang Zhong

The aim of this paper is to investigate the use of an entropic projection method for the iterative regularization of linear ill-posed problems. We derive a closed form solution for the iterates and analyze their convergence behaviour both…

Optimization and Control · Mathematics 2020-01-29 Martin Burger , Elena Resmerita , Martin Benning

We consider adaptive finite element methods for second-order elliptic PDEs, where the arising discrete systems are not solved exactly. For contractive iterative solvers, we formulate an adaptive algorithm which monitors and steers the…

Numerical Analysis · Mathematics 2021-07-14 Gregor Gantner , Alexander Haberl , Dirk Praetorius , Stefan Schimanko

Optimization of convex functions subject to eigenvalue constraints is intriguing because of peculiar analytical properties of eigenvalues, and is of practical interest because of wide range of applications in fields such as structural…

Numerical Analysis · Mathematics 2013-10-08 Emre Mengi

We consider solving equality-constrained nonlinear, nonconvex optimization problems. This class of problems appears widely in a variety of applications in machine learning and engineering, ranging from constrained deep neural networks, to…

Optimization and Control · Mathematics 2023-05-31 Ilgee Hong , Sen Na , Michael W. Mahoney , Mladen Kolar

We present the first framework to solve linear inverse problems leveraging pre-trained latent diffusion models. Previously proposed algorithms (such as DPS and DDRM) only apply to pixel-space diffusion models. We theoretically analyze our…

Machine Learning · Computer Science 2023-07-04 Litu Rout , Negin Raoof , Giannis Daras , Constantine Caramanis , Alexandros G. Dimakis , Sanjay Shakkottai

In this paper, we propose a double iteratively reweighted algorithm to solve nonconvex and nonsmooth optimization problems, where both the objectives and constraint functions are formulated by concave compositions to promote group-sparse…

Optimization and Control · Mathematics 2025-11-25 Wanqin Nie , Kai Tu , Minglu Ye , Shuqin Sun

Recent development on mixed precision techniques has largely enhanced the performance of various linear algebra solvers, one of which being the solver for the least squares problem $\min_{x}\lVert b-Ax\rVert_{2}$. By transforming least…

Numerical Analysis · Mathematics 2025-09-09 Bowen Gao , Yuxin Ma , Meiyue Shao

We propose a new practical adaptive refinement strategy for $hp$-finite element approximations of elliptic problems. Following recent theoretical developments in polynomial-degree-robust a posteriori error analysis, we solve two types of…

Numerical Analysis · Mathematics 2018-10-17 Patrik Daniel , Alexandre Ern , Iain Smears , Martin Vohralík

In this work, we propose a high-order multiscale method for an elliptic model problem with rough and possibly highly oscillatory coefficients. Convergence rates of higher order are obtained using the regularity of the right-hand side only.…

Numerical Analysis · Mathematics 2023-04-18 Zhaonan Dong , Moritz Hauck , Roland Maier

Solving inverse problems with iterative algorithms is popular, especially for large data. Due to time constraints, the number of possible iterations is usually limited, potentially affecting the achievable accuracy. Given an error one is…

Numerical Analysis · Computer Science 2018-02-16 Raja Giryes , Yonina C. Eldar , Alex M. Bronstein , Guillermo Sapiro

In this article, we develop a posteriori error analysis of a nonconforming finite element method for a linear quadratic elliptic distributed optimal control problem with two different set of constraints, namely (i) integral state constraint…

Optimization and Control · Mathematics 2021-08-09 Kamana Porwal , Pratibha Shakya

In this paper, we propose an inexact perturbed path-following algorithm in the framework of Lagrangian dual decomposition for solving large-scale structured convex optimization problems. Unlike the exact versions considered in literature,…

Optimization and Control · Mathematics 2011-09-16 Quoc Tran Dinh , Ion Necoara , Carlo Savorgnan , Moritz Diehl

We study a class of algorithms for solving bilevel optimization problems in both stochastic and deterministic settings when the inner-level objective is strongly convex. Specifically, we consider algorithms based on inexact implicit…

Optimization and Control · Mathematics 2022-07-12 Michael Arbel , Julien Mairal

We develop error estimates for the finite element approximation of elliptic partial differential equations on perturbed domains, i.e. when the computational domain does not match the real geometry. The result shows that the error related to…

Numerical Analysis · Mathematics 2020-08-19 Piotr Minakowski , Thomas Richter