English
Related papers

Related papers: Subspace correction methods for total variation an…

200 papers

We revisit a unified methodology for the iterative solution of nonlinear equations in Hilbert spaces. Our key observation is that the general approach from [Heid & Wihler, Math. Comp. 89 (2020), Calcolo 57 (2020)] satisfies an energy…

Numerical Analysis · Mathematics 2021-02-18 Pascal Heid , Dirk Praetorius , Thomas P. Wihler

Sparsity constrained minimization captures a wide spectrum of applications in both machine learning and signal processing. This class of problems is difficult to solve since it is NP-hard and existing solutions are primarily based on…

Optimization and Control · Mathematics 2018-12-31 Ganzhao Yuan , Bernard Ghanem

A new approximation format for solutions of partial differential equations depending on infinitely many parameters is introduced. By combining low-rank tensor approximation in a selected subset of variables with a sparse polynomial…

Numerical Analysis · Mathematics 2025-06-25 Markus Bachmayr , Huqing Yang

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms,…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Alessandro Rudi , Lorenzo Rosasco , Volkan Cevher

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

A common optimization problem is the minimization of a symmetric positive definite quadratic form $< x,Tx >$ under linear constrains. The solution to this problem may be given using the Moore-Penrose inverse matrix. In this work we extend…

Functional Analysis · Mathematics 2010-03-31 Dimitrios Pappas

This work deals with a regularization method enforcing solution sparsity of linear ill-posed problems by appropriate discretization in the image space. Namely, we formulate the so called least error method in an $\ell^1$ setting and perform…

Numerical Analysis · Mathematics 2016-08-03 Kristian Bredies , Barbara Kaltenbacher , Elena Resmerita

In this paper we look at a particular problem related to under-determined linear systems of equations with sparse solutions. $\ell_1$-minimization is a fairly successful polynomial technique that can in certain statistical scenarios find…

Information Theory · Computer Science 2015-07-17 Mihailo Stojnic

This paper introduces and studies the convergence properties of a new class of explicit $\epsilon$-subgradient methods for the task of minimizing a convex function over the set of minimizers of another convex minimization problem. The…

Optimization and Control · Mathematics 2019-04-03 Elias Salomão Helou , Lucas Eduardo Azevedo Simões

In the framework of a real Hilbert space we consider the problem of approaching solutions to a class of hierarchical variational inequality problems, subsuming several other problem classes including certain mathematical programs under…

Optimization and Control · Mathematics 2026-01-27 Pavel Dvurechensky , Meggie Marschner , Shimrit Shtern , Mathias Staudigl

This paper investigates solution strategies for nonlinear problems in Hilbert spaces, such as nonlinear partial differential equations (PDEs) in Sobolev spaces, when only finite measurements are available. We formulate this as a nonlinear…

Numerical Analysis · Mathematics 2025-06-06 Daozhe Lin , Qiang Du

We present two parallel optimization algorithms for a convex function $f$. The first algorithm optimizes over linear inequality constraints in a Hilbert space, $\mathbb H$, and the second over a non convex polyhedron in $\mathbb R^n$. The…

Optimization and Control · Mathematics 2025-10-22 E. Dov Neimand , Serban Sabau

This paper presents reproducing kernel Hilbert spaces method to obtain the numerical solution for partial differential equation constrained optimization problem.

Optimization and Control · Mathematics 2016-11-09 Majid Darehmiraki

We study three well-known minimization problems in Hilbert spaces: the weighted least squares problem and the related problems of abstract splines and smoothing. In each case we analyze the solvability of the problem for every point of the…

Functional Analysis · Mathematics 2019-10-23 Maximiliano Contino , Maria Eugenia Di Iorio y Lucero , Guillermina Fongi

Numerical homogenization aims to efficiently and accurately approximate the solution space of an elliptic partial differential operator with arbitrarily rough coefficients in a $d$-dimensional domain. The application of the inverse operator…

Numerical Analysis · Mathematics 2022-11-24 Moritz Hauck , Daniel Peterseim

Submodular function minimization is a fundamental optimization problem that arises in several applications in machine learning and computer vision. The problem is known to be solvable in polynomial time, but general purpose algorithms have…

Machine Learning · Computer Science 2015-02-10 Alina Ene , Huy L. Nguyen

We introduce a new variational method for the numerical homogenization of divergence form elliptic, parabolic and hyperbolic equations with arbitrary rough ($L^\infty$) coefficients. Our method does not rely on concepts of ergodicity or…

Numerical Analysis · Mathematics 2019-02-20 Houman Owhadi , Lei Zhang , Leonid Berlyand

We consider the problem of optimal recovery of an element $u$ of a Hilbert space $\mathcal{H}$ from $m$ measurements obtained through known linear functionals on $\mathcal{H}$. Problems of this type are well studied \cite{MRW} under an…

Numerical Analysis · Mathematics 2015-06-17 Peter Binev , Albert Cohen , Wolfgang Dahmen , Ronald DeVore , Guergana Petrova , Przemyslaw Wojtaszczyk

We provide a framework for the numerical approximation of distributed optimal control problems, based on least-squares finite element methods. Our proposed method simultaneously solves the state and adjoint equations and is $\inf$--$\sup$…

Numerical Analysis · Mathematics 2023-08-03 Thomas Führer , Michael Karkulik

A broad range of inverse problems can be abstracted into the problem of minimizing the sum of several convex functions in a Hilbert space. We propose a proximal decomposition algorithm for solving this problem with an arbitrary number of…

Optimization and Control · Mathematics 2009-11-13 Patrick L. Combettes , Jean-Christophe Pesquet