English
Related papers

Related papers: A Duality Approach to Regularized Learning Problem…

200 papers

Bilevel programs are optimization problems where some variables are solutions to optimization problems themselves, and they arise in a variety of control applications, including: control of vehicle traffic networks, inverse reinforcement…

Optimization and Control · Mathematics 2017-09-27 Aurélien Ouattara , Anil Aswani

We consider ill-posed linear operator equations with operators acting between Banach spaces. For solution approximation, the methods of choice here are projection methods onto finite dimensional subspaces, thus extending existing results…

Numerical Analysis · Mathematics 2016-04-26 Uno Hämarik , Barbara Kaltenbacher , Urve Kangro , Elena Resmerita

The paper studies a general norm minimization problem on a product of normed vector spaces. We establish dual necessary and sufficient optimality conditions and derive explicit formulas for the corresponding solution sets. These formulas…

Optimization and Control · Mathematics 2026-01-14 Nguyen Duy Cuong

We propose a duality scheme for solving constrained nonsmooth and nonconvex optimization problems in a reflexive Banach space. We establish strong duality for a very general type of augmented Lagrangian, in which we assume a less…

Optimization and Control · Mathematics 2023-02-07 Regina S. Burachik , Xuemei Liu

Consider a nonlinear ill-posed operator equation $F(u)=y$ where $F$ is defined on a Banach space $X$. In general, for solving this equation numerically, a finite dimensional approximation of $X$ and an approximation of $F$ are required.…

Numerical Analysis · Mathematics 2015-05-18 C. Poeschl , E. Resmerita , O. Scherzer

We consider determining $\R$-minimizing solutions of linear ill-posed problems $A x = y$, where $A: {\mathscr X} \to {\mathscr Y}$ is a bounded linear operator from a Banach space ${\mathscr X}$ to a Hilbert space ${\mathscr Y}$ and…

Numerical Analysis · Mathematics 2023-07-05 Qinian Jin , Wei Wang

When optimization theorists consider optimization problems in infinite dimensional spaces, they need to deal with closed convex subsets(usually cones) which mostly have empty interior. These subsets often prevent optimization theorists from…

Functional Analysis · Mathematics 2022-10-19 Lixin Cheng , Weihao Mao

We investigate nonlinear eigenproblems for a broad class of proper, closed, convex functionals in reflexive Banach spaces. We develop a dual formulation of the nonlinear eigenproblem using the Fenchel conjugate and establish an equivalence…

Spectral Theory · Mathematics 2025-11-27 Jonathan Laubmann , Manuel Friedrich , Daniel Tenbrinck

In this paper, two parallel methods for solving systems of accretive operator equations in Banach spaces are studied. The convergence analysis of the methods in both free-noise and noisy data cases is provided.

Optimization and Control · Mathematics 2015-10-28 Pham Ky Anh , Nguyen Buong , Dang Van Hieu

We address the issue of binary classification in Banach spaces in presence of uncertainty. We show that a number of results from classical support vector machines theory can be appropriately generalised to their robust counterpart in Banach…

Machine Learning · Statistics 2022-02-18 Mohammed Sbihi , Nicolas Couellan

How to extract more and useful information for single image super resolution is an imperative and difficult problem. Learning-based method is a representative method for such task. However, the results are not so stable as there may exist…

Image and Video Processing · Electrical Eng. & Systems 2020-03-25 Hu Liang , Shengrong Zhao

This paper introduces a hypothesis space for deep learning based on deep neural networks (DNNs). By treating a DNN as a function of two variables - the input variable and the parameter variable - we consider the set of DNNs where the…

Machine Learning · Statistics 2025-08-15 Rui Wang , Yuesheng Xu , Mingsong Yan

A typical approach in estimating the learning rate of a regularized learning scheme is to bound the approximation error by the sum of the sampling error, the hypothesis error and the regularization error. Using a reproducing kernel space…

Machine Learning · Statistics 2011-01-28 Guohui Song , Haizhang Zhang

We study several classical concepts in the topic of strict convexity of norms in infinite dimensional Banach spaces. Specifically, and in descending order of strength, we deal with Uniform Rotundity (UR), Weak Uniform Rotundity (WUR) and…

Functional Analysis · Mathematics 2023-02-23 Petr Hájek , Andrés Quilis

In this article on variational regularization for ill-posed nonlinear problems, we are once again discussing the consequences of an oversmoothing penalty term. This means in our model that the searched-for solution of the considered…

Numerical Analysis · Mathematics 2023-05-02 Bernd Hofmann , Chantal Klinkhammer , Robert Plato

The subject of this paper is regularity-preserving aggregation of regular norms on finite-dimensional linear spaces. Regular norms were introduced in [5] and are closely related to ``type 2'' spaces [9, Chapter 9] playing important role in…

Optimization and Control · Mathematics 2024-02-13 Anatoli Juditsky , Arkadi Nemirovski

Existence of solutions to doubly nonlinear equations in reflexive Banach spaces is established by resorting to a global-in-time variational approach inspired by De Giorgi's principle, which characterizes the associated flows as…

Analysis of PDEs · Mathematics 2026-03-03 Alessandro Pinzi , Filippo Riva , Giuseppe Savaré

The aim of this paper is to develop an efficient algorithm for solving a class of unconstrained nondifferentiable convex optimization problems in finite dimensional spaces. To this end we formulate first its Fenchel dual problem and…

Optimization and Control · Mathematics 2012-03-12 Radu Ioan Bot , Christopher Hendrich

Diverse inverse problems in imaging can be cast as variational problems composed of a task-specific data fidelity term and a regularization term. In this paper, we propose a novel learnable general-purpose regularizer exploiting recent…

Optimization and Control · Mathematics 2020-02-19 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

This paper is concerned with the study of constrained statistical learning problems, the unconstrained version of which are at the core of virtually all of modern information processing. Accounting for constraints, however, is paramount to…

Machine Learning · Computer Science 2020-02-14 Luiz F. O. Chamon , Santiago Paternain , Miguel Calvo-Fullana , Alejandro Ribeiro