English
Related papers

Related papers: Regularized Learning Schemes in Feature Banach Spa…

200 papers

In this paper, we consider a generic probabilistic discriminative learner from the functional viewpoint and argue that, to make it learn well, it is necessary to constrain its hypothesis space to a set of non-trivial piecewise constant…

Machine Learning · Statistics 2018-06-05 Yi-Qing Wang

We propose a new \emph{Transformed Risk Minimization} (TRM) framework as an extension of classical risk minimization. In TRM, we optimize not only over predictive models, but also over data transformations; specifically over distributions…

Machine Learning · Computer Science 2023-10-09 Evangelos Chatzipantazis , Stefanos Pertigkiozoglou , Kostas Daniilidis , Edgar Dobriban

Spatially varying regularization accommodates the deformation variations that may be necessary for different anatomical regions during deformable image registration. Historically, optimization-based registration models have harnessed…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Junyu Chen , Shuwen Wei , Yihao Liu , Zhangxing Bian , Yufan He , Aaron Carass , Harrison Bai , Yong Du

In this paper, based on the Tikhonov regularization technique, we study a monotone general variational inequality (GVI) by considering an associated strongly monotone GVI, depending on a regularization parameter $\alpha,$ such that the…

Optimization and Control · Mathematics 2025-03-11 Pham Ky Anh , Trinh Ngoc Hai , Nguyen Van Manh

In continuation of the paper [3], we discuss various consequences of Hahn-Banach theorem for bounded b-linear functional in linear n-normed space and describe the notion of reflexivity of linear n-normed space with respect to bounded…

Functional Analysis · Mathematics 2024-10-29 Prasenjit Ghosh , Tapas Kumar Samanta

In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks and cascaded…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Andreas Kofler , Markus Haltmeier , Tobias Schaeffter , Marc Kachelrieß , Marc Dewey , Christian Wald , Christoph Kolbitsch

A supervised learning approach is proposed for regularization of large inverse problems where the main operator is built from noisy data. This is germane to superresolution imaging via the sampling indicators of the inverse scattering…

Numerical Analysis · Mathematics 2025-08-22 Fatemeh Pourahmadian , Yang Xu

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations leading to various…

Machine Learning · Statistics 2019-05-15 Alberto Bietti , Grégoire Mialon , Dexiong Chen , Julien Mairal

In this work, we study the well-posedness of certain sparse regularized linear regression problems, i.e., the existence, uniqueness and continuity of the solution map with respect to the data. We focus on regularization functions that are…

Statistics Theory · Mathematics 2024-09-06 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

We exploit the similarities between Tikhonov regularization and Bayesian hierarchical models to propose a regularization scheme that acts like a distributed Tikhonov regularization where the amount of regularization varies from component to…

Numerical Analysis · Mathematics 2024-04-10 Daniela Calvetti , Erkki Somersalo

Normalization layers have recently experienced a renaissance in the deep reinforcement learning and continual learning literature, with several works highlighting diverse benefits such as improving loss landscape conditioning and combatting…

Machine Learning · Computer Science 2024-07-03 Clare Lyle , Zeyu Zheng , Khimya Khetarpal , James Martens , Hado van Hasselt , Razvan Pascanu , Will Dabney

Tensor-based methods are receiving a growing interest in scientific computing for the numerical solution of problems defined in high dimensional tensor product spaces. A family of methods called Proper Generalized Decompositions methods…

Numerical Analysis · Mathematics 2011-12-02 Antonio Falco , Anthony Nouy

Considering the question: how non-linear may a non-linear operator be in order to extend the linear regularization theory, we introduce the class of dilinear mappings, which covers linear, bilinear, and quadratic operators between Banach…

Numerical Analysis · Mathematics 2021-03-19 Robert Beinert , Kristian Bredies

Proper regularization is critical for speeding up training, improving generalization performance, and learning compact models that are cost efficient. We propose and analyze regularized gradient descent algorithms for learning shallow…

Machine Learning · Computer Science 2018-06-08 Samet Oymak

It is well known that in the calculus of variations and in optimization there exist many formulations of the fundamental propositions on the attainment of the infima of sequentially weakly lower semicontinuous coercive functions on…

Functional Analysis · Mathematics 2022-05-04 Yan Tang , Shiqing Zhang , Tiexin Guo

Statistical inverse learning theory, a field that lies at the intersection of inverse problems and statistical learning, has lately gained more and more attention. In an effort to steer this interplay more towards the variational…

Statistics Theory · Mathematics 2022-04-27 Tatiana A. Bubba , Luca Ratti

In this work, we investigate the generalization properties of random feature methods. Our analysis extends prior results for Tikhonov regularization to a broad class of spectral regularization techniques and further generalizes the setting…

Machine Learning · Statistics 2026-03-03 Mike Nguyen , Nicole Mücke

This paper is concerned with a novel regularisation technique for solving linear ill-posed operator equations in Hilbert spaces from data that is corrupted by white noise. We combine convex penalty functionals with extreme-value statistics…

Statistics Theory · Mathematics 2012-04-03 Klaus Frick , Philipp Marnitz , Axel Munk

Beside the minimization of the prediction error, two of the most desirable properties of a regression scheme are stability and interpretability. Driven by these principles, we propose continuous-domain formulations for one-dimensional…

Machine Learning · Computer Science 2021-12-28 Shayan Aziznejad , Thomas Debarre , Michael Unser

Feature selection with specific multivariate performance measures is the key to the success of many applications, such as image retrieval and text classification. The existing feature selection methods are usually designed for…

Machine Learning · Computer Science 2015-03-19 Qi Mao , Ivor W. Tsang