English
Related papers

Related papers: Regularization to orthogonal-polynomials fitting w…

200 papers

Sparse matrix factorization is a popular tool to obtain interpretable data decompositions, which are also effective to perform data completion or denoising. Its applicability to large datasets has been addressed with online and randomized…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gaël Varoquaux

Machine learning models suffer from overfitting, which is caused by a lack of labeled data. To tackle this problem, we proposed a framework of regularization methods, called density-fixing, that can be used commonly for supervised and…

Machine Learning · Computer Science 2020-09-08 Masanari Kimura , Ryohei Izawa

Multiscale phenomena which include several processes occuring simultaneously at different length scales and exchanging energy with each other, are widespread in magnetism. These phenomena often govern the magnetization reversal dynamics,…

Materials Science · Physics 2009-10-31 V. V. Dobrovitski , M. I. Katsnelson , B. N. Harmon

Regularization is a popular technique in machine learning for model estimation and avoiding overfitting. Prior studies have found that modern ordered regularization can be more effective in handling highly correlated, high-dimensional data…

Machine Learning · Computer Science 2019-11-01 Mahammad Humayoo , Xueqi Cheng

Variational regularization is commonly used to solve linear inverse problems, and involves augmenting a data fidelity by a regularizer. The regularizer is used to promote a priori information and is weighted by a regularization parameter.…

Optimization and Control · Mathematics 2024-01-23 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

Several aspects of fusion rings and fusion rule algebras, and of their manifestations in twodimensional (conformal) field theory, are described: diagonalization and the connection with modular invariance; the presentation in terms of…

High Energy Physics - Theory · Physics 2009-10-22 J. Fuchs

The magnetic polarisabilities of octet baryons are calculated close to the physical quark-mass point using the background field method in lattice QCD. This first calculation draws on the identification and elimination of exceptional…

High Energy Physics - Lattice · Physics 2024-12-13 Thomas Kabelitz , Waseem Kamleh , Derek Leinweber

Model regularization requires extensive manual tuning to balance complexity against overfitting. Cross-regularization resolves this tradeoff by directly adapting regularization parameters through validation gradients during training. The…

Machine Learning · Computer Science 2025-06-25 Carlos Stein Brito

The Augmented Lagrangian Method as an approach for regularizing inverse problems received much attention recently, e.g. under the name Bregman iteration in imaging. This work shows convergence (rates) for this method when Morozov's…

Numerical Analysis · Mathematics 2012-04-19 Klaus Frick , Dirk A. Lorenz , Elena Resmerita

The paper is devoted to the study of regularized versions of multiobjective optimization problems described by directionally Lipschitzian functions. Such regularizations appear in proximal-type algorithms of multiobjective optimization,…

Optimization and Control · Mathematics 2025-11-21 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , B. S. Mordukhovich , P. R. Silva Filho

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

We introduce a generalized framework for studying higher-order versions of the multiscale method known as Localized Orthogonal Decomposition. Through a suitable reformulation, we are able to accommodate both conforming and nonconforming…

Numerical Analysis · Mathematics 2025-06-25 Moritz Hauck , Alexei Lozinski , Roland Maier

The exact matching condition is given for hadron matrix elements calculated in any two different schemes, in particular, in the lattice and dimensional regularization, (modified) minimal subtraction $\overline{\rm MS}$ schemes. The result…

High Energy Physics - Lattice · Physics 2007-05-23 Xiangdong Ji

Low-rank representation learning has emerged as a powerful tool for recovering missing values in power load data due to its ability to exploit the inherent low-dimensional structures of spatiotemporal measurements. Among various techniques,…

Machine Learning · Computer Science 2025-06-24 Yan Xia , Hao Feng , Hongwei Sun , Junjie Wang , Qicong Hu

This paper pursues a twofold goal. First, we introduce and study in detail a new notion of variational analysis called generalized metric subregularity, which is a far-going extension of the conventional metric subregularity conditions. Our…

Optimization and Control · Mathematics 2024-06-21 Guoyin Li , Boris Mordukhovich , Jiangxing Zhu

Magnetization of a ferromagnetic substance in response to an externally applied magnetic field increases with the strength of the field. This is because at the microscopic level, magnetic moments in certain regions or domains of the…

Machine Learning · Computer Science 2025-12-12 Vijay Prakash S

In this work we approach attractor neural networks from a machine learning perspective: we look for optimal network parameters by applying a gradient descent over a regularized loss function. Within this framework, the optimal…

Machine Learning · Computer Science 2024-02-21 Elena Agliari , Francesco Alemanno , Miriam Aquaro , Alberto Fachechi

We study implicit regularization when optimizing an underdetermined quadratic objective over a matrix $X$ with gradient descent on a factorization of $X$. We conjecture and provide empirical and theoretical evidence that with small enough…

Machine Learning · Statistics 2017-05-26 Suriya Gunasekar , Blake Woodworth , Srinadh Bhojanapalli , Behnam Neyshabur , Nathan Srebro

This paper is concerned with the factorization and equivalence problems of multivariate polynomial matrices. We present some new criteria for the existence of matrix factorizations for a class of multivariate polynomial matrices, and obtain…

Symbolic Computation · Computer Science 2020-10-15 Dong Lu , Dingkang Wang , Fanghui Xiao

Regularization is a well studied problem in the context of neural networks. It is usually used to improve the generalization performance when the number of input samples is relatively small or heavily contaminated with noise. The…

Artificial Intelligence · Computer Science 2011-04-19 Salah Rifai , Xavier Glorot , Yoshua Bengio , Pascal Vincent