English
Related papers

Related papers: Adaptive Regularization of B-Spline Models for Sci…

200 papers

Large samples have been generated routinely from various sources. Classic statistical models, such as smoothing spline ANOVA models, are not well equipped to analyze such large samples due to expensive computational costs. In particular,…

Methodology · Statistics 2020-04-23 Xiaoxiao Sun , Wenxuan Zhong , Ping Ma

Regularization is used in many different areas of optimization when solutions are sought which not only minimize a given function, but also possess a certain degree of regularity. Popular applications are image denoising, sparse regression…

Optimization and Control · Mathematics 2021-11-15 Bennet Gebken , Katharina Bieker , Sebastian Peitz

This paper discusses a general framework for smoothing parameter estimation for models with regular likelihoods constructed in terms of unknown smooth functions of covariates. Gaussian random effects and parametric terms may also be…

Methodology · Statistics 2016-05-10 Simon N. Wood , Natalya Pya , Benjamin Säfken

Image registration is an inherently ill-posed problem that lacks the constraints needed for a unique mapping between voxels of the two images being registered. As such, one must regularize the registration to achieve physically meaningful…

Numerical Analysis · Mathematics 2025-02-03 Keyur D. Shah , James A. Shackleford , Nagarajan Kandasamy , Gregory C. Sharp

Even though dropout is a popular regularization technique, its theoretical properties are not fully understood. In this paper we study dropout regularization in extended generalized linear models based on double exponential families, for…

Machine Learning · Statistics 2024-07-30 Benedikt Lütke Schwienhorst , Lucas Kock , Nadja Klein , David J. Nott

Many scientific fields and applications require compact representations of multivariate functions. For this problem, decoupling methods are powerful techniques for representing the multivariate functions as a combination of linear…

Systems and Control · Electrical Eng. & Systems 2025-04-07 Joppe De Jonghe , Mariya Ishteva

Local perturbations around contours strongly disturb the final result of computer vision tasks. It is common to introduce a priori information in the estimation process. Improvement can be achieved via a deformable model such as the snake…

Computer Vision and Pattern Recognition · Computer Science 2016-04-01 R. L. B. Breder , Vania V. Estrela , J. T. de Assis

Numerous regularization methods for deformable image registration aim at enforcing smooth transformations, but are difficult to tune-in a priori and lack a clear physical basis. Physically inspired strategies have emerged, offering a sound…

Image and Video Processing · Electrical Eng. & Systems 2023-12-27 Pablo Alvarez , Stéphane Cotin

Regularizing neural networks is important for anticipating model behavior in regions of the data space that are not well represented. In this work, we propose a regularization technique for enforcing a level of smoothness in the mapping…

Machine Learning · Computer Science 2025-03-05 Ali Hasan , Haoming Yang , Yuting Ng , Vahid Tarokh

Pruning methods have recently grown in popularity as an effective way to reduce the size and computational complexity of deep neural networks. Large numbers of parameters can be removed from trained models with little discernible loss in…

Machine Learning · Computer Science 2024-01-18 Tim Whitaker , Darrell Whitley

Trustworthy machine learning necessitates meticulous regulation of model reliance on non-robust features. We propose a framework to delineate and regulate such features by attributing model predictions to the input. Within our approach,…

Machine Learning · Computer Science 2024-07-10 Peiyu Yang , Naveed Akhtar , Mubarak Shah , Ajmal Mian

We propose a variational regularization approach based on a multiscale representation called cylindrical shearlets aimed at dynamic imaging problems, especially dynamic tomography. The intuitive idea of our approach is to integrate a…

Numerical Analysis · Mathematics 2025-08-05 Tatiana A. Bubba , Tommi Heikkilä , Demetrio Labate , Luca Ratti

The parameter selection is crucial to regularization based image restoration methods. Generally speaking, a spatially fixed parameter for regularization item in the whole image does not perform well for both edge and smooth areas. A larger…

Image and Video Processing · Electrical Eng. & Systems 2021-04-07 Tingting Zhang , Jie Chen , Caiying Wu , Zhifei He , Tieyong Zeng , Qiyu Jin

The importance of regularization has been well established in image reconstruction -- which is the computational inversion of imaging forward model -- with applications including deconvolution for microscopy, tomographic reconstruction,…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Sanjay Viswanath , Manu Ghulyani , Muthuvel Arigovindan

With too few samples or too many model parameters, overfitting can inhibit the ability to generalise predictions to new data. Within medical imaging, this can occur when features are incorrectly assigned importance such as distinct hospital…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Becks Simpson , Francis Dutil , Yoshua Bengio , Joseph Paul Cohen

A basis expansion with regularization methods is much appealing to the flexible or robust nonlinear regression models for data with complex structures. When the underlying function has inhomogeneous smoothness, it is well known that…

Methodology · Statistics 2021-02-02 Daeju Kim , Shuichi Kawano , Yoshiyuki Ninomiya

General skinning techniques aim to deform the surface of an articulated model following the pose change of a skeleton. Their rapidity makes them ideal tools for real-time animation purposes. However, popular skinning algorithms are simple,…

Computational Geometry · Computer Science 2021-06-08 Tong Fu , Raphaëlle Chaine , Julie Digne

Modern technologies are producing a wealth of data with complex structures. For instance, in two-dimensional digital imaging, flow cytometry, and electroencephalography, matrix type covariates frequently arise when measurements are obtained…

Methodology · Statistics 2013-10-22 Hua Zhou , Lexin Li

Invariant-based models for incompressible isotropic hyperelasticity are typically formulated as functions of the first and second invariants, $W = W(\bar{I}_1, \bar{I}_2)$. A widely used class of models employs separable representations of…

Computational Engineering, Finance, and Science · Computer Science 2026-04-14 Simon Wiesheier , Miguel Angel Moreno-Mateos , Paul Steinmann

Neural networks are powerful function approximators with tremendous potential in learning complex distributions. However, they are prone to overfitting on spurious patterns. Bayesian inference provides a principled way to regularize neural…

Machine Learning · Computer Science 2024-12-02 Yanzhe Bekkemoen , Helge Langseth