English
Related papers

Related papers: Unified Models for Second-Order TV-Type Regularisa…

200 papers

Weight-sharing is ubiquitous in deep learning. Motivated by this, we propose a "weight-sharing regularization" penalty on the weights $w \in \mathbb{R}^d$ of a neural network, defined as $\mathcal{R}(w) = \frac{1}{d - 1}\sum_{i > j}^d |w_i…

Machine Learning · Computer Science 2024-03-12 Mehran Shakerinava , Motahareh Sohrabi , Siamak Ravanbakhsh , Simon Lacoste-Julien

Focus of this work is solving a non-smooth constraint minimization problem by a primal-dual splitting algorithm involving proximity operators. The problem is penalized by the Bregman divergence associated with the non-smooth total variation…

Numerical Analysis · Mathematics 2020-02-25 Erdem Altuntac

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

Recently, non-convex regularisation models have been introduced in order to provide a better prior for gradient distributions in real images. They are based on using concave energies $\phi$ in the total variation type functional…

Functional Analysis · Mathematics 2020-02-13 Michael Hintermüller , Tuomo Valkonen , Tao Wu

We give a comprehensive survey on a class of higher order variational problems which are motivated by applications in mathematical imaging. The overall aim of this note is to investigate if and in which manner results from the first…

Analysis of PDEs · Mathematics 2018-03-28 Martin Fuchs , Jan Mueller

A novel class of semi-norms, generalising the notion of the isotropic total variation $TV_{2}$ and the an-isotropic total variation $TV_{1}$ is introduced. A supervised learning method via bilevel optimisation is proposed for the…

Analysis of PDEs · Mathematics 2019-03-29 Pan Liu , Carola-Bibiane Schönlieb

In this work, we propose Regularization-by-Equivariance (REV), a novel structure-adaptive regularization scheme for solving imaging inverse problems under incomplete measurements. This regularization scheme utilizes the equivariant…

Optimization and Control · Mathematics 2022-02-15 Junqi Tang

Fitting a matrix of a given rank to data in a least squares sense can be done very effectively using 2nd order methods such as Levenberg-Marquardt by explicitly optimizing over a bilinear parameterization of the matrix. In contrast, when…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 José Pedro Iglesias , Carl Olsson , Marcus Valtonen Örnhag

We propose a novel discrete concept for the total generalized variation (TGV), which has originally been derived to reduce the staircasing effect in classical total variation (TV) regularization, in image denoising problems. We describe…

Numerical Analysis · Mathematics 2022-09-27 Lukas Baumgärtner , Ronny Bergmann , Roland Herzog , Stephan Schmidt , José Vidal-Núñez

In this paper, we are interested in the application to video segmentation of the discrete shape optimization problem involving the shape weighted perimeter and an additional term depending on a parameter. Based on recent works and in…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Florent Ranchin , Antonin Chambolle , Françoise Dibos

We present a new vectorial total variation method that addresses the problem of color consistent image filtering. Our approach is inspired from the double-opponent cell representation in the human visual cortex. Existing methods of…

Computer Vision and Pattern Recognition · Computer Science 2016-05-20 Freddie Åström , Christoph Schnörr

Using weight decay to penalize the L2 norms of weights in neural networks has been a standard training practice to regularize the complexity of networks. In this paper, we show that a family of regularizers, including weight decay, is…

Machine Learning · Computer Science 2022-06-09 Ziquan Liu , Yufei Cui , Antoni B. Chan

This paper is concerned with a novel regularisation technique for solving linear ill-posed operator equations in Hilbert spaces from data that is corrupted by white noise. We combine convex penalty functionals with extreme-value statistics…

Statistics Theory · Mathematics 2012-04-03 Klaus Frick , Philipp Marnitz , Axel Munk

Problems in machine learning (ML) can involve noisy input data, and ML classification methods have reached limiting accuracies when based on standard ML data sets consisting of feature vectors and their classes. Greater accuracy will…

Machine Learning · Statistics 2013-12-31 Yue Fan , Louise Raphael , Mark Kon

In this paper we present a novel iterative procedure for multichannel image and data reconstruction using Bregman distances. With the motivation that multiple channels sharing a common subgradient with respect to a suitable regularization…

Numerical Analysis · Mathematics 2014-12-18 Michael Moeller , Eva-Maria Brinkmann , Martin Burger , Tamara Seybold

Total variation regularization has proven to be a valuable tool in the context of optimal control of differential equations. This is particularly attributed to the observation that TV-penalties often favor piecewise constant minimizers with…

Optimization and Control · Mathematics 2025-10-03 Giacomo Cristinelli , José A. Iglesias , Daniel Walter

The parameter selection is crucial to regularization based image restoration methods. Generally speaking, a spatially fixed parameter for regularization item in the whole image does not perform well for both edge and smooth areas. A larger…

Image and Video Processing · Electrical Eng. & Systems 2021-04-07 Tingting Zhang , Jie Chen , Caiying Wu , Zhifei He , Tieyong Zeng , Qiyu Jin

We propose regularization schemes for deformable registration and efficient algorithms for their numerical approximation. We treat image registration as a variational optimal control problem. The deformation map is parametrized by its…

Optimization and Control · Mathematics 2016-09-09 Andreas Mang , George Biros

The computation of 2-D optical flow by means of regularized pel-recursive algorithms raises a host of issues, which include the treatment of outliers, motion discontinuities and occlusion among other problems. We propose a new approach…

Computer Vision and Pattern Recognition · Computer Science 2016-11-07 Vania V. Estrela , Luis A. Rivera , Paulo C. Beggio , Ricardo T. Lopes

Deep learning models have been successfully used in computer vision and many other fields. We propose an unorthodox algorithm for performing quantization of the model parameters. In contrast with popular quantization schemes based on…

Machine Learning · Computer Science 2018-11-27 Maxim Naumov , Utku Diril , Jongsoo Park , Benjamin Ray , Jedrzej Jablonski , Andrew Tulloch
‹ Prev 1 3 4 5 6 7 10 Next ›