English
Related papers

Related papers: Regularization Graphs -- A unified framework for v…

200 papers

This work introduces Bilinear Classes, a new structural framework, which permit generalization in reinforcement learning in a wide variety of settings through the use of function approximation. The framework incorporates nearly all existing…

Machine Learning · Computer Science 2021-07-13 Simon S. Du , Sham M. Kakade , Jason D. Lee , Shachar Lovett , Gaurav Mahajan , Wen Sun , Ruosong Wang

We present the SCR framework for enhancing the training of graph neural networks (GNNs) with consistency regularization. Regularization is a set of strategies used in Machine Learning to reduce overfitting and improve the generalization…

Social and Information Networks · Computer Science 2022-06-14 Chenhui Zhang , Yufei He , Yukuo Cen , Zhenyu Hou , Wenzheng Feng , Yuxiao Dong , Xu Cheng , Hongyun Cai , Feng He , Jie Tang

A common challenge in regression is that for many problems, the degrees of freedom required for a high-quality solution also allows for overfitting. Regularization is a class of strategies that seek to restrict the range of possible…

Machine Learning · Computer Science 2022-11-15 Colin Ponce , Ruipeng Li , Christina Mao , Panayot Vassilevski

Unsupervised and self-supervised learning approaches have become a crucial tool to learn representations for downstream prediction tasks. While these approaches are widely used in practice and achieve impressive empirical gains, their…

Machine Learning · Computer Science 2020-10-23 Siddhant Garg , Yingyu Liang

We introduce an algorithm to solve linear inverse problems regularized with the total (gradient) variation in a gridless manner. Contrary to most existing methods, that produce an approximate solution which is piecewise constant on a fixed…

Signal Processing · Electrical Eng. & Systems 2025-07-08 Yohann de Castro , Vincent Duval , Romain Petit

Many problems can be presented in an abstract form through a wide range of binary objects and relations which are defined over problem domain. In these problems, graphical demonstration of defined binary objects and solutions is the most…

Graphics · Computer Science 2016-03-24 Mohammadreza Ashouri , Ali Golshani , Dara Moazzmi , Mandana Ghasemi

The common graph Laplacian regularizer is well-established in semi-supervised learning and spectral dimensionality reduction. However, as a first-order regularizer, it can lead to degenerate functions in high-dimensional manifolds. The…

Computer Vision and Pattern Recognition · Computer Science 2016-02-12 Kwang In Kim , James Tompkin , Hanspeter Pfister , Christian Theobalt

The authors discuss how general regularization schemes, in particular linear regularization schemes and projection schemes, can be used to design tests for signal detection in statistical inverse problems. It is shown that such tests can…

Statistics Theory · Mathematics 2013-04-04 Clément Marteau , Peter Mathé

While there are many studies on weight regularization, the study on structure regularization is rare. Many existing systems on structured prediction focus on increasing the level of structural dependencies within the model. However, this…

Machine Learning · Computer Science 2015-02-02 Xu Sun

Purpose: This work aims at developing a generalizable MRI reconstruction model in the meta-learning framework. The standard benchmarks in meta-learning are challenged by learning on diverse task distributions. The proposed network learns…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Wanyu Bian , Yunmei Chen , Xiaojing Ye , Qingchao Zhang

Learning maps between data samples is fundamental. Applications range from representation learning, image translation and generative modeling, to the estimation of spatial deformations. Such maps relate feature vectors, or map between…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Hastings Greer , Roland Kwitt , Francois-Xavier Vialard , Marc Niethammer

Regularisation allows one to handle ill-posed inverse problems. Here we focus on discrete unfolding problems. The properties of the results are characterised by the consistency between measurements and unfolding result and by the posterior…

Data Analysis, Statistics and Probability · Physics 2023-09-07 Michael Schmelling

The need to blend observational data and mathematical models arises in many applications and leads naturally to inverse problems. Parameters appearing in the model, such as constitutive tensors, initial conditions, boundary conditions, and…

Statistics Theory · Mathematics 2010-09-16 J. Nolen , G. A. Pavliotis , A. M. Stuart

This paper is concerned with the development, analysis and numerical realization of a novel variational model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative…

Optimization and Control · Mathematics 2021-11-10 Andreas Habring , Martin Holler

By the recent advances in computer technology leading to the invention of more powerful processors, the importance of creating models using data training is even greater than ever. Given the significance of this issue, this work tries to…

Optimization and Control · Mathematics 2023-12-27 Saman Khoramian

Inverse problems are key issues in several scientific areas, including signal processing and medical imaging. Data-driven approaches for inverse problems aim for learning model and regularization parameters from observed data samples, and…

Optimization and Control · Mathematics 2024-11-28 Mathias Staudigl , Simon Weissmann , Tristan van Leeuwen

We propose a new type of regularization functional for images called oscillation total generalized variation (TGV) which can represent structured textures with oscillatory character in a specified direction and scale. The infimal…

Numerical Analysis · Mathematics 2018-09-17 Yiming Gao , Kristian Bredies

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

Many imaging problems require solving an inverse problem that is ill-conditioned or ill-posed. Imaging methods typically address this difficulty by regularising the estimation problem to make it well-posed. This often requires setting the…

Methodology · Statistics 2020-08-17 Ana F. Vidal , Valentin De Bortoli , Marcelo Pereyra , Alain Durmus

We study linear inverse problems under the premise that the forward operator is not at hand but given indirectly through some input-output training pairs. We demonstrate that regularization by projection and variational regularization can…

Numerical Analysis · Mathematics 2020-12-30 Andrea Aspri , Yury Korolev , Otmar Scherzer