English
Related papers

Related papers: Synthesis and analysis in total variation regulari…

200 papers

Synthetic data can improve generalization when real data is scarce, but excessive reliance may introduce distributional mismatches that degrade performance. In this paper, we present a learning-theoretic framework to quantify the trade-off…

Machine Learning · Statistics 2026-04-02 Amitis Shidani , Tyler Farghly , Yang Sun , Habib Ganjgahi , George Deligiannidis

Regularizers help deep neural networks prevent feature co-adaptations. Dropout, as a commonly used regularization technique, stochastically disables neuron activations during network optimization. However, such complete feature disposal can…

Machine Learning · Computer Science 2022-01-25 Tiange Xiang , Chaoyi Zhang , Yang Song , Siqi Liu , Hongliang Yuan , Weidong Cai

Over the last decades, the total variation (TV) evolved to one of the most broadly-used regularisation functionals for inverse problems, in particular for imaging applications. When first introduced as a regulariser, higher-order…

Optimization and Control · Mathematics 2020-12-30 Kristian Bredies , Martin Holler

Unbiased estimators are introduced for averaged Bregman divergences which generalize Stein's Unbiased (Predictive) Risk Estimator, and the minimization of these estimators is proposed as a regularization parameter selection method for…

Numerical Analysis · Mathematics 2021-11-22 Elias S. Helou , Sandra A. Santos , Lucas E. A. Simões

Necessary and sufficient conditions for a finite connected graph with a strict partial order on vertices to be a combinatorial invariant of pseudoharmonic function are obtained.

General Topology · Mathematics 2009-10-20 Yevgen Polulyakh , Iryna Yurchuk

Variance estimation in the linear model when $p > n$ is a difficult problem. Standard least squares estimation techniques do not apply. Several variance estimators have been proposed in the literature, all with accompanying asymptotic…

Methodology · Statistics 2014-01-30 Stephen Reid , Robert Tibshirani , Jerome Friedman

Many iterative methods in optimization are fixed-point iterations with averaged operators. As such methods converge at an $\mathcal{O}(1/k)$ rate with the constant determined by the averagedness coefficient, establishing small averagedness…

Optimization and Control · Mathematics 2020-04-28 Xinmeng Huang , Ernest K. Ryu , Wotao Yin

Some prominent discretisation methods such as finite elements provide a way to approximate a function of $d$ variables from $n$ values it takes on the nodes $x_i$ of the corresponding mesh. The accuracy is $n^{-s_a/d}$ in $L^2$-norm, where…

Numerical Analysis · Mathematics 2024-07-19 Camille Pouchol , Marc Hoffmann

We present an exploration of the rich theoretical connections between several classes of regularized models, network flows, and recent results in submodular function theory. This work unifies key aspects of these problems under a common…

Machine Learning · Statistics 2013-12-09 Hoyt Koepke , Marina Meila

We study Schr\"odinger operators on compact finite metric graphs subject to $\delta$-coupling and standard boundary conditions. We compare the $n$-th eigenvalues of those self-adjoint realizations and derive an asymptotic result for the…

Mathematical Physics · Physics 2023-09-06 Patrizio Bifulco , Joachim Kerner

This article carries out a large dimensional analysis of standard regularized discriminant analysis classifiers designed on the assumption that data arise from a Gaussian mixture model with different means and covariances. The analysis…

Machine Learning · Statistics 2019-06-19 Khalil Elkhalil , Abla Kammoun , Romain Couillet , Tareq Y. Al-Naffouri , Mohamed-Slim Alouini

The paper concerns the second-order generalized differentiation theory of variational analysis and new applications of this theory to some problems of constrained optimization in finitedimensional spaces. The main attention is paid to the…

Optimization and Control · Mathematics 2011-10-21 B. S. Mordukhovich , R. T. Rockafellar

Quantification, i.e., the task of training predictors of the class prevalence values in sets of unlabeled data items, has received increased attention in recent years. However, most quantification research has concentrated on developing…

Machine Learning · Computer Science 2023-10-16 Mirko Bunse , Alejandro Moreo , Fabrizio Sebastiani , Martin Senz

We consider whether minimizers for total variation regularization of linear inverse problems belong to $L^\infty$ even if the measured data does not. We present a simple proof of boundedness of the minimizer for fixed regularization…

Optimization and Control · Mathematics 2023-06-28 Kristian Bredies , José A. Iglesias , Gwenael Mercier

We study the design of graph filters to implement arbitrary linear transformations between graph signals. Graph filters can be represented by matrix polynomials of the graph-shift operator, which captures the structure of the graph and is…

Information Theory · Computer Science 2017-05-23 Santiago Segarra , Antonio G. Marques , Alejandro Ribeiro

We study synthesis of reactive systems interacting with environments using an infinite data domain. A popular formalism for specifying and modelling such systems is register automata and transducers. They extend finite-state automata by…

Formal Languages and Automata Theory · Computer Science 2022-05-23 Léo Exibard , Emmanuel Filiot , Ayrat Khalimov

We study the solutions of infinite dimensional linear inverse problems over Banach spaces. The regularizer is defined as the total variation of a linear mapping of the function to recover, while the data fitting term is a near arbitrary…

Optimization and Control · Mathematics 2017-11-03 Axel Flinth , Pierre Weiss

Ideas and results of the generalized wave operator theory for dynamical and stationary cases are developed further and exact expressions for generalized scattering operators are obtained for wide classes of differential equations. New…

Mathematical Physics · Physics 2016-02-24 Lev Sakhnovich

A novel class of semi-norms, generalising the notion of the isotropic total variation $TV_{2}$ and the an-isotropic total variation $TV_{1}$ is introduced. A supervised learning method via bilevel optimisation is proposed for the…

Analysis of PDEs · Mathematics 2019-03-29 Pan Liu , Carola-Bibiane Schönlieb

This paper investigates the use of regularization priors in the context of treatment effect estimation using observational data where the number of control variables is large relative to the number of observations. First, the phenomenon of…

Methodology · Statistics 2016-12-30 P. Richard Hahn , Carlos M. Carvalho , Jingyu He , David Puelz