English
Related papers

Related papers: Statistical Learnability of Generalized Additive M…

200 papers

Given a finite set of real numbers $A$, the generalised golden ratio is the unique real number $\mathcal{G}(A) > 1$ for which we only have trivial unique expansions in smaller bases, and have non-trivial unique expansions in larger bases.…

Number Theory · Mathematics 2016-09-12 Simon Baker , Wolfgang Steiner

While Total Variation (TV) excels in noise reduction and edge preservation, its reliance on a scalar regularization parameter limits adaptivity. In this study, we present a Learnable Total Variation (LTV) framework coupling an unrolled TV…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yusuf Talha Basak , Mehmet Ozan Unal , Metin Ertas , Isa Yildirim

Generalized additive index models (GAIMs) offer a flexible semiparametric framework for capturing complex data relationships, balancing the interpretability of parametric models with the flexibility of nonparametric approaches. However,…

Methodology · Statistics 2026-05-29 Ziyu Peng , Linglingzhi Zhu , Yao Xie

Understanding and certifying the generalization performance of machine learning algorithms -- i.e. obtaining theoretical estimates of the test error from the training error -- is a central theme of statistical learning theory. Among the…

Machine Learning · Computer Science 2026-05-26 Sho Sonoda , Kazumi Kasaura , Yuma Mizuno , Kei Tsukamoto , Naoto Onda

We consider the total variation (TV) minimization problem used for compressive sensing and solve it using the generalized alternating projection (GAP) algorithm. Extensive results demonstrate the high performance of proposed algorithm on…

Information Theory · Computer Science 2015-11-13 Xin Yuan

In this paper, we consider a model called CHARME (Conditional Heteroscedastic Autoregressive Mixture of Experts), a class of generalized mixture of nonlinear nonparametric AR-ARCH time series. Under certain Lipschitz-type conditions on the…

Machine Learning · Statistics 2020-11-18 José G. Gómez García , Jalal Fadili , Christophe Chesneau

Diverse inverse problems in imaging can be cast as variational problems composed of a task-specific data fidelity term and a regularization term. In this paper, we propose a novel learnable general-purpose regularizer exploiting recent…

Optimization and Control · Mathematics 2020-02-19 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

This study presents the development of a spatially adaptive weighting strategy for Total Variation regularization, aimed at addressing under-determined linear inverse problems. The method leverages the rapid computation of an accurate…

Numerical Analysis · Mathematics 2025-01-20 Elena Morotti , Davide Evangelista , Andrea Sebastiani , Elena Loli Piccolomini

An earlier introduced characterization of nonuniform learnability that allows the sample size to depend on the hypothesis to which the learner is compared has been redefined using the measure theoretic approach. Where nonuniform…

Machine Learning · Computer Science 2020-11-03 Ankit Bandyopadhyay

Neural network approaches have been demonstrated to work quite well to solve partial differential equations in practice. In this context approaches like physics-informed neural networks and the Deep Ritz method have become popular. In this…

Numerical Analysis · Mathematics 2025-09-12 Andreas Langer , Sara Behnamian

Many fundamental machine learning tasks can be formulated as a problem of learning with vector-valued functions, where we learn multiple scalar-valued functions together. Although there is some generalization analysis on different specific…

Machine Learning · Computer Science 2021-04-30 Liang Wu , Antoine Ledent , Yunwen Lei , Marius Kloft

The generalized perturbative approach is an all purpose variant of Stein's method used to obtain rates of normal approximation. Originally developed for functions of independent random variables this method is here extended to functions of…

Probability · Mathematics 2020-10-12 Christian Houdré , George Kerchev

Recently, learning algorithms motivated from sharpness of loss surface as an effective measure of generalization gap have shown state-of-the-art performances. Nevertheless, sharpness defined in a rigid region with a fixed radius, has a…

Machine Learning · Computer Science 2021-06-30 Jungmin Kwon , Jeongseop Kim , Hyunseo Park , In Kwon Choi

We introduce a general framework for the reconstruction of periodic multivariate functions from finitely many and possibly noisy linear measurements. The reconstruction task is formulated as a penalized convex optimization problem, taking…

Optimization and Control · Mathematics 2020-12-02 Julien Fageot , Matthieu Simeoni

We present an extension of the cut-pursuit algorithm, introduced by Landrieu and Obozinski (2017), to the graph total-variation regularization of functions with a separable nondifferentiable part. We propose a modified algorithmic scheme as…

Optimization and Control · Mathematics 2018-05-22 Hugo Raguet , Loïc Landrieu

A function $f: \mathbb{R}^d \rightarrow \mathbb{R}$ is referred to as a Sparse Additive Model (SPAM), if it is of the form $f(\mathbf{x}) = \sum_{l \in \mathcal{S}}\phi_{l}(x_l)$, where $\mathcal{S} \subset [d]$, $|\mathcal{S}| \ll d$.…

Machine Learning · Computer Science 2016-04-20 Hemant Tyagi , Anastasios Kyrillidis , Bernd Gärtner , Andreas Krause

We present a unified approach to compute the total vertex irregularity strength (tvs) of various graphs, employing a novel technique recently proposed by Barra et al. For graphs such as cycles, paths, prisms, wheels, complete graphs, helm…

Combinatorics · Mathematics 2025-06-24 Aleams Barra

There are proposals that extend the classical generalized additive models (GAMs) to accommodate high-dimensional data ($p>>n$) using group sparse regularization. However, the sparse regularization may induce excess shrinkage when estimating…

Methodology · Statistics 2022-07-07 Boyi Guo , Byron C. Jaeger , A. K. M. Fazlur Rahman , D. Leann Long , Nengjun Yi

The general regularisation scheme, a versatile approach for nonparametric estimation, has been successfully applied to regression, density ratio, and score estimation. In this paper, we introduce a unified framework encompassing these…

Statistics Theory · Mathematics 2026-05-12 Gilles Germain

Generalized Additive Models (GAMs) have quickly become the leading choice for inherently-interpretable machine learning. However, unlike uninterpretable methods such as DNNs, they lack expressive power and easy scalability, and are hence…

Machine Learning · Computer Science 2022-10-20 Abhimanyu Dubey , Filip Radenovic , Dhruv Mahajan