English

Ridge regression with adaptive additive rectangles and other piecewise functional templates

Methodology 2020-11-03 v1 Machine Learning Machine Learning

Abstract

We propose an L2L_{2}-based penalization algorithm for functional linear regression models, where the coefficient function is shrunk towards a data-driven shape template γ\gamma, which is constrained to belong to a class of piecewise functions by restricting its basis expansion. In particular, we focus on the case where γ\gamma can be expressed as a sum of qq rectangles that are adaptively positioned with respect to the regression error. As the problem of finding the optimal knot placement of a piecewise function is nonconvex, the proposed parametrization allows to reduce the number of variables in the global optimization scheme, resulting in a fitting algorithm that alternates between approximating a suitable template and solving a convex ridge-like problem. The predictive power and interpretability of our method is shown on multiple simulations and two real world case studies.

Keywords

Cite

@article{arxiv.2011.01048,
  title  = {Ridge regression with adaptive additive rectangles and other piecewise functional templates},
  author = {Edoardo Belli and Simone Vantini},
  journal= {arXiv preprint arXiv:2011.01048},
  year   = {2020}
}
R2 v1 2026-06-23T19:51:05.501Z