English
Related papers

Related papers: Hybrid Regularisation of Functional Linear Models

200 papers

We consider the problem of estimating the autocorrelation operator of an autoregressive Hilbertian process. By means of a Tikhonov approach, we establish a general result that yields the convergence rate of the estimated autocorrelation…

Statistics Theory · Mathematics 2022-06-09 Alessia Caponera , Victor M. Panaretos

The advantages and difficulties of application of Pad\'e approximants to two-dimensional regression analysis are discussed. New formulation of residuals is suggested in the method of least squares. It leads to a system of linear equations…

Methodology · Statistics 2022-08-23 Glib Yevkin , Olexandr Yevkin

This paper proposes a novel graph-based regularized regression estimator - the hierarchical feature regression (HFR) -, which mobilizes insights from the domains of machine learning and graph theory to estimate robust parameters for a…

Machine Learning · Statistics 2022-01-11 Johann Pfitzinger

In this paper we consider the linear regression model $Y =S X+\varepsilon $ with functional regressors and responses. We develop new inference tools to quantify deviations of the true slope $S$ from a hypothesized operator $S_0$ with…

Statistics Theory · Mathematics 2021-08-17 Tim Kutta , Gauthier Dierickx , Holger Dette

This paper provides a new regularization method which is particularly suitable for linear exponentially ill-posed problems. Under logarithmic source conditions (which have a natural interpretation in terms of Sobolev spaces in the…

Numerical Analysis · Mathematics 2020-07-08 Walter Cedric Simo Tao Lee

This paper explores the incorporation of Tikhonov regularization into the least squares approximation scheme using trigonometric polynomials on the unit circle. This approach encompasses interpolation and hyperinterpolation as specific…

Numerical Analysis · Mathematics 2025-05-26 Congpei An , Mou Cai

Linear regression is arguably the most fundamental statistical model; however, the validity of its use in randomized clinical trials, despite being common practice, has never been crystal clear, particularly when stratified or…

Methodology · Statistics 2023-02-14 Wei Ma , Fuyi Tu , Hanzhong Liu

We introduce a new model of linear regression for random functional inputs taking into account the first order derivative of the data. We propose an estimation method which comes down to solving a special linear inverse problem. Our…

Statistics Theory · Mathematics 2016-08-16 André Mas , Besnik Pumo

Many inverse problems can be described by a PDE model with unknown parameters that need to be calibrated based on measurements related to its solution. This can be seen as a constrained minimization problem where one wishes to minimize the…

Numerical Analysis · Mathematics 2018-09-06 Nick Schenkels , Wim Vanroose

Random feature approximation is arguably one of the most widely used techniques for kernel methods in large-scale learning algorithms. In this work, we analyze the generalization properties of random feature methods, extending previous…

Machine Learning · Statistics 2025-06-23 Mike Nguyen , Nicole Mücke

In this paper, we study the estimation of partially linear models for spatial data distributed over complex domains. We use bivariate splines over triangulations to represent the nonparametric component on an irregular two-dimensional…

Statistics Theory · Mathematics 2021-06-03 Li Wang , Guannan Wang , Min-Jun Lai , Lei Gao

The Tikhonov-Phillips method is widely used for regularizing ill-posed inverse problems mainly due to the simplicity of its formulation as an optimization problem. The use of different penalizers in the functionals associated to the…

Functional Analysis · Mathematics 2011-08-23 Gisela L. Mazzieri , Ruben D. Spies , Karina G. Temperini

We consider the stable approximation of sparse solutions to non-linear operator equations by means of Tikhonov regularization with a subquadratic penalty term. Imposing certain assumptions, which for a linear operator are equivalent to the…

Functional Analysis · Mathematics 2009-12-06 Markus Grasmair , Markus Haltmeier , Otmar Scherzer

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

In this paper, we consider a functional linear regression model, where both the covariate and the response variable are functional random variables. We address the problem of optimal nonparametric estimation of the conditional expectation…

Statistics Theory · Mathematics 2022-03-02 Gaëlle Chagny , Anouar Meynaoui , Angelina Roche

We study the semiparametric efficient estimation of a class of linear functionals in settings where a complete multivariate dataset is supplemented by additional datasets recording subsets of the variables of interest. These datasets are…

Statistics Theory · Mathematics 2025-06-19 Thomas B. Berrett

The aim of this article is to overview the problem of mean square optimal estimation of linear functionals which depend on unknown values of periodically correlated stochastic process. Estimates are based on observations of this process and…

Statistics Theory · Mathematics 2025-11-24 Iryna Dubovets'ka , Mykhailo Moklyachuk

Recurrent stochastic configuration networks (RSCNs) have shown great potential in modelling nonlinear dynamic systems with uncertainties. This paper presents an RSCN with hybrid regularization to enhance both the learning capacity and…

Machine Learning · Computer Science 2024-12-03 Gang Dang , Dianhui Wang

This paper deals with a Tikhonov regularized second-order plus first-order primal-dual dynamical system with time scaling for separable convex optimization problems with linear equality constraints. This system consists of two second-order…

Optimization and Control · Mathematics 2025-10-29 Xiangkai Sun , Lijuan Zheng , Kok Lay Teo

In a Hilbert space, we propose a class of general mixed-order primal-dual dynamical systems with Tikhonov regularization for a convex optimization problem with linear equality constraints. The proposed dynamical system is characterized by…

Optimization and Control · Mathematics 2025-07-31 Honglu Li , Rong Hu , Xin He , Yibin Xiao