English
Related papers

Related papers: Optimal Estimation of Brownian Penalized Regressio…

200 papers

Shape restrictions on functional regression coefficients such as non-negativity, monotonicity, convexity or concavity are often available in the form of a prior knowledge or required to maintain a structural consistency in functional…

Methodology · Statistics 2022-09-13 Rahul Ghosal , Sujit Ghosh , Jacek Urbanek , Jennifer A. Schrack , Vadim Zipunnikov

Classical functional linear regression models the relationship between a scalar response and a functional covariate, where the coefficient function is assumed to be identical for all subjects. In this paper, the classical model is extended…

Methodology · Statistics 2022-11-29 Yifan Sun , Ziyi Liu , Wu Wang

We propose solution of the problem of the mean square optimal estimation of linear functionals which depend on the unobserved values of a continuous time stochastic process with periodically correlated increments based on observations of…

Statistics Theory · Mathematics 2024-01-18 Maksym Luz , Mikhail Moklyachuk

The Lasso is a very well known penalized regression model, which adds an $L_{1}$ penalty with parameter $\lambda_{1}$ on the coefficients to the squared error loss function. The Fused Lasso extends this model by also putting an $L_{1}$…

Computation · Statistics 2009-10-06 Holger Hoefling

In this paper we present nonparametric estimators for coefficients in stochastic differential equation if the data are described by independent, identically distributed random variables. The problem is formulated as a nonlinear ill-posed…

Computation · Statistics 2015-11-18 Fabian Dunker , Thorsten Hohage

We consider the estimation of the slope function in functional linear regression, where scalar responses are modeled in dependence of random functions. Cardot and Johannes [J. Multivariate Anal. 101 (2010) 395-408] have shown that a…

Statistics Theory · Mathematics 2013-02-19 Fabienne Comte , Jan Johannes

We propose a penalized least-squares method to fit the linear regression model with fitted values that are invariant to invertible linear transformations of the design matrix. This invariance is important, for example, when practitioners…

Methodology · Statistics 2024-10-11 Daeyoung Ham , Adam J. Rothman

Motivated by value function estimation in reinforcement learning, we study statistical linear inverse problems, i.e., problems where the coefficients of a linear system to be solved are observed in noise. We consider penalized estimators,…

Machine Learning · Computer Science 2012-07-03 Bernardo Avila Pires , Csaba Szepesvari

We consider the problem of designing experiments for the comparison of two regression curves describing the relation between a predictor and a response in two groups, where the data between and within the group may be dependent. In order to…

Statistics Theory · Mathematics 2021-01-15 Kirsten Schorning , Holger Dette

We proposed a new penalized method in this paper to solve sparse Poisson Regression problems. Being different from $\ell_1$ penalized log-likelihood estimation, our new method can be viewed as penalized weighted score function method. We…

Statistics Theory · Mathematics 2017-03-14 Jinzhu Jia , Fang Xie , Lihu Xu

We consider the generic regularized optimization problem $\hat{\mathsf{\beta}}(\lambda)=\arg \min_{\beta}L({\sf{y}},X{\sf{\beta}})+\lambda J({\sf{\beta}})$. Efron, Hastie, Johnstone and Tibshirani [Ann. Statist. 32 (2004) 407--499] have…

Statistics Theory · Mathematics 2007-08-22 Saharon Rosset , Ji Zhu

The paper considers functional linear regression, where scalar responses $Y_1,\ldots,Y_n$ are modeled in dependence of i.i.d. random functions $X_1,\ldots,X_n$. We study a generalization of the classical functional linear regression model.…

Statistics Theory · Mathematics 2016-01-13 Alois Kneip , Dominik Poß , Pascal Sarda

We deal with the problem of optimal estimation of the linear functionals constructed from unobserved values of a continuous time stochastic process with periodically correlated increments based on past observations of this process. To solve…

Statistics Theory · Mathematics 2023-04-25 Maksym Luz , Mikhail Moklyachuk

Penalization procedures often suffer from their dependence on multiplying factors, whose optimal values are either unknown or hard to estimate from the data. We propose a completely data-driven calibration algorithm for this parameter in…

Statistics Theory · Mathematics 2010-07-02 Sylvain Arlot , Pascal Massart

We consider the problem of constructing a regression model with a functional predictor and a functional response. We extend the functional linear model to the quadratic model, where the quadratic term also takes the interaction between the…

Methodology · Statistics 2020-06-01 Hidetoshi Matsui

We study additive function-on-function regression where the mean response at a particular time point depends on the time point itself as well as the entire covariate trajectory. We develop a computationally efficient estimation methodology…

Methodology · Statistics 2016-12-15 Janet S. Kim , Ana-Maria Staicu , Arnab Maity , Raymond J. Carroll , David Ruppert

We propose a novel model selection algorithm based on a penalized maximum likelihood estimator (PMLE) for functional hidden dynamic geostatistical models (f-HDGM). These models employ a classic mixed-effect regression structure with…

Methodology · Statistics 2023-10-24 Paolo Maranzano , Philipp Otto , Alessandro Fassò

One of the challenges with functional data is incorporating spatial structure, or local correlation, into the analysis. This structure is inherent in the output from an increasing number of biomedical technologies, and a functional linear…

Applications · Statistics 2011-11-07 Timothy W. Randolph , Jaroslaw Harezlak , Ziding Feng

In general, the solution to a regression problem is the minimizer of a given loss criterion, and depends on the specified loss function. The nonparametric isotonic regression problem is special, in that optimal solutions can be found by…

Statistics Theory · Mathematics 2020-05-06 Alexander I. Jordan , Anja Mühlemann , Johanna F. Ziegel

In this paper several related estimation problems are addressed from a Bayesian point of view and optimal estimators are obtained for each of them when some natural loss functions are considered. Namely, we are interested in estimating a…

Statistics Theory · Mathematics 2021-10-27 A. G. Nogales