English
Related papers

Related papers: Optimal Estimation of Brownian Penalized Regressio…

200 papers

In this paper we present new theoretical results on optimal estimation of certain random quantities based on high frequency observations of a L\'evy process. More specifically, we investigate the asymptotic theory for the conditional mean…

Probability · Mathematics 2020-01-09 Jevgenijs Ivanovs , Mark Podolskij

Many real-world functions are defined over both categorical and category-specific continuous variables and thus cannot be optimized by traditional Bayesian optimization (BO) methods. To optimize such functions, we propose a new method that…

Machine Learning · Computer Science 2019-12-02 Dang Nguyen , Sunil Gupta , Santu Rana , Alistair Shilton , Svetha Venkatesh

This paper discusses a nonparametric regression model that naturally generalizes neural network models. The model is based on a finite number of one-dimensional transformations and can be estimated with a one-dimensional rate of…

Statistics Theory · Mathematics 2008-12-18 Joel L. Horowitz , Enno Mammen

The problem of optimal linear estimation of a linear functional depending on the unknown values of periodically correlated stochastic process from observations of the process with additive noise is considered. Formulas for calculating the…

Statistics Theory · Mathematics 2025-11-20 Iryna Dubovets'ka , Mykhailo Moklyachuk

Penalized smoothing is a standard tool in regression analysis. Classical approaches often rely on basis or kernel expansions, which constrain the estimator to a fixed span and impose smoothness assumptions that may be restrictive for…

Statistics Theory · Mathematics 2026-01-19 Marc Vidal , Yves Rosseel

In the realm of large-scale spatiotemporal data, abrupt changes are commonly occurring across both spatial and temporal domains. This study aims to address the concurrent challenges of detecting change points and identifying spatial…

Methodology · Statistics 2025-05-05 Zerui Zhang , Xin Wang , Xin Zhang , Jing Zhang

This study examines the optimal selections of bandwidth and semi-metric for a functional partial linear model. Our proposed method begins by estimating the unknown error density using a kernel density estimator of residuals, where the…

Methodology · Statistics 2020-11-17 Han Lin Shang

In this paper we study nonconvex penalization using Bernstein functions whose first-order derivatives are completely monotone. The Bernstein function can induce a class of nonconvex penalty functions for high-dimensional sparse estimation…

Machine Learning · Statistics 2015-10-30 Zhihua Zhang

In this paper we consider the conditional stochastic optimization (CSO) problem. This consists of optimizing a function which can be written as the expectation of a function which is itself a function of a conditional expectation, i.e.~of…

Optimization and Control · Mathematics 2026-05-20 Miguel Alvarez , Ajay Jasra

We consider PDE constrained nonparametric regression problems in which the parameter $f$ is the unknown coefficient function of a second order elliptic partial differential operator $L_f$, and the unique solution $u_f$ of the boundary value…

Statistics Theory · Mathematics 2019-12-20 Richard Nickl , Sara van de Geer , Sven Wang

This paper studies optimal estimation of large-dimensional nonlinear factor models. The key challenge is that the observed variables are possibly nonlinear functions of some latent variables where the functional forms are left unspecified.…

Statistics Theory · Mathematics 2023-11-14 Yingjie Feng

This paper studies macroeconomic forecasting and variable selection using a folded-concave penalized regression with a very large number of predictors. The penalized regression approach leads to sparse estimates of the regression…

Applications · Statistics 2017-03-07 Yoshimasa Uematsu , Shinya Tanaka

Complementing existing results on minimal ruin probabilities, we minimize expected discounted penalty functions (or Gerber-Shiu functions) in a Cramer-Lundberg model by choosing optimal reinsurance. Reinsurance strategies are modelled as…

Optimization and Control · Mathematics 2018-09-10 Michael Preischl , Stefan Thonhauser

We study regression using functional predictors in situations where these functions contain both phase and amplitude variability. In other words, the functions are misaligned due to errors in time measurements, and these errors can…

Applications · Statistics 2019-04-26 J. Derek Tucker , John Lewis , Anuj Srivastava

We propose an approach to better inform treatment decisions at an individual level by adapting recent advances in average treatment effect estimation to conditional average treatment effect estimation. Our work is based on doubly robust…

Methodology · Statistics 2023-06-13 Aaron Fisher , Virginia Fisher

We study the problem of parameter estimation for reflected stochastic processes driven by a standard Brownian motion. The estimator is obtained using nonlinear least squares method based on discretely observed processes. Under some certain…

Statistics Theory · Mathematics 2022-05-03 Han Yuecai , Zhang Dingwen

We propose a bivariate quantile regression method for the bivariate varying coefficient model through a directional approach. The varying coefficients are approximated by the B-spline basis and an $L_{2}$ type penalty is imposed to achieve…

Methodology · Statistics 2015-11-10 Linglong Kong , Haoxu Shu , Giseon Heo , Qianchuan Chad He

Function-on-function linear regression is important for understanding the relationship between the response and the predictor that are both functions. In this article, we propose a reproducing kernel Hilbert space approach to…

Statistics Theory · Mathematics 2021-09-29 Holger Dette , Jiajun Tang

We propose a two-stage penalized least squares method to build large systems of structural equations based on the instrumental variables view of the classical two-stage least squares method. We show that, with large numbers of endogenous…

Methodology · Statistics 2018-07-31 Chen Chen , Min Ren , Min Zhang , Dabao Zhang

In this paper, we consider the nonparametric regression problem with multivariate predictors. We provide a characterization of the degrees of freedom and divergence for estimators of the unknown regression function, which are obtained as…

Statistics Theory · Mathematics 2018-10-09 Xi Chen , Qihang Lin , Bodhisattva Sen