English
Related papers

Related papers: Higher Order Estimating Equations for High-dimensi…

200 papers

When the response mechanism is believed to be not missing at random (NMAR), a valid analysis requires stronger assumptions on the response mechanism than standard statistical methods would otherwise require. Semiparametric estimators have…

Methodology · Statistics 2020-05-08 Kosuke Morikawa , Jae Kwang Kim

We examine nonlinear dynamical systems of ordinary differential equations or differential algebraic equations. In an uncertainty quantification, physical parameters are replaced by random variables. The inner variables as well as a quantity…

Numerical Analysis · Mathematics 2019-04-15 Roland Pulch

We consider the problem of parameter estimation for a system of ordinary differential equations from noisy observations on a solution of the system. In case the system is nonlinear, as it typically is in practical applications, an analytic…

Statistics Theory · Mathematics 2012-07-27 Shota Gugushvili , Chris A. J. Klaassen

We study a linear high-dimensional regression model in a semi-supervised setting, where for many observations only the vector of covariates $X$ is given with no response $Y$. We do not make any sparsity assumptions on the vector of…

Statistics Theory · Mathematics 2021-09-03 Ilan Livne , David Azriel , Yair Goldberg

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. For example, the maximum likelihood estimator has a bias that can result in a significant inferential loss. This problem is…

Statistics Theory · Mathematics 2019-11-04 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

Despite the risk of misspecification they are tied to, parametric models continue to be used in statistical practice because they are accessible to all. In particular, efficient estimation procedures in parametric models are simple to…

Statistics Theory · Mathematics 2016-09-01 Marco Carone , Alexander R. Luedtke , Mark J. van der Laan

We present alphaPDE, a new multivariate analysis technique for parameter estimation. The method is based on a direct construction of joint probability densities of known variables and the parameters to be estimated. We show how posterior…

Data Analysis, Statistics and Probability · Physics 2009-11-07 B. Knuteson , H. Miettinen , L. Holmstrom

This paper aims at providing a fresh look at semiparametric estimation theory and, in particular, at the Semiparametric Cram\'{e}r-Rao Bound (SCRB). Semiparametric models are characterized by a finite-dimensional parameter vector of…

Signal Processing · Electrical Eng. & Systems 2018-03-02 Stefano Fortunati , Fulvio Gini , Maria S. Greco , Abdelhak M. Zoubir , Muralidhar Rangaswamy

This thesis responds to the challenges of using a large number, such as thousands, of features in regression and classification problems. There are two situations where such high dimensional features arise. One is when high dimensional…

Machine Learning · Statistics 2007-09-20 Longhai Li

A model for cross-over designs with repeated measures within each period was developed. It is obtained using an extension of generalized estimating equations that includes a parametric component to model treatment effects and a…

Methodology · Statistics 2023-03-21 N. A. Cruz , O. O. Melo , C. A. Martinez

We consider the problem of asymptotic reconstruction of the state and parameter values in systems of ordinary differential equations. A solution to this problem is proposed for a class of systems of which the unknowns are allowed to be…

Optimization and Control · Mathematics 2015-03-13 Ivan Y. Tyukin , Erik Steur , Henk Nijmeijer , Cees van Leeuwen

We consider change-point estimation in a sequence of high-dimensional signals given noisy observations. Classical approaches to this problem such as the filtered derivative method are useful for sequences of scalar-valued signals, but they…

Statistics Theory · Mathematics 2015-01-08 Yong Sheng Soh , Venkat Chandrasekaran

Suppose data are fitted to some parametric model but that the true model happens to be one with an additional parameter. When a parameter is to be estimated one can use likelihood estimation in the wider model or in the narrow model.…

Methodology · Statistics 2026-03-27 Nils Lid Hjort

We propose a self-tuning $\sqrt{\mathrm {Lasso}}$ method that simultaneously resolves three important practical problems in high-dimensional regression analysis, namely it handles the unknown scale, heteroscedasticity and (drastic)…

Methodology · Statistics 2014-05-27 Alexandre Belloni , Victor Chernozhukov , Lie Wang

We propose a transfer learning method that utilizes data representations in a semiparametric regression model. Our aim is to perform statistical inference on the parameter of primary interest in the target model while accounting for…

Methodology · Statistics 2024-06-21 Baihua He , Huihang Liu , Xinyu Zhang , Jian Huang

Consider a semiparametric model with a Euclidean parameter and an infinite-dimensional parameter, to be called a Banach parameter. Assume: (a) There exists an efficient estimator of the Euclidean parameter. (b) When the value of the…

Statistics Theory · Mathematics 2007-06-13 Chris A. J. Klaassen , Hein Putter

Higher-Order Influence Functions (HOIFs) provide a unified theory for constructing rate-optimal estimators for a large class of low-dimensional (smooth) statistical functionals/parameters (and sometimes even infinite-dimensional functions)…

Statistics Theory · Mathematics 2023-02-17 Lin Liu , Chang Li

A popular technique for selecting and tuning machine learning estimators is cross-validation. Cross-validation evaluates overall model fit, usually in terms of predictive accuracy. In causal inference, the optimal choice of estimator…

Methodology · Statistics 2021-07-07 Dominik Rothenhäusler

We study the problem of estimating the coefficients in linear ordinary differential equations (ODE's) with a diverging number of variables when the solutions are observed with noise. The solution trajectories are first smoothed with local…

Statistics Theory · Mathematics 2008-04-29 Heng Lian

We mainly study the M-estimation method for the high-dimensional linear regression model, and discuss the properties of M-estimator when the penalty term is the local linear approximation. In fact, M-estimation method is a framework, which…

Probability · Mathematics 2018-10-31 Kai Wang , Yanling Zhu