English
Related papers

Related papers: Robust estimation of parameters in logistic regres…

200 papers

Nonparametric methods are widely applicable to statistical inference problems, since they rely on a few modeling assumptions. In this context, the fresh look advocated here permeates benefits from variable selection and compressive…

Machine Learning · Statistics 2015-03-19 Gonzalo Mateos , Georgios B. Giannakis

We construct a novel estimator for the diffusion coefficient of the limiting homogenized equation, when observing the slow dynamics of a multiscale model, in the case when the slow dynamics are of bounded variation. Previous research…

Statistics Theory · Mathematics 2018-07-04 Theodoros Manikas , Anastasia Papavasiliou

We study the problem of estimating an unknown deterministic signal that is observed through an unknown deterministic data matrix under additive noise. In particular, we present a minimax optimization framework to the least squares problems,…

Systems and Control · Computer Science 2014-04-28 N. Denizcan Vanli , Mehmet A. Donmez , Suleyman S. Kozat

This paper investigates a new approach to estimate the gradient of the conditional probability given the covariates in the binary classification framework. The proposed approach consists in fitting a localized nearest-neighbor logistic…

Statistics Theory · Mathematics 2025-01-20 Touqeer Ahmad , François Portier , Gilles Stupfler

We consider a class of systems with time-varying parameters, which are written as linear regressions with bounded disturbances. The task is to estimate such parameters under the condition that the regressor is finitely exciting (FE).…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Anton Glushchenko , Konstantin Lastochkin

Estimation of the four generalized lambda distribution parameters is not straightforward, and available estimators that perform best have large computation times. In this paper, we introduce a simple two-step estimator of the parameters…

Methodology · Statistics 2020-02-26 Dilanka S. Dedduwakumara , Luke A. Prendergast , Robert G. Staudte

Logistic regression is a common classification method in supervised learning. Surprisingly, there are very few solutions for performing logistic regression with missing values in the covariates. We suggest a complete approach based on a…

Methodology · Statistics 2019-08-09 Wei Jiang , Julie Josse , Marc Lavielle , TraumaBase Group

Increasing effort is put into the development of methods for learning mechanistic models from data. This task entails not only the accurate estimation of parameters but also a suitable model structure. Recent work on the discovery of…

Machine Learning · Computer Science 2024-07-01 Justin N. Kreikemeyer , Philipp Andelfinger , Adelinde M. Uhrmacher

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Estimating location is a central problem in functional data analysis, yet most current estimation procedures either unrealistically assume completely observed trajectories or lack robustness with respect to the many kinds of anomalies one…

Methodology · Statistics 2022-03-24 Ioannis Kalogridis , Stefan Van Aelst

Biased stochastic estimators, such as finite-differences for noisy gradient estimation, often contain parameters that need to be properly chosen to balance impacts from the bias and the variance. While the optimal order of these parameters…

Methodology · Statistics 2019-02-14 Henry Lam , Xinyu Zhang , Xuhui Zhang

A nonparametric and locally adaptive Bayesian estimator is proposed for estimating a binary regression. Flexibility is obtained by modeling the binary regression as a mixture of probit regressions with the argument of each probit regression…

Methodology · Statistics 2007-09-25 Sally Wood , Robert Kohn , Remy Cottet , Wenxin Jiang , Martin Tanner

Big data is ubiquitous in practices, and it has also led to heavy computation burden. To reduce the calculation cost and ensure the effectiveness of parameter estimators, an optimal subset sampling method is proposed to estimate the…

Methodology · Statistics 2023-11-16 Haohui Han , Liya Fu

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. This problem is magnified in high-dimensional settings where the number of variables $p$ diverges with the sample size $n$, as well…

Statistics Theory · Mathematics 2020-02-21 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

A robust estimator is proposed for the parameters that characterize the linear regression problem. It is based on the notion of shrinkages, often used in Finance and previously studied for outlier detection in multivariate data. A thorough…

Methodology · Statistics 2020-02-07 Elisa Cabana , Rosa E. Lillo , Henry Laniado

In this paper, we propose a new semiparametric regression estimator by using a hybrid technique of a parametric approach and a nonparametric penalized spline method. The overall shape of the true regression function is captured by the…

Statistics Theory · Mathematics 2012-02-17 Takuma Yoshida , Kanta Naito

This paper presents a novel method to make statistical inferences for both the model support and regression coefficients in a high-dimensional logistic regression model. Our method is based on the repro samples framework, in which we…

Methodology · Statistics 2024-03-18 Xiaotian Hou , Linjun Zhang , Peng Wang , Min-ge Xie

In order to overcome multicollinearity, we propose a stochastic restricted Liu-type max- imum likelihood estimator by incorporating Liu-type maximum likelihood estimator (Inan and Erdo- gan, 2013) to the logistic regression model when the…

Methodology · Statistics 2017-10-09 Jibo Wu , Yasin Asar

In this study, we propose a mixture logistic regression model with a Markov structure, and consider the estimation of model parameters using maximum likelihood estimation. We also provide a forward type variable selection algorithm to…

Methodology · Statistics 2025-08-28 Yu-Hsiang Cheng , Tzee-Ming Huang

Reparameterization (RP) and likelihood ratio (LR) gradient estimators are used to estimate gradients of expectations throughout machine learning and reinforcement learning; however, they are usually explained as simple mathematical tricks,…

Machine Learning · Computer Science 2021-06-01 Paavo Parmas , Masashi Sugiyama