English
Related papers

Related papers: Balancing Flexibility and Interpretability: A Cond…

200 papers

Over the past decades, classification models have proven to be essential machine learning tools given their potential and applicability in various domains. In these years, the north of the majority of the researchers had been to improve…

Machine Learning · Computer Science 2020-12-11 Mário Popolin Neto , Fernando V. Paulovich

A fully nonparametric approach for making probabilistic predictions in multi-response regression problems is introduced. Random forests are used as marginal models for each response variable and, as novel contribution of the present work,…

Machine Learning · Computer Science 2022-10-12 Marius Hofert , Avinash Prasad , Mu Zhu

Beta coefficients for linear regression models represent the ideal form of an interpretable feature effect. However, for non-linear models and especially generalized linear models, the estimated coefficients cannot be interpreted as a…

Machine Learning · Computer Science 2022-01-24 Christian A. Scholbeck , Giuseppe Casalicchio , Christoph Molnar , Bernd Bischl , Christian Heumann

Bayesian Additive Regression Trees (BART) is a flexible machine learning algorithm capable of capturing nonlinearities between an outcome and covariates and interaction among covariates. We extend BART to a semiparametric regression…

Applications · Statistics 2018-06-13 Bret Zeldow , Vincent Lo Re , Jason Roy

Stochastic frontier models have attracted considerable attention due to the incorporation of an inefficiency term in addition to the conventional error term. In this paper, we propose a general estimation framework for panel stochastic…

Econometrics · Economics 2026-04-22 Kazuki Tomioka , Thomas T. Yang , Xibin Zhang

Existing identification and estimation methods for semiparametric sample selection models rely heavily on exclusion restrictions. However, it is difficult in practice to find a credible excluded variable that has a correlation with…

Econometrics · Economics 2024-12-03 Zhewen Pan , Yifan Zhang

Linear regression models have been extensively considered in the literature. However, in some practical applications they may not be appropriate all over the range of the covariate. In this paper, a more flexible model is introduced by…

Statistics Theory · Mathematics 2023-12-19 Graciela Boente , Florencia Leonardi , Daniela Rodriguez , Mariela Sued

This paper considers an empirical likelihood inference for parameters defined by general estimating equations, when data are missing at random. The efficiency of existing estimators depends critically on correctly specifying the conditional…

Methodology · Statistics 2016-12-06 Tianqing Liu , Xiaohui Yuan , Zhaohai Li , Aiyi Liu

We consider a broad class of semiparametric regression models in which the conditional distribution of the response takes the form $f\{Y|\bf{x}^{\rm T}\boldsymbol{\beta}+m(z), \phi\}$, which is known up to a parametric component…

Methodology · Statistics 2026-05-12 Yuming Zhang , Yanyuan Ma , Xuming He , Stéphane Guerrier

I propose a locally robust semiparametric framework for estimating causal effects using the popular examiner IV design, in the presence of many examiners and possibly many covariates relative to the sample size. The key ingredient of this…

Econometrics · Economics 2024-05-01 Lonjezo Sithole

Uncovering the heterogeneity of causal effects of policies and business decisions at various levels of granularity provides substantial value to decision makers. This paper develops estimation and inference procedures for multiple treatment…

Econometrics · Economics 2022-09-09 Michael Lechner , Jana Mareckova

We provide a new flexible framework for inference with the instrumental variable model. Rather than using linear specifications, functions characterizing the effects of instruments and other explanatory variables are estimated using machine…

Machine Learning · Statistics 2021-02-03 Robert E. McCulloch , Rodney A. Sparapani , Brent R. Logan , Purushottam W. Laud

In this paper, we consider a functional linear regression model, where both the covariate and the response variable are functional random variables. We address the problem of optimal nonparametric estimation of the conditional expectation…

Statistics Theory · Mathematics 2022-03-02 Gaëlle Chagny , Anouar Meynaoui , Angelina Roche

We propose the orthogonal random forest, an algorithm that combines Neyman-orthogonality to reduce sensitivity with respect to estimation error of nuisance parameters with generalized random forests (Athey et al., 2017)--a flexible…

Machine Learning · Computer Science 2019-09-27 Miruna Oprescu , Vasilis Syrgkanis , Zhiwei Steven Wu

How should researchers conduct causal inference when the outcome of interest is latent and measured imperfectly by multiple indicators? We develop a general nonparametric framework for identifying and estimating average treatment effects on…

Methodology · Statistics 2026-04-22 Jiawei Fu , Donald P. Green

Regression models to relate a scalar $Y$ to a functional predictor $X(t)$ are becoming increasingly common. Work in this area has concentrated on estimating a coefficient function, $\beta(t)$, with $Y$ related to $X(t)$ through…

Statistics Theory · Mathematics 2009-08-21 Gareth M. James , Jing Wang , Ji Zhu

In the mixture of experts model, a common assumption is the linearity between a response variable and covariates. While this assumption has theoretical and computational benefits, it may lead to suboptimal estimates by overlooking potential…

Methodology · Statistics 2025-04-17 Yeongsan Hwang , Byungtae Seo , Sangkon Oh

This paper proposes a partition-based functional ridge regression framework to address multicollinearity, overfitting, and interpretability in high-dimensional functional linear models. The coefficient function vector \(…

Methodology · Statistics 2026-03-13 Shaista Ashraf , Ismail Shah , Farrukh Javed

Random Forest (RF) is well-known as an efficient ensemble learning method in terms of predictive performance. It is also considered a Black Box because of its hundreds of deep decision trees. This lack of interpretability can be a real…

Machine Learning · Computer Science 2024-03-27 Haddouchi Maissae , Berrado Abdelaziz

When predicting scalar responses in the situation where the explanatory variables are functions, it is sometimes the case that some functional variables are related to responses linearly while other variables have more complicated…

Methodology · Statistics 2012-11-29 Heng Lian