English
Related papers

Related papers: Linear spline index regression model: Interpretabi…

200 papers

Numerical preprocessing remains an important component of tabular deep learning, where the representation of continuous features can strongly affect downstream performance. Although its importance is well established for classical…

Machine Learning · Computer Science 2026-04-08 Manish Kumar , Anton Frederik Thielmann , Christoph Weisser , Benjamin Säfken

Nonlinear expectation, including sublinear expectation as its special case, is a new and original framework of probability theory and has potential applications in some scientific fields, especially in finance risk measure and management.…

Statistics Theory · Mathematics 2013-04-15 Lu Lin , Yufeng Shi , Xin Wang , Shuzhen Yang

Additive models play an essential role in studying non-linear relationships. Despite many recent advances in estimation, there is a lack of methods and theories for inference in high-dimensional additive models, including confidence…

Statistics Theory · Mathematics 2022-02-18 Zijian Guo , Wei Yuan , Cun-Hui Zhang

Deep learning has achieved remarkable success across many domains, but it has also created a growing demand for interpretability in model predictions. Although many explainable machine learning methods have been proposed, post-hoc…

Machine Learning · Computer Science 2026-01-28 Shijian Xu , Marcello Massimo Negri , Volker Roth

In this paper, we propose a new semiparametric regression estimator by using a hybrid technique of a parametric approach and a nonparametric penalized spline method. The overall shape of the true regression function is captured by the…

Statistics Theory · Mathematics 2012-02-17 Takuma Yoshida , Kanta Naito

Detecting slender, overlapping structures remains a challenge in computational microscopy. While recent coordinate-based approaches improve detection, they often produce less accurate splines than pixel-based methods. We introduce a…

Image and Video Processing · Electrical Eng. & Systems 2025-10-07 Frans Zdyb , Albert Alonso , Julius B. Kirkegaard

Probabilistic regression models the entire predictive distribution of a response variable, offering richer insights than classical point estimates and directly allowing for uncertainty quantification. While diffusion-based generative models…

Machine Learning · Computer Science 2025-10-07 Carlo Kneissl , Christopher Bülte , Philipp Scholl , Gitta Kutyniok

To deal with non-linear relations between the predictors and the response, we can use transformations to make the data look linear or approximately linear. In practice, however, transformation methods may be ineffective, and it may be more…

Methodology · Statistics 2023-01-02 Mithun Kumar Acharjee , Kumer Pial Das

Similar to variable selection in the linear regression model, selecting significant components in the popular additive regression model is of great interest. However, such components are unknown smooth functions of independent variables,…

Methodology · Statistics 2011-01-04 Xia Cui , Heng Peng , Songqiao Wen , Lixing Zhu

This paper studies a \textit{partial functional partially linear single-index model} that consists of a functional linear component as well as a linear single-index component. This model generalizes many well-known existing models and is…

Statistics Theory · Mathematics 2017-03-09 Qingguo Tang , Linglong Kong , David Ruppert , Rohana J. Karunamuni

Quantile regression has received increased attention in the statistics community in recent years. This article adapts an auxiliary variable method, commonly used in Bayesian variable selection for mean regression models, to the fitting of…

Methodology · Statistics 2012-02-28 J. -L. Dortet-Bernadet , Y. Fan

A new single-index model that reflects the time-dynamic effects of the single index is proposed for longitudinal and functional response data, possibly measured with errors, for both longitudinal and time-invariant covariates. With…

Statistics Theory · Mathematics 2011-03-10 Ci-Ren Jiang , Jane-Ling Wang

P-splines are penalized B-splines, in which finite order differences in coefficients are typically penalized with an $\ell_2$ norm. P-splines can be used for semiparametric regression and can include random effects to account for…

Methodology · Statistics 2018-11-01 Brian D. Segal , Michael R. Elliott , Thomas Braun , Hui Jiang

Recently, NLP models have achieved remarkable progress across a variety of tasks; however, they have also been criticized for being not robust. Many robustness problems can be attributed to models exploiting spurious correlations, or…

Computation and Language · Computer Science 2022-05-26 Tianlu Wang , Rohit Sridhar , Diyi Yang , Xuezhi Wang

For the past two decades, single-index model, a special case of projection pursuit regression, has proven to be an efficient way of coping with the high dimensional problem in nonparametric regression. In this paper, based on weakly…

Statistics Theory · Mathematics 2007-05-23 Li Wang , Lijian Yang

In meta-analysis, the random-effects models are standard tools to address between-study heterogeneity in evidence synthesis analyses. For the random-effects distribution models, the normal distribution model has been adopted in most…

Applications · Statistics 2021-07-28 Hisashi Noma , Kengo Nagashima , Shogo Kato , Satoshi Teramukai , Toshi A. Furukawa

Decision trees are powerful for predictive modeling but often suffer from high variance when modeling continuous relationships. While algorithms like Multivariate Adaptive Regression Splines (MARS) excel at capturing such continuous…

Machine Learning · Statistics 2024-10-10 William Pattie , Arvind Krishna

This paper develops an approach to inference in a linear regression model when the number of potential explanatory variables is larger than the sample size. The approach treats each regression coefficient in turn as the interest parameter,…

Methodology · Statistics 2022-11-14 Heather S. Battey , Nancy Reid

We consider estimation and inference in a single index regression model with an unknown but smooth link function. In contrast to the standard approach of using kernels or regression splines, we use smoothing splines to estimate the smooth…

Methodology · Statistics 2019-05-28 Arun Kumar Kuchibhotla , Rohit Kumar Patra

The problem of adaptive multivariate function estimation in the single-index regression model with random design and weak assumptions on the noise is investigated. A novel estimation procedure that adapts simultaneously to the unknown index…

Statistics Theory · Mathematics 2014-01-29 Oleg Lepski , Nora Serdyukova