English
Related papers

Related papers: Machine-Learning-Assisted Comparison of Regression…

200 papers

In this paper we introduce a kernel-based measure for detecting differences between two conditional distributions. Using the `kernel trick' and nearest-neighbor graphs, we propose a consistent estimate of this measure which can be computed…

Methodology · Statistics 2024-08-30 Anirban Chatterjee , Ziang Niu , Bhaswar B. Bhattacharya

Consider estimation of the regression function based on a model with equidistant design and measurement errors generated from a fractional Gaussian noise process. In previous literature, this model has been heuristically linked to an…

Statistics Theory · Mathematics 2014-12-02 Johannes Schmidt-Hieber

We address the problem of general supervised learning when data can only be accessed through an (indefinite) similarity function between data points. Existing work on learning with indefinite kernels has concentrated solely on…

Machine Learning · Computer Science 2012-10-23 Purushottam Kar , Prateek Jain

Debiased machine learning is a meta algorithm based on bias correction and sample splitting to calculate confidence intervals for functionals, i.e. scalar summaries, of machine learning algorithms. For example, an analyst may desire the…

Machine Learning · Statistics 2022-10-25 Victor Chernozhukov , Whitney K. Newey , Rahul Singh

We investigate asymptotic inference in a linear regression model where both response and regressors are functions, using an estimator based on functional principal components analysis. Although this approach is widely used in functional…

Methodology · Statistics 2026-03-16 Hyemin Yeon

The paper concerns inference in the ill-conditioned functional response model, which is a part of functional data analysis. In this regression model, the functional response is modeled using several independent scalar variables. To verify…

Methodology · Statistics 2024-10-07 Łukasz Smaga , Natalia Stefańska

Randomization testing is a fundamental method in statistics, enabling inferential tasks such as testing for (conditional) independence of random variables, constructing confidence intervals in semiparametric location models, and…

Methodology · Statistics 2023-03-21 Yash Nair , Lucas Janson

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

The problem of testing for the parametric form of the conditional variance is considered in a fully nonparametric regression model. A test statistic based on a weighted $L_2$-distance between the empirical characteristic functions of…

Methodology · Statistics 2018-07-24 Juan Carlos Pardo-Fernandez , M. Dolores Jimenez-Gamero

Regression adjustment is broadly applied in randomized trials under the premise that it usually improves the precision of a treatment effect estimator. However, previous work has shown that this is not always true. To further understand…

Methodology · Statistics 2022-10-11 Katarzyna Reluga , Ting Ye , Qingyuan Zhao

In many modern applications, a dependent functional response is observed for each subject over repeated time, leading to longitudinal functional data. In this paper, we propose a novel statistical procedure to test whether the mean function…

Methodology · Statistics 2024-01-17 Salil Koner , So Young Park , Ana-Maria Staicu

The goal of this paper is to indicate a new method for constructing normal confidence intervals for the mean, when the data is coming from stochastic structures with possibly long memory, especially when the dependence structure is not…

Methodology · Statistics 2018-01-03 Martial Longla , Magda Peligrad

In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to flexibly combine individual regression estimators $r_1, r_2, \ldots, r_M$ using a weighted average where the weights are defined…

Methodology · Statistics 2021-04-29 Sothea Has

For regression models, most of existing specification tests can be categorized into the class of local smoothing tests and of global smoothing tests. Compared with global smoothing tests, local smoothing tests can only detect local…

Methodology · Statistics 2017-10-18 Lingzhu Li , Lixing Zhu

Model checking plays an important role in linear regression as model misspecification seriously affects the validity and efficiency of regression analysis. In practice, model checking is often performed by subjectively evaluating the plot…

Statistics Theory · Mathematics 2019-11-19 Rok Blagus , Jakob Peterlin , Janez Stare

In this paper, we develop invariance-based procedures for testing and inference in high-dimensional regression models. These procedures, also known as randomization tests, provide several important advantages. First, for the global null…

Methodology · Statistics 2023-12-27 Wenxuan Guo , Panos Toulis

As medical devices become more complex, they routinely collect extensive and complicated data. While classical regressions typically examine the relationship between an outcome and a vector of predictors, it becomes imperative to identify…

Methodology · Statistics 2024-05-16 Huaqing Jin , Fei Jiang

Many applications that use empirically estimated functions face a curse of dimensionality, because the integrals over most function classes must be approximated by sampling. This paper introduces a novel regression-algorithm that learns…

Machine Learning · Computer Science 2015-03-31 Wendelin Böhmer , Klaus Obermayer

The ultimate goal of regression analysis is to obtain information about the conditional distribution of a response given a set of explanatory variables. This goal is, however, seldom achieved because most established regression models only…

Methodology · Statistics 2017-12-13 Torsten Hothorn , Thomas Kneib , Peter Bühlmann

We propose a novel method for testing the null hypothesis of no effect of a covariate on the response in the context of functional linear concurrent regression. We establish an equivalent random effects formulation of our functional…

Methodology · Statistics 2019-12-16 Rahul Ghosal , Arnab Maity