English
Related papers

Related papers: Partition-Based Functional Ridge Regression for Hi…

200 papers

Multidimensional function data arise from many fields nowadays. The covariance function plays an important role in the analysis of such increasingly common data. In this paper, we propose a novel nonparametric covariance function estimation…

Methodology · Statistics 2021-09-14 Jiayi Wang , Raymond K. W. Wong , Xiaoke Zhang

We propose a novel methodology, forest floor, to visualize and interpret random forest (RF) models. RF is a popular and useful tool for non-linear multi-variate classification and regression, which yields a good trade-off between robustness…

Machine Learning · Statistics 2016-07-05 Soeren H. Welling , Hanne H. F. Refsgaard , Per B. Brockhoff , Line H. Clemmensen

The presence of surface defects (roughness, surface imperfections, profiles, etc.) in a contact inevitably leads to the modification of its local properties, such as the coefficient of friction. In railway wheelsets, this surface condition…

Classical Physics · Physics 2025-10-03 Victor Lalleman , Pierre Gosselet , Cédric Hubert , Stéphane Salengro , Vincent Magnier

While large training datasets generally offer improvement in model performance, the training process becomes computationally expensive and time consuming. Distributed learning is a common strategy to reduce the overall training time by…

Machine Learning · Statistics 2021-10-22 Nicole Mücke , Enrico Reiss , Jonas Rungenhagen , Markus Klein

Blockwise missing data occurs frequently when we integrate multisource or multimodality data where different sources or modalities contain complementary information. In this paper, we consider a high-dimensional linear regression model with…

Methodology · Statistics 2023-06-30 Fei Xue , Rong Ma , Hongzhe Li

Building on top of a regression model, Conformal Prediction methods produce distribution free prediction sets, requiring only i.i.d. data. While R packages implementing such methods for the univariate response framework have been developed,…

Methodology · Statistics 2022-06-30 Paolo Vergottini , Matteo Fontana , Jacopo Diquigiovanni , Aldo Solari , Simone Vantini

Segmented regression models offer model flexibility and interpretability as compared to the global parametric and the nonparametric models, and yet are challenging in both estimation and inference. We consider a four-regime segmented model…

Methodology · Statistics 2024-10-08 Han Yan , Song Xi Chen

This paper investigates the efficient solution of penalized quadratic regressions in high-dimensional settings. A novel and efficient algorithm for ridge-penalized quadratic regression is proposed, leveraging the matrix structures of the…

Computation · Statistics 2023-12-05 Cheng Wang , Haozhe Chen , Binyan Jiang

We propose a flexible dual functional factor model for modelling high-dimensional functional time series. In this model, a high-dimensional fully functional factor parametrisation is imposed on the observed functional processes, whereas a…

Econometrics · Economics 2024-01-15 Chenlei Leng , Degui Li , Hanlin Shang , Yingcun Xia

It is crucial to learn the shared structures among functional predictors, as these structures characterize how predictor components exert common effects and, more generally, how predictors are homogeneously associated with the response.…

Methodology · Statistics 2026-04-27 Shuhao Jiao , Hernando Ombao , Ian W. McKeague

Artificial intelligence, trained via machine learning or computational statistics algorithms, holds much promise for the improvement of small molecule drug discovery. However, structure-activity data are high dimensional with low…

Applications · Statistics 2018-07-25 Oliver Watson , Isidro Cortes-Ciriano , Aimee Taylor , James A Watson

Regression models to relate a scalar $Y$ to a functional predictor $X(t)$ are becoming increasingly common. Work in this area has concentrated on estimating a coefficient function, $\beta(t)$, with $Y$ related to $X(t)$ through…

Statistics Theory · Mathematics 2009-08-21 Gareth M. James , Jing Wang , Ji Zhu

The random feature method (RFM) has demonstrated great potential in bridging traditional numerical methods and machine learning techniques for solving partial differential equations (PDEs). It retains the advantages of mesh-free approaches…

Numerical Analysis · Mathematics 2025-05-02 Mikhail Kuvakin , Zijian Mei , Jingrun Chen

This paper considers the partially functional linear model (PFLM) where all predictive features consist of a functional covariate and a high dimensional scalar vector. Over an infinite dimensional reproducing kernel Hilbert space, the…

Statistics Theory · Mathematics 2021-10-19 Shaogao Lv , Xin He , Junhui Wang

We address the challenge of correlated predictors in high-dimensional GLMs, where regression coefficients range from sparse to dense, by proposing a data-driven random projection method. This is particularly relevant for applications where…

Methodology · Statistics 2025-12-30 Roman Parzer , Peter Filzmoser , Laura Vana-Gür

Meta-learning involves training models on a variety of training tasks in a way that enables them to generalize well on new, unseen test tasks. In this work, we consider meta-learning within the framework of high-dimensional multivariate…

Statistics Theory · Mathematics 2024-04-01 Yanhao Jin , Krishnakumar Balasubramanian , Debashis Paul

While building machine learning models, Feature selection (FS) stands out as an essential preprocessing step used to handle the uncertainty and vagueness in the data. Recently, the minimum Redundancy and Maximum Relevance (mRMR) approach…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-25 Yelleti Vivek , P. S. V. S. Sai Prasad

We analyze the problem of regression when both input covariates and output responses are functions from a nonparametric function class. Function to function regression (FFR) covers a large range of interesting applications including…

Machine Learning · Statistics 2014-10-29 Junier Oliva , Willie Neiswanger , Barnabas Poczos , Eric Xing , Jeff Schneider

We propose two localized Radial Basis Function (RBF) methods, the Radial Basis Function Partition of Unity method (RBF-PUM) and the Radial Basis Function generated Finite Differences method (RBF-FD), for solving financial derivative pricing…

Computational Finance · Quantitative Finance 2018-08-20 Slobodan Milovanović , Victor Shcherbakov

This study focuses on the feature extraction problem in multi-modal data regression. To address three core challenges in real-world scenarios: limited and non-IID data, effective extraction and fusion of multi-modal information, and…

Machine Learning · Computer Science 2025-12-03 Haozhe Wu