English
Related papers

Related papers: The EFM approach for single-index models

200 papers

Traditional model-free feature selection methods treat each feature independently while disregarding the interrelationships among features, which leads to relatively poor performance compared with the model-aware methods. To address this…

Machine Learning · Computer Science 2025-06-10 Jianming Lv , Sijun Xia , Depin Liang , Wei Chen

Functional variables are often used as predictors in regression problems. A commonly-used parametric approach, called {\it scalar-on-function regression}, uses the $\ltwo$ inner product to map functional predictors into scalar responses.…

Methodology · Statistics 2020-06-02 Kyungmin Ahn , J. Derek Tucker , Wei Wu , Anuj Srivastava

We propose an evolution strategies-based algorithm for estimating gradients in unrolled computation graphs, called ES-Single. Similarly to the recently-proposed Persistent Evolution Strategies (PES), ES-Single is unbiased, and overcomes…

Machine Learning · Computer Science 2023-04-24 Paul Vicol , Zico Kolter , Kevin Swersky

We present DeepFDM, a differentiable finite-difference framework for learning spatially varying coefficients in time-dependent partial differential equations (PDEs). By embedding a classical forward-Euler discretization into a convolutional…

Numerical Analysis · Mathematics 2025-07-30 Patrick Chatain , Michael Rizvi-Martel , Guillaume Rabusseau , Adam Oberman

The identification of new rare signals in data, the detection of a sudden change in a trend, and the selection of competing models, are among the most challenging problems in statistical practice. These challenges can be tackled using a…

Methodology · Statistics 2022-04-06 Sara Algeri , David A. van Dyk

Vector Error Correction Model (VECM) is a classic method to analyse cointegration relationships amongst multivariate non-stationary time series. In this paper, we focus on high dimensional setting and seek for sample-size-efficient…

Methodology · Statistics 2024-03-13 Parley R Yang , Alexander Y Shestopaloff

For the past two decades, single-index model, a special case of projection pursuit regression, has proven to be an efficient way of coping with the high dimensional problem in nonparametric regression. In this paper, based on weakly…

Statistics Theory · Mathematics 2007-05-23 Li Wang , Lijian Yang

We propose a method to account for model error due to unresolved scales in the context of the ensemble transform Kalman filter (ETKF). The approach extends to this class of algorithms the deterministic model error formulation recently…

Data Analysis, Statistics and Probability · Physics 2023-07-19 Lewis Mitchell , Alberto Carrassi

Ordinary differential equations (ODEs) are commonly used to model dynamic behavior of a system. Because many parameters are unknown and have to be estimated from the observed data, there is growing interest in statistics to develop…

Statistics Theory · Mathematics 2010-01-13 Xin Qi , Hongyu Zhao

Despite the risk of misspecification they are tied to, parametric models continue to be used in statistical practice because they are accessible to all. In particular, efficient estimation procedures in parametric models are simple to…

Statistics Theory · Mathematics 2016-09-01 Marco Carone , Alexander R. Luedtke , Mark J. van der Laan

We consider a randomised implementation of the finite element method (FEM) for elliptic partial differential equations on high-dimensional models. This is motivated by applications where model predictions are essential for real-time process…

Numerical Analysis · Mathematics 2019-07-30 Yue Wu , Dimitris Kamilis , Nick Polydorides

In this article, we propose two classes of semiparametric mixture regression models with single-index for model based clustering. Unlike many semiparametric/nonparametric mixture regression models that can only be applied to low dimensional…

Methodology · Statistics 2017-08-15 Sijia Xiang , Weixin Yao

We propose a new inferential framework for constructing confidence regions and testing hypotheses in statistical models specified by a system of high dimensional estimating equations. We construct an influence function by projecting the…

Statistics Theory · Mathematics 2016-06-24 Matey Neykov , Yang Ning , Jun S. Liu , Han Liu

ESFEM is a method introduced in order to solve a linear advection-diffusion equation on an evolving two-dimensional surface with finite elements by using a moving grid with nodes sitting on and evolving with the surface. The evolution of…

Numerical Analysis · Mathematics 2016-04-18 Maryia Borukhava , Heiko Kröner

A folded type model is developed for analyzing compositional data. The proposed model involves an extension of the $\alpha$-transformation for compositional data and provides a new and flexible class of distributions for modeling data…

Machine Learning · Statistics 2019-02-27 Michail Tsagris , Connie Stewart

We propose a new parametrization for the estimation and identification of the impulse-response functions (IRFs) of dynamic factor models (DFMs). The theoretical contribution of this paper concerns the problem of observational equivalence…

Econometrics · Economics 2022-02-23 Juho Koistinen , Bernd Funovits

We investigate the use of models from the theory of regularity structures as features in machine learning tasks. A model is a polynomial function of a space-time signal designed to well-approximate solutions to partial differential…

Machine Learning · Statistics 2023-12-05 Ilya Chevyrev , Andris Gerasimovics , Hendrik Weber

We extend nonparametric regression smoothing splines to a context where there is endogeneity and instrumental variables are available. Unlike popular existing estimators, the resulting estimator is one-step and relies on a unique…

Econometrics · Economics 2024-12-10 Jad Beyhum , Elia Lapenta , Pascal Lavergne

Many methods have been proposed to quantify the predictive uncertainty associated with the outputs of deep neural networks. Among them, ensemble methods often lead to state-of-the-art results, though they require modifications to the…

Machine Learning · Computer Science 2021-05-11 Zhiyun Lu , Eugene Ie , Fei Sha

Generalized partially linear single-index models (GPLSIMs) provide a flexible and interpretable semiparametric framework for longitudinal outcomes by combining a low-dimensional parametric component with a nonparametric index component. For…

Methodology · Statistics 2026-02-19 Tianni Zhang , Yuyao Wang , Yu Lu , Mengfei Ran