English
Related papers

Related papers: L1-Regularized Functional Support Vector Machine

200 papers

We consider a finite mixture of regressions (FMR) model for high-dimensional inhomogeneous data where the number of covariates may be much larger than sample size. We propose an l1-penalized maximum likelihood estimator in an appropriate…

Methodology · Statistics 2012-02-28 Nicolas Städler , Peter Bühlmann , Sara van de Geer

This paper proposes a multivariate nonlinear function-on-function regression model, which allows both the response and the covariates can be multi-dimensional functions. The model is built upon the multivariate functional reproducing kernel…

Methodology · Statistics 2024-06-28 Xu Haijie , Zhang Chen

We study functional regression with random subgaussian design and real-valued response. The focus is on the problems in which the regression function can be well approximated by a functional linear model with the slope function being…

Statistics Theory · Mathematics 2014-09-16 Vladimir Koltchinskii , Stanislav Minsker

This article explores the extension of well-known F1 score used for assessing the performance of binary classifiers. We propose the new metric using probabilistic interpretation of precision, recall, specificity, and negative predictive…

Machine Learning · Computer Science 2024-04-17 Mikolaj Sitarz

We explore the merits of training of support vector machines for binary classification by means of solving systems of ordinary differential equations. We thus assume a continuous time perspective on a machine learning problem which may be…

Machine Learning · Computer Science 2022-08-10 Christian Bauckhage , Helen Schneider , Benjamin Wulff , Rafet Sifa

High-dimensional data pose challenges in statistical learning and modeling. Sometimes the predictors can be naturally grouped where pursuing the between-group sparsity is desired. Collinearity may occur in real-world high-dimensional…

Machine Learning · Statistics 2011-11-11 Yiyuan She

Functional linear regression analysis aims to model regression relations which include a functional predictor. The analog of the regression parameter vector or matrix in conventional multivariate or multiple-response linear regression…

Statistics Theory · Mathematics 2011-02-28 Yichao Wu , Jianqing Fan , Hans-Georg Müller

We consider the problem of estimation of a covariance matrix for Gaussian data in a high dimensional setting. Existing approaches include maximum likelihood estimation under a pre-specified sparsity pattern, l_1-penalized loglikelihood…

Methodology · Statistics 2024-10-04 Luca Cibinel , Alberto Roverato , Veronica Vinciotti

One of the challenges with functional data is incorporating spatial structure, or local correlation, into the analysis. This structure is inherent in the output from an increasing number of biomedical technologies, and a functional linear…

Applications · Statistics 2011-11-07 Timothy W. Randolph , Jaroslaw Harezlak , Ziding Feng

In binary classification, kernel-free linear or quadratic support vector machines are proposed to avoid dealing with difficulties such as finding appropriate kernel functions or tuning their hyper-parameters. Furthermore, Universum data…

Machine Learning · Computer Science 2021-04-06 Hossein Moosaei , Ahmad Mousavi , Milan Hladík , Zheming Gao

This paper addresses the problem of providing robust estimators under a functional logistic regression model. Logistic regression is a popular tool in classification problems with two populations. As in functional linear regression,…

Methodology · Statistics 2023-08-16 Graciela Boente , Marina Valdora

In many applications, input data are sampled functions taking their values in infinite dimensional spaces rather than standard vectors. This fact has complex consequences on data analysis algorithms that motivate modifications of them. In…

Statistics Theory · Mathematics 2007-05-23 Fabrice Rossi , Nathalie Villa

The linear Support Vector Machine (SVM) is a classic classification technique in machine learning. Motivated by applications in modern high dimensional statistics, we consider penalized SVM problems involving the minimization of a…

Machine Learning · Statistics 2021-08-31 Antoine Dedieu , Rahul Mazumder , Haoyue Wang

We introduce a new model of linear regression for random functional inputs taking into account the first order derivative of the data. We propose an estimation method which comes down to solving a special linear inverse problem. Our…

Statistics Theory · Mathematics 2016-08-16 André Mas , Besnik Pumo

Classification (supervised-learning) of multivariate functional data is considered when the elements of the random functional vector of interest are defined on different domains. In this setting, PLS classification and tree PLS-based…

Methodology · Statistics 2024-06-11 Issam-Ali Moindjie , Sophie Dabo-Niang , Cristian Preda

We consider nonlinear mixed effects models including high-dimensional covariates to model individual parameters variability. The objective is to identify relevant covariates among a large set under sparsity assumption and to estimate model…

Statistics Theory · Mathematics 2025-08-06 Antoine Caillebotte , Estelle Kuhn , Sarah Lemler

This paper addresses estimation in a longitudinal regression model for association between a scalar outcome and a set of longitudinally-collected functional covariates or predictor curves. The framework consists of estimating a time-varying…

Applications · Statistics 2020-06-30 Madan G. Kundu , Jaroslaw Harezlak , Timothy W. Randolph

The adequate use of information measured in a continuous manner along a period of time represents a methodological challenge. In the last decades, most of traditional statistical procedures have been extended for accommodating these…

Methodology · Statistics 2025-12-04 Pablo Martinez-Camblor

Improvement of statistical learning models in order to increase efficiency in solving classification or regression problems is still a goal pursued by the scientific community. In this way, the support vector machine model is one of the…

Machine Learning · Statistics 2019-11-22 Anderson Ara , Mateus Maia , Samuel Macêdo , Francisco Louzada

High-dimensional functional data are becoming increasingly common in fields such as environmental monitoring and neuroimaging. This paper studies high-dimensional functional linear regression models that relate a scalar response to…

Methodology · Statistics 2026-05-08 Xingche Guo , Yehua Li , Pang Du