English
Related papers

Related papers: On functional logistic regression: some conceptual…

200 papers

This work presents a nonparametric framework for dissipativity learning in reproducing kernel Hilbert spaces, which enables data-driven certification of stability and performance properties for unknown nonlinear systems without requiring an…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Xiuzhen Ye , Wentao Tang

Data loss is a critical problem in structural health monitoring (SHM). Probability distributions play a highly important role in many applications. Improving the quality of distribution estimations made using incomplete samples is highly…

Applications · Statistics 2018-12-11 Zhicheng Chen , Yuequan Bao , Hui Li , Billie F. Spencer

This paper deals with robust marginal estimation under a general regression model when missing data occur in the response and also in some of covariates. The target is a marginal location parameter which is given through an $M-$functional.…

This paper considers the problem of manifold functional multiple regression with functional response, time--varying scalar regressors, and functional error term displaying Long Range Dependence (LRD) in time. Specifically, the error term is…

Statistics Theory · Mathematics 2024-02-14 Diana P. Ovalle-Muñoz , M. Dolores Ruiz-Medina

This paper addresses the covariate shift problem in the context of nonparametric regression within reproducing kernel Hilbert spaces (RKHSs). Covariate shift arises in supervised learning when the input distributions of the training and…

Machine Learning · Statistics 2025-05-21 Andrea Della Vecchia , Arnaud Mavakala Watusadisi , Ernesto De Vito , Lorenzo Rosasco

In this paper we consider the linear regression model $Y =S X+\varepsilon $ with functional regressors and responses. We develop new inference tools to quantify deviations of the true slope $S$ from a hypothesized operator $S_0$ with…

Statistics Theory · Mathematics 2021-08-17 Tim Kutta , Gauthier Dierickx , Holger Dette

Reward modeling is crucial for aligning large language models with human preferences, yet current approaches lack a principled mathematical framework for leveraging ordinal preference data. When human annotators provide graded preferences…

Machine Learning · Computer Science 2026-03-04 Amirhossein Afsharrad , Ruida Zhou , Luca Viano , Sanjay Lall , Mohammad Ghavamzadeh

We propose a functional linear model to predict a response using multiple functional and longitudinal predictors and to estimate the effect lags of predictors. The coefficient functions are written as the expansion of a basis system (e.g.…

Methodology · Statistics 2019-07-24 Haiyan Liu , Georgios Aivaliotis , Jeanine Houwing-Duistermaat

Empirical risk minimization, a cornerstone in machine learning, is often hindered by the Optimizer's Curse stemming from discrepancies between the empirical and true data-generating distributions.To address this challenge, the robust…

Machine Learning · Computer Science 2024-08-20 Haojie Yan , Minglong Zhou , Jiayi Guo

This work introduces Bilinear Classes, a new structural framework, which permit generalization in reinforcement learning in a wide variety of settings through the use of function approximation. The framework incorporates nearly all existing…

Machine Learning · Computer Science 2021-07-13 Simon S. Du , Sham M. Kakade , Jason D. Lee , Shachar Lovett , Gaurav Mahajan , Wen Sun , Ruosong Wang

Logistic regression involving high-dimensional covariates is a practically important problem. Often the goal is variable selection, i.e., determining which few of the many covariates are associated with the binary response. Unfortunately,…

Computation · Statistics 2025-02-18 Yiqi Tang , Ryan Martin

We consider the Berkson model of logistic regression with Gaussian and homoscedastic error in regressor. The measurement error variance can be either known or unknown. We deal with both functional and structural cases. Sufficient conditions…

Probability · Mathematics 2015-08-13 Sergiy Shklyar

While discriminative classifiers often yield strong predictive performance, missing feature values at prediction time can still be a challenge. Classifiers may not behave as expected under certain ways of substituting the missing values,…

Machine Learning · Computer Science 2019-06-04 Pasha Khosravi , Yitao Liang , YooJung Choi , Guy Van den Broeck

Reproducing kernel Hilbert spaces (RKHSs) play an important role in many statistics and machine learning applications ranging from support vector machines to Gaussian processes and kernel embeddings of distributions. Operators acting on…

Functional Analysis · Mathematics 2021-04-06 Mattes Mollenhauer , Ingmar Schuster , Stefan Klus , Christof Schütte

While LLMs exhibit impressive fluency and factual recall, they struggle with robust causal reasoning, often relying on spurious correlations and brittle patterns. Similarly, traditional Reinforcement Learning agents also lack causal…

Machine Learning · Computer Science 2025-09-26 Abi Aryan , Zac Liu

We propose in this work to derive a CLT in the functional linear regression model to get confidence sets for prediction based on functional linear regression. The main difficulty is due to the fact that estimation of the functional…

Statistics Theory · Mathematics 2016-08-16 Hervé Cardot , André Mas , Pascal Sarda

Classical functional calculus is primarily spectral, capturing eigenvalue information through resolvent methods while largely ignoring nilpotent structure. Building on the projector-nilpotent characterization developed in our companion…

Functional Analysis · Mathematics 2026-05-14 Shih-Yu Chang

We propose an extensive framework for additive regression models for correlated functional responses, allowing for multiple partially nested or crossed functional random effects with flexible correlation structures for, e.g., spatial,…

Methodology · Statistics 2013-11-26 Fabian Scheipl , Ana-Maria Staicu , Sonja Greven

Regularized empirical risk minimization using kernels and their corresponding reproducing kernel Hilbert spaces (RKHSs) plays an important role in machine learning. However, the actually used kernel often depends on one or on a few…

Machine Learning · Statistics 2017-09-25 Andreas Christmann , Daohong Xiang , Ding-Xuan Zhou

We generalize Jan Willems' behavioral approach to a class of discrete-time nonlinear systems in a vector-valued reproducing kernel Hilbert space (RKHS). Apart from linear time-invariant systems, this class covers nonlinear systems modeled…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Boya Hou , Maxim Raginsky