English
Related papers

Related papers: Hierarchical Total Variations and Doubly Penalized…

200 papers

This paper focuses on a semiparametric regression model in which the response variable is explained by the sum of two components. One of them is parametric (linear), the corresponding explanatory variable is measured with additive error and…

Methodology · Statistics 2024-11-20 Silvia Novo , Germán Aneiros , Philippe Vieu

Covariance regression offers an effective way to model the large covariance matrix with the auxiliary similarity matrices. In this work, we propose a sparse covariance regression (SCR) approach to handle the potentially high-dimensional…

Methodology · Statistics 2024-10-17 Yuan Gao , Zhiyuan Zhang , Zhanrui Cai , Xuening Zhu , Tao Zou , Hansheng Wang

Fitting regression models with many multivariate responses and covariates can be challenging, but such responses and covariates sometimes have tensor-variate structure. We extend the classical multivariate regression model to exploit such…

Methodology · Statistics 2023-01-31 Carlos Llosa-Vite , Ranjan Maitra

In traditional logistic regression models, the link function is often assumed to be linear and continuous in predictors. Here, we consider a threshold model that all continuous features are discretized into ordinal levels, which further…

Methodology · Statistics 2022-02-18 Yinan Lin , Wen Zhou , Zhi Geng , Gexin Xiao , Jianxin Yin

We study functional regression with random subgaussian design and real-valued response. The focus is on the problems in which the regression function can be well approximated by a functional linear model with the slope function being…

Statistics Theory · Mathematics 2014-09-16 Vladimir Koltchinskii , Stanislav Minsker

Due to its low computational cost, Lasso is an attractive regularization method for high-dimensional statistical settings. In this paper, we consider multivariate counting processes depending on an unknown function parameter to be estimated…

Statistics Theory · Mathematics 2015-04-08 Niels Richard Hansen , Patricia Reynaud-Bouret , Vincent Rivoirard

Sparse linear regression -- finding an unknown vector from linear measurements -- is now known to be possible with fewer samples than variables, via methods like the LASSO. We consider the multiple sparse linear regression problem, where…

Machine Learning · Computer Science 2012-02-28 Ali Jalali , Pradeep Ravikumar , Sujay Sanghavi

Using representations of functional data can be more convenient and beneficial in subsequent statistical models than direct observations. These representations, in a lower-dimensional space, extract and compress information from individual…

Machine Learning · Statistics 2022-06-24 Haixu Wang , Jiguo Cao

Semi-structured networks (SSNs) merge the structures familiar from additive models with deep neural networks, allowing the modeling of interpretable partial feature effects while capturing higher-order non-linearities at the same time. A…

Machine Learning · Computer Science 2024-10-15 David Rügamer , Bernard X. W. Liew , Zainab Altai , Almond Stöcker

Motivated by value function estimation in reinforcement learning, we study statistical linear inverse problems, i.e., problems where the coefficients of a linear system to be solved are observed in noise. We consider penalized estimators,…

Machine Learning · Computer Science 2012-07-03 Bernardo Avila Pires , Csaba Szepesvari

Functional linear regression is an important topic in functional data analysis. It is commonly assumed that samples of the functional predictor are independent realizations of an underlying stochastic process, and are observed over a grid…

Methodology · Statistics 2020-09-15 Cheng Chen , Shaojun Guo , Xinghao Qiao

The functional ANOVA expansion of a multivariate mapping plays a fundamental role in statistics. The expansion is unique once a unique distribution is assigned to the covariates. Recent investigations in the environmental and climate…

Computation · Statistics 2018-01-17 Emanuele Borgonovo , Max D. Morris , Elmar Plischke

Contamination of covariates by measurement error is a classical problem in multivariate regression, where it is well known that failing to account for this contamination can result in substantial bias in the parameter estimators. The nature…

Methodology · Statistics 2017-12-13 Anirvan Chakraborty , Victor M. Panaretos

We extend the varying coefficient functional linear model to the nonlinear model and propose a varying coefficient functional additive model. The proposed method can represent the relationship between functional predictors and a scalar…

Methodology · Statistics 2020-05-27 Hidetoshi Matsui

Multivariate functional data can be intrinsically multivariate like movement trajectories in 2D or complementary like precipitation, temperature, and wind speeds over time at a given weather station. We propose a multivariate functional…

Methodology · Statistics 2021-10-06 Alexander Volkmann , Almond Stöcker , Fabian Scheipl , Sonja Greven

Functional data analysis has been extensively conducted. In this study, we consider a partially functional model, under which some covariates are scalars and have linear effects, while some other variables are functional and have…

Methodology · Statistics 2023-01-11 Weijuan Liang , Qingzhao Zhang , Shuangge Ma

We propose a tree-based algorithm for classification and regression problems in the context of functional data analysis, which allows to leverage representation learning and multiple splitting rules at the node level, reducing…

Machine Learning · Statistics 2020-11-03 Edoardo Belli , Simone Vantini

Deep neural networks typically treat nonlinearities as fixed primitives (e.g., ReLU), limiting both interpretability and the granularity of control over the induced function class. While recent additive models (like KANs) attempt to address…

Machine Learning · Computer Science 2026-02-05 Jusheng Zhang , Ningyuan Liu , Qinhan Lyu , Jing Yang , Keze Wang

Translating machine learning algorithms into clinical applications requires addressing challenges related to interpretability, such as accounting for the effect of confounding variables (or metadata). Confounding variables affect the…

Machine Learning · Computer Science 2022-07-12 Anthony Vento , Qingyu Zhao , Robert Paul , Kilian M. Pohl , Ehsan Adeli

We introduce a new class of non-linear function-on-function regression models for functional data using neural networks. We propose a framework using a hidden layer consisting of continuous neurons, called a continuous hidden layer, for…

Methodology · Statistics 2023-10-10 Aniruddha Rajendra Rao , Matthew Reimherr