English
Related papers

Related papers: Functional Tensor Regression

200 papers

In the machine learning fields, Recurrent Neural Network (RNN) has become a popular architecture for sequential data modeling. However, behind the impressive performance, RNNs require a large number of parameters for both training and…

Machine Learning · Computer Science 2018-05-09 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

An increasing number of emerging applications in data science and engineering are based on multidimensional and structurally rich data. The irregularities, however, of high-dimensional data often compromise the effectiveness of standard…

Explosive growth in spatio-temporal data and its wide range of applications have attracted increasing interests of researchers in the statistical and machine learning fields. The spatio-temporal regression problem is of paramount importance…

Machine Learning · Computer Science 2020-09-15 Aniruddha Rajendra Rao , Qiyao Wang , Haiyan Wang , Hamed Khorasgani , Chetan Gupta

Uncertainty quantification based on stochastic spectral methods suffers from the curse of dimensionality. This issue was mitigated recently by low-rank tensor methods. However, there exist two fundamental challenges in low-rank tensor-based…

Numerical Analysis · Mathematics 2021-02-03 Zichang He , Zheng Zhang

This paper presents a method for approximate Gaussian process (GP) regression with tensor networks (TNs). A parametric approximation of a GP uses a linear combination of basis functions, where the accuracy of the approximation depends on…

Machine Learning · Statistics 2023-11-01 Clara Menzen , Eva Memmel , Kim Batselier , Manon Kok

Tensor completion is a fundamental tool for incomplete data analysis, where the goal is to predict missing entries from partial observations. However, existing methods often make the explicit or implicit assumption that the observed entries…

Machine Learning · Statistics 2022-03-18 Yuning Qiu , Guoxu Zhou , Qibin Zhao , Shengli Xie

Characterising intractable high-dimensional random variables is one of the fundamental challenges in stochastic computation. The recent surge of transport maps offers a mathematical foundation and new insights for tackling this challenge by…

Machine Learning · Statistics 2021-10-20 Tiangang Cui , Sergey Dolgov

We study the fundamental problem of fixed design {\em multidimensional segmented regression}: Given noisy samples from a function $f$, promised to be piecewise linear on an unknown set of $k$ rectangles, we want to recover $f$ up to a…

Data Structures and Algorithms · Computer Science 2020-03-26 Ilias Diakonikolas , Jerry Li , Anastasia Voloshinov

As medical devices become more complex, they routinely collect extensive and complicated data. While classical regressions typically examine the relationship between an outcome and a vector of predictors, it becomes imperative to identify…

Methodology · Statistics 2024-05-16 Huaqing Jin , Fei Jiang

We consider the recursive estimation of a regression functional where the explanatory variables take values in some functional space. We prove the almost sure convergence of such estimates for dependent functional data. Also we derive the…

Statistics Theory · Mathematics 2013-04-19 Aboubacar Amiri , Baba Thiam

Tensors play a central role in many modern machine learning and signal processing applications. In such applications, the target tensor is usually of low rank, i.e., can be expressed as a sum of a small number of rank one tensors. This…

Machine Learning · Statistics 2015-05-18 Parikshit Shah , Nikhil Rao , Gongguo Tang

In functional linear regression, the parameters estimation involves solving a non necessarily well-posed problem and it has points of contact with a range of methodologies, including statistical smoothing, deconvolution and projection on…

Statistics Theory · Mathematics 2018-01-04 Andrea Ghiglietti , Francesca Ieva , Anna Maria Paganoni , Giacomo Aletti

This paper addresses the problem of providing robust estimators under a functional logistic regression model. Logistic regression is a popular tool in classification problems with two populations. As in functional linear regression,…

Methodology · Statistics 2023-08-16 Graciela Boente , Marina Valdora

Tensor decomposition is one of the fundamental technique for model compression of deep convolution neural networks owing to its ability to reveal the latent relations among complex structures. However, most existing methods compress the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Bo-Shiuan Chu , Che-Rung Lee

In this paper, we propose methods for functional predictor selection and the estimation of smooth functional coefficients simultaneously in a scalar-on-function regression problem under high-dimensional multivariate functional data setting.…

Methodology · Statistics 2022-05-04 Ali Mahzarnia , Jun Song

This chapter studies the problem of decomposing a tensor into a sum of constituent rank one tensors. While tensor decompositions are very useful in designing learning algorithms and data analysis, they are NP-hard in the worst-case. We will…

Data Structures and Algorithms · Computer Science 2020-07-31 Aravindan Vijayaraghavan

In the present paper, we propose and analyze a novel method for estimating a univariate regression function of bounded variation. The underpinning idea is to combine two classical tools in nonparametric statistics, namely isotonic…

Statistics Theory · Mathematics 2012-11-20 Arnaud Guyader , Nicolas Jégou , Alexander B. Németh , Sándor Z. Németh

Contingency table analysis routinely relies on log linear models, with latent structure analysis providing a common alternative. Latent structure models lead to a low rank tensor factorization of the probability mass function for…

Statistics Theory · Mathematics 2014-04-03 James E. Johndrow , Anirban Battacharya , David B. Dunson

Statistical methods relating tensor predictors to scalar outcomes in a regression model generally vectorize the tensor predictor and estimate the coefficients of its entries employing some form of regularization, use summaries of the tensor…

Methodology · Statistics 2021-07-29 Georgia Papadogeorgou , Zhengwu Zhang , David B. Dunson

In this paper we propose a general methodology, based on multiple testing, for testing that the mean of a Gaussian vector in R^n belongs to a convex set. We show that the test achieves its nominal level, and characterize a class of vectors…

Statistics Theory · Mathematics 2007-06-13 Yannick Baraud , Sylvie Huet , Beatrice Laurent