English
Related papers

Related papers: A Non-linear Function-on-Function Model for Regres…

200 papers

Multivariate time series is prevalent in many scientific and industrial domains. Modeling multivariate signals is challenging due to their long-range temporal dependencies and intricate interactions--both direct and indirect. To confront…

Machine Learning · Computer Science 2023-12-01 Juhyeon Kim , Hyungeun Lee , Seungwon Yu , Ung Hwang , Wooyul Jung , Miseon Park , Kijung Yoon

Multivariate functional data present theoretical and practical complications which are not found in univariate functional data. One of these is a situation where the component functions of multivariate functional data are positive and are…

Methodology · Statistics 2023-03-09 Cody Carroll , Hans-Georg Müller

Modeling multivariate time series has long been a subject that has attracted researchers from a diverse range of fields including economics, finance, and traffic. A basic assumption behind multivariate time series forecasting is that its…

Machine Learning · Computer Science 2020-05-26 Zonghan Wu , Shirui Pan , Guodong Long , Jing Jiang , Xiaojun Chang , Chengqi Zhang

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this…

Machine Learning · Statistics 2025-03-19 Minoru Kusaba , Megumi Iwayama , Ryo Yoshida

Linear Regression and neural networks are widely used to model data. Neural networks distinguish themselves from linear regression with their use of activation functions that enable modeling nonlinear functions. The standard argument for…

Machine Learning · Computer Science 2024-01-02 Anish Lakkapragada

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

Machine Learning · Computer Science 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

Continuous-time series is essential for different modern application areas, e.g. healthcare, automobile, energy, finance, Internet of things (IoT) and other related areas. Different application needs to process as well as analyse a massive…

Machine Learning · Computer Science 2024-09-17 Mansura Habiba , Barak A. Pearlmutter , Mehrdad Maleki

In this paper, we propose two nonparametric methods used in the forecasting of functional time-dependent data, namely functional singular spectrum analysis recurrent forecasting and vector forecasting. Both algorithms utilize the results of…

Machine Learning · Statistics 2021-01-28 Jordan Trinka , Hossein Haghbin , Mehdi Maadooliat

The classical functional linear regression model (FLM) and its extensions, which are based on the assumption that all individuals are mutually independent, have been well studied and are used by many researchers. This independence…

Computation · Statistics 2018-11-02 Tingting Huang , Gilbert Saporta , Huiwen Wang , Shanshan Wang

Regressing a scalar response on a random function is nowadays a common situation. In the nonparametric setting, this paper paves the way for making the local linear regression based on a projection approach a prominent method for solving…

Methodology · Statistics 2019-07-19 Frédéric Ferraty , Stanislav Nagy

We consider a sequence of related multivariate time series learning tasks, such as predicting failures for different instances of a machine from time series of multi-sensor data, or activity recognition tasks over different individuals from…

Machine Learning · Computer Science 2022-03-15 Vibhor Gupta , Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff

Regression models are used in a wide range of applications providing a powerful scientific tool for researchers from different fields. Linear, or simple parametric, models are often not sufficient to describe complex relationships between…

Machine Learning · Statistics 2021-11-24 Aliaksandr Hubin , Geir Storvik , Florian Frommlet

We study a non linear regression model with functional data as inputs and scalar response. We propose a pointwise estimate of the regression function that maps a Hilbert space onto the real line by a local linear method. We provide the…

Statistics Theory · Mathematics 2013-02-20 Alain Berlinet , Abdallah Elamine , André Mas

In this paper, we introduce a novel theoretical framework for multi-task regression, applying random matrix theory to provide precise performance estimations, under high-dimensional, non-Gaussian data distributions. We formulate a…

Recurrent neural networks (RNNs) are state-of-the-art in several sequential learning tasks, but they often require considerable amounts of data to generalise well. For many time series forecasting (TSF) tasks, only a few dozens of…

Machine Learning · Computer Science 2020-03-30 Bernardo Pérez Orozco , Stephen J Roberts

Traditional linear methods for forecasting multivariate time series are not able to satisfactorily model the non-linear dependencies that may exist in non-Gaussian series. We build on the theory of learning vector-valued functions in the…

Machine Learning · Computer Science 2017-06-28 Magda Gregorová , Alexandros Kalousis , Stéphane Marchand-Maillet

Time series analysis faces significant challenges in handling variable-length data and achieving robust generalization. While Transformer-based models have advanced time series tasks, they often struggle with feature redundancy and limited…

Machine Learning · Computer Science 2025-09-23 Kai Zhang , Siming Sun , Zhengyu Fan , Qinmin Yang , Xuejun Jiang

Additive models form a widely popular class of regression models which represent the relation between covariates and response variables as the sum of low-dimensional transfer functions. Besides flexibility and accuracy, a key benefit of…

Machine Learning · Statistics 2015-05-20 Alhussein Fawzi , Mathieu Sinn , Pascal Frossard

In contrast to conventional, univariate analysis, various types of multivariate analysis have been applied to functional magnetic resonance imaging (fMRI) data. In this paper, we compare two contemporary approaches for multivariate…

Applications · Statistics 2018-02-08 Ethan C. Jackson , James Alexander Hughes , Mark Daley

This paper introduces a couple of new time-frequency transforms, designed to adapt their scale to specific features of the analyzed function. Such an adaptation is implemented via so-called focus functions, which control the window scale as…

Classical Analysis and ODEs · Mathematics 2024-06-19 Pierre Warion , Bruno Torrésani