English
Related papers

Related papers: SLANTS: Sequential Adaptive Nonlinear Modeling of …

200 papers

On-line detection of anomalies in time series is a key technique used in various event-sensitive scenarios such as robotic system monitoring, smart sensor networks and data center security. However, the increasing diversity of data sources…

Machine Learning · Computer Science 2021-04-26 Wentai Wu , Ligang He , Weiwei Lin , Yi Su , Yuhua Cui , Carsten Maple , Stephen Jarvis

We propose an approach for fitting linear regression models that splits the set of covariates into groups. The optimal split of the variables into groups and the regularized estimation of the regression coefficients are performed by…

Methodology · Statistics 2019-12-13 Anthony Christidis , Ruben Zamar , Laks V. S. Lakshmanan , Ezequiel Smucler

We present a novel adaptive random subspace learning algorithm (RSSL) for prediction purpose. This new framework is flexible where it can be adapted with any learning technique. In this paper, we tested the algorithm for regression and…

Machine Learning · Computer Science 2015-02-10 Mohamed Elshrif , Ernest Fokoue

We propose a deep neural network (DNN) based least distance (LD) estimator (DNN-LD) for a multivariate regression problem, addressing the limitations of the conventional methods. Due to the flexibility of a DNN structure, both linear and…

Methodology · Statistics 2024-01-09 Jungmin Shin , Seung Jun Shin , Sungwan Bang

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

Multivariate time-series data are frequently observed in critical care settings and are typically characterized by sparsity (missing information) and irregular time intervals. Existing approaches for learning representations in this domain…

Machine Learning · Computer Science 2022-02-17 Sindhu Tipirneni , Chandan K. Reddy

The identification of a linear system model from data has wide applications in control theory. The existing work that provides finite sample guarantees for linear system identification typically uses data from a single long system…

Machine Learning · Statistics 2025-05-09 Lei Xin , Baike She , Qi Dou , George Chiu , Shreyas Sundaram

We consider nonlinear mixed effects models including high-dimensional covariates to model individual parameters variability. The objective is to identify relevant covariates among a large set under sparsity assumption and to estimate model…

Statistics Theory · Mathematics 2025-08-06 Antoine Caillebotte , Estelle Kuhn , Sarah Lemler

We present an estimation procedure for nonlinear mixed-effects models in which the population trajectory is represented by penalized splines and adapted to individuals via subject-specific transformation parameters. By exploiting the mixed…

Methodology · Statistics 2026-03-13 Matteo D'Alessandro , Magne Thoresen , Øystein Sørensen

Recent advancements in recurrent neural network (RNN) research have demonstrated the superiority of utilizing multiscale structures in learning temporal representations of time series. Currently, most of multiscale RNNs use fixed scales,…

Machine Learning · Computer Science 2019-02-18 Hao Hu , Liqiang Wang , Guo-Jun Qi

This paper develops a new framework, called modular regression, to utilize auxiliary information -- such as variables other than the original features or additional data sets -- in the training process of linear models. At a high level, our…

Methodology · Statistics 2023-11-27 Ying Jin , Dominik Rothenhäusler

Recent advances in digitization have led to the availability of multivariate time series data in various domains, enabling real-time monitoring of operations. Identifying abnormal data patterns and detecting potential failures in these…

Machine Learning · Computer Science 2023-10-10 Fan Wang , Keli Wang , Boyu Yao

Recurrent Neural Networks (RNNs) are widely used for sequential processing but face fundamental limitations with continual inference due to state saturation, requiring disruptive hidden state resets. However, reset-based methods impose…

Machine Learning · Computer Science 2024-12-23 Bojian Yin , Federico Corradi

A method is proposed to generate an optimal fit of a number of connected linear trend segments onto time-series data. To be able to efficiently handle many lines, the method employs a stochastic search procedure to determine optimal…

Quantitative Methods · Quantitative Biology 2017-04-11 Myrl G. Marmarelis

This paper focuses on developing a method to obtain an uncertain linear fractional transformation (LFT) system that adequately captures the dynamics of a nonlinear time-invariant system over some desired envelope. First, the nonlinear…

Systems and Control · Electrical Eng. & Systems 2023-05-02 Sourav Sinha , Devaprakash Muniraj , Mazen Farhood

A method for nonlinear topology identification is proposed, based on the assumption that a collection of time series are generated in two steps: i) a vector autoregressive process in a latent space, and ii) a nonlinear, component-wise,…

Signal Processing · Electrical Eng. & Systems 2021-07-02 Luis Miguel Lopez-Ramos , Kevin Roy , Baltasar Beferull-Lozano

Despite increasing accessibility to function data, effective methods for flexibly estimating underlying functional trend are still scarce. We thereby develop functional version of trend filtering for estimating trend of functional data…

Methodology · Statistics 2022-02-22 Tomoya Wakayama , Shonosuke Sugasawa

This study introduces a novel formulation to enhance Support Vector Machines (SVMs) in handling class imbalance and noise. Unlike the conventional Soft Margin SVM, which penalizes the magnitude of constraint violations, the proposed model…

Machine Learning · Computer Science 2025-03-20 Seyed Mojtaba Mohasel , Hamidreza Koosha

We define a SDP framework based on the RLSTD algorithm and multivariate simplex B-splines. We introduce a local forget factor capable of preserving the continuity of the simplex splines. This local forget factor is integrated with the RLSTD…

Machine Learning · Computer Science 2016-07-01 Willem Eerland , Coen de Visser , Erik-Jan van Kampen

Multivariate time-series (MTS) forecasting is a paramount and fundamental problem in many real-world applications. The core issue in MTS forecasting is how to effectively model complex spatial-temporal patterns. In this paper, we develop a…

Machine Learning · Computer Science 2024-02-16 Jinliang Deng , Xiusi Chen , Renhe Jiang , Du Yin , Yi Yang , Xuan Song , Ivor W. Tsang