English
Related papers

Related papers: Transparent Networks for Multivariate Time Series

200 papers

Irregularly-sampled time series occur in many domains including healthcare. They can be challenging to model because they do not naturally yield a fixed-dimensional representation as required by many standard machine learning models. In…

Machine Learning · Computer Science 2020-08-19 Steven Cheng-Xian Li , Benjamin M. Marlin

Many real-world complex systems, such as epidemic spreading networks and ecosystems, can be modeled as networked dynamical systems that produce multivariate time series. Learning the intrinsic dynamics from observational data is pivotal for…

Machine Learning · Computer Science 2024-12-30 Yanna Ding , Zijie Huang , Malik Magdon-Ismail , Jianxi Gao

Foundation models have achieved remarkable success across diverse machine-learning domains through large-scale pretraining on large, diverse datasets. However, pretraining on such datasets introduces significant challenges due to…

Machine Learning · Computer Science 2025-04-16 Peiliang Gong , Emadeldeen Eldele , Min Wu , Zhenghua Chen , Xiaoli Li , Daoqiang Zhang

Time series forecasting is an important problem across many domains, playing a crucial role in multiple real-world applications. In this paper, we propose a forecasting architecture that combines deep autoregressive models with a Spectral…

Machine Learning · Statistics 2021-12-28 Fernando Moreno-Pino , Pablo M. Olmos , Antonio Artés-Rodríguez

The prediction of periodical time-series remains challenging due to various types of data distortions and misalignments. Here, we propose a novel model called Temporal embedding-enhanced convolutional neural Network (TeNet) to learn…

Machine Learning · Computer Science 2022-02-09 Jiajun Liu , Kun Zhao , Brano Kusy , Ji-rong Wen , Raja Jurdak

High-dimensional time series are common in many domains. Since human cognition is not optimized to work well in high-dimensional spaces, these areas could benefit from interpretable low-dimensional representations. However, most…

Machine Learning · Computer Science 2019-01-07 Vincent Fortuin , Matthias Hüser , Francesco Locatello , Heiko Strathmann , Gunnar Rätsch

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

Generating high-quality synthetic time series is a fundamental yet challenging task across domains such as forecasting and anomaly detection, where real data can be scarce, noisy, or costly to collect. Unlike static data generation,…

Machine Learning · Computer Science 2025-09-25 MohammadReza EskandariNasab , Shah Muhammad Hamdi , Soukaina Filali Boubrahimi

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

Machine Learning · Computer Science 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

Deep learning is a popular machine learning approach which has achieved a lot of progress in all traditional machine learning areas. Internet of thing (IoT) and Smart City deployments are generating large amounts of time-series sensor data…

Networking and Internet Architecture · Computer Science 2021-04-15 Xiaofeng Xie , Di Wu , Siping Liu , Renfa Li

Predictive analytics aims to build machine learning models to predict behavior patterns and use predictions to guide decision-making. Predictive analytics is human involved, thus the machine learning model is preferred to be interpretable.…

Machine Learning · Computer Science 2023-03-14 Yuanyuan Jiang , Rui Ding , Tianchi Qiao , Yunan Zhu , Shi Han , Dongmei Zhang

In a dynamic network, the neighborhood of the vertices evolve across different temporal snapshots of the network. Accurate modeling of this temporal evolution can help solve complex tasks involving real-life social and interaction networks.…

Social and Information Networks · Computer Science 2018-04-17 Tanay Kumar Saha , Thomas Williams , Mohammad Al Hasan , Shafiq Joty , Nicholas K. Varberg

Irregularly sampled time series are increasingly prevalent, particularly in medical domains. While various specialized methods have been developed to handle these irregularities, effectively modeling their complex dynamics and pronounced…

Machine Learning · Computer Science 2023-11-01 Zekun Li , Shiyang Li , Xifeng Yan

In this paper, we introduce TimeGPT, the first foundation model for time series, capable of generating accurate predictions for diverse datasets not seen during training. We evaluate our pre-trained model against established statistical,…

Machine Learning · Computer Science 2024-05-29 Azul Garza , Cristian Challu , Max Mergenthaler-Canseco

Sparse generalized additive models (GAMs) are an extension of sparse generalized linear models which allow a model's prediction to vary non-linearly with an input variable. This enables the data analyst build more accurate models,…

Methodology · Statistics 2020-01-15 J. Kenneth Tay , Robert Tibshirani

Recent strides in interpretable machine learning (ML) research reveal that models exploit undesirable patterns in the data to make predictions, which potentially causes harms in deployment. However, it is unclear how we can fix these…

Inspired by the success of large language models (LLMs) in natural language processing, recent research has explored the building of time series foundation models and applied them to tasks such as forecasting, classification, and anomaly…

Machine Learning · Computer Science 2025-06-04 Chihiro Maru , Shoetsu Sato

Partial Differential Equations are infinite dimensional encoded representations of physical processes. However, imbibing multiple observation data towards a coupled representation presents significant challenges. We present a fully…

Machine Learning · Computer Science 2020-03-09 Gurpreet Singh , Soumyajit Gupta , Matt Lease , Clint N. Dawson

Deep learning has made significant advances in creating efficient representations of time series data by automatically identifying complex patterns. However, these approaches lack interpretability, as the time series is transformed into a…

Machine Learning · Computer Science 2023-10-26 Etienne Le Naour , Ghislain Agoua , Nicolas Baskiotis , Vincent Guigue

Temporal domain generalization is a promising yet extremely challenging area where the goal is to learn models under temporally changing data distributions and generalize to unseen data distributions following the trends of the change. The…

Machine Learning · Computer Science 2023-02-13 Guangji Bai , Chen Ling , Liang Zhao