English
Related papers

Related papers: Enhancing Transformer Efficiency for Multivariate …

200 papers

Scaling laws motivate the development of Time Series Foundation Models (TSFMs) that pre-train vast parameters and achieve remarkable zero-shot forecasting performance. Surprisingly, even after fine-tuning, TSFMs cannot consistently…

Machine Learning · Computer Science 2025-12-23 Lifan Zhao , Yanyan Shen , Zhaoyang Liu , Xue Wang , Jiaji Deng

Recently, Transformer-base models have made significant progress in the field of time series prediction which have achieved good results and become baseline models beyond Dlinear. The paper proposes an U-Net time series prediction model…

Machine Learning · Computer Science 2024-06-07 Li Chu , Xiao Bingjia , Yuan Qiping

Time series analysis has gained significant attention due to its critical applications in diverse fields such as healthcare, finance, and sensor networks. The complexity and non-stationarity of time series make it challenging to capture the…

Machine Learning · Computer Science 2024-10-31 Guancen Lin , Cong Shen , Aijing Lin

Temporal Convolutional Networks (TCNs) are promising Deep Learning models for time-series processing tasks. One key feature of TCNs is time-dilated convolution, whose optimization requires extensive experimentation. We propose an automatic…

We propose an efficient design of Transformer-based models for multivariate time series forecasting and self-supervised representation learning. It is based on two key components: (i) segmentation of time series into subseries-level patches…

Machine Learning · Computer Science 2023-03-07 Yuqi Nie , Nam H. Nguyen , Phanwadee Sinthong , Jayant Kalagnanam

Although multi-task deep neural network (DNN) models have computation and storage benefits over individual single-task DNN models, they can be further optimized via model compression. Numerous structured pruning methods are already…

Machine Learning · Computer Science 2023-04-17 Siddhant Garg , Lijun Zhang , Hui Guan

Due to the sweeping digitalization of processes, increasingly vast amounts of time series data are being produced. Accurate classification of such time series facilitates decision making in multiple domains. State-of-the-art classification…

Machine Learning · Computer Science 2023-08-08 David Campos , Miao Zhang , Bin Yang , Tung Kieu , Chenjuan Guo , Christian S. Jensen

Performance optimization of deep learning models is conducted either manually or through automatic architecture search, or a combination of both. On the other hand, their performance strongly depends on the target hardware and how…

Machine Learning · Computer Science 2022-09-23 Vahid Partovi Nia , Alireza Ghaffari , Mahdi Zolnouri , Yvon Savaria

Multivariate time series forecasting has seen widely ranging applications in various domains, including finance, traffic, energy, and healthcare. To capture the sophisticated temporal patterns, plenty of research studies designed complex…

Machine Learning · Computer Science 2022-07-05 Tianping Zhang , Yizhuo Zhang , Wei Cao , Jiang Bian , Xiaohan Yi , Shun Zheng , Jian Li

The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the…

Machine Learning · Computer Science 2023-11-01 Liyilei Su , Xumin Zuo , Rui Li , Xin Wang , Heng Zhao , Bingding Huang

Irregular multivariate time series (IMTS) is characterized by the lack of synchronized observations across its different channels. In this paper, we point out that this channel-wise asynchrony can lead to poor channel-wise modeling of…

Machine Learning · Computer Science 2025-09-23 Shuhan Zhong , Weipeng Zhuo , Sizhe Song , Guanyao Li , Zhongyi Yu , S. -H. Gary Chan

Pre-trained models exhibit strong generalization to various downstream tasks. However, given the numerous models available in the model hub, identifying the most suitable one by individually fine-tuning is time-consuming. In this paper, we…

Machine Learning · Computer Science 2026-03-10 Tengxue Zhang , Biao Ouyang , Yang Shu , Xinyang Chen , Chenjuan Guo , Bin Yang

Time series forecasting plays an increasingly important role in modern business decisions. In today's data-rich environment, people often aim to choose the optimal forecasting model for their data. However, identifying the optimal model…

Applications · Statistics 2021-12-17 Xixi Li , Fotios Petropoulos , Yanfei Kang

Time series classification is an important analytical task across diverse domains. However, its practical application is often hindered by the scarcity of labeled data and the requirement for substantial computational resources. To address…

Machine Learning · Computer Science 2026-04-29 Xuanhao Yang , Bing Xue , Mengjie Zhang

Correlations in streams of multivariate time series data means that typically, only a small subset of the features are required for a given data mining task. In this paper, we propose a technique which we call Merit Score for Time-Series…

Machine Learning · Computer Science 2021-12-08 Bahavathy Kathirgamanathan , Padraig Cunningham

This article investigates the use of Machine Learning and Deep Learning models in multivariate time series analysis within financial markets. It compares small and big data approaches, focusing on their distinct challenges and the benefits…

Machine Learning · Computer Science 2025-05-09 Grégory Bournassenko

Real-world time series typically exhibit complex temporal variations, making the time series classification task notably challenging. Recent advancements have demonstrated the potential of multi-scale analysis approaches, which provide an…

Artificial Intelligence · Computer Science 2025-07-25 Zhipeng Liu , Peibo Duan , Binwu Wang , Xuan Tang , Qi Chu , Changsheng Zhang , Yongsheng Huang , Bin Zhang

Multivariate time series forecasting is crucial across various industries, where accurate extraction of complex periodic and trend components can significantly enhance prediction performance. However, existing models often struggle to…

Machine Learning · Computer Science 2025-05-08 Yulong Wang , Yushuo Liu , Xiaoyi Duan , Kai Wang

Exploring deep convolutional neural networks of high efficiency and low memory usage is very essential for a wide variety of machine learning tasks. Most of existing approaches used to accelerate deep models by manipulating parameters or…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Chuanjian Liu , Yunhe Wang , Kai Han , Chunjing Xu , Chang Xu

Accuracy is a key focus of current work in time series classification. However, speed and data reduction in many applications is equally important, especially when the data scale and storage requirements increase rapidly. Current MTSC…

Machine Learning · Computer Science 2022-12-06 Bhaskar Dhariyal , Thach Le Nguyen , Georgiana Ifrim