English
Related papers

Related papers: Channel, Trend and Periodic-Wise Representation Le…

200 papers

Deep learning (DL) approaches are being increasingly used for time-series forecasting, with many efforts devoted to designing complex DL models. Recent studies have shown that the DL success is often attributed to effective data…

Human-Computer Interaction · Computer Science 2023-07-28 Jianing Hao , Qing Shi , Yilin Ye , Wei Zeng

Among the existing Transformer-based multivariate time series forecasting methods, iTransformer, which treats each variable sequence as a token and only explicitly extracts cross-variable dependencies, and PatchTST, which adopts a…

Machine Learning · Computer Science 2025-01-08 Liyang Qin , Xiaoli Wang , Chunhua Yang , Huaiwen Zou , Haochuan Zhang

The massive generation of time-series data by largescale Internet of Things (IoT) devices necessitates the exploration of more effective models for multivariate time-series forecasting. In previous models, there was a predominant use of the…

Machine Learning · Computer Science 2024-03-15 Wenyong Han , Tao Zhu Member , Liming Chen , Huansheng Ning , Yang Luo , Yaping Wan

Time series forecasting is a critical task across domains such as energy, finance, and meteorology, where accurate predictions enable informed decision-making. While transformer-based and large-parameter models have recently achieved…

Machine Learning · Computer Science 2026-02-11 Julien Guité-Vinet , Alexandre Blondin Massé , Éric Beaudry

Traffic forecasting is important in intelligent transportation systems of webs and beneficial to traffic safety, yet is very challenging because of the complex and dynamic spatio-temporal dependencies in real-world traffic systems. Prior…

Machine Learning · Computer Science 2021-12-07 Yuchen Fang , Yanjun Qin , Haiyong Luo , Fang Zhao , Liang Zeng , Bo Hui , Chenxing Wang

Supervised (pre-)training currently yields state-of-the-art performance for representation learning for visual recognition, yet it comes at the cost of (1) intensive manual annotations and (2) an inherent restriction in the scope of data…

Computer Vision and Pattern Recognition · Computer Science 2016-12-05 Ruohan Gao , Dinesh Jayaraman , Kristen Grauman

Multivariate time series forecasting (MTSF) plays a vital role in a wide range of real-world applications, such as weather prediction and traffic flow forecasting. Although recent advances have significantly improved the modeling of…

Machine Learning · Computer Science 2025-10-03 Beiliang Wu , Peiyuan Liu , Yifan Hu , Luyan Zhang , Ao Hu , Zenglin Xu

Recent state-of-the-art forecasting methods are trained on collections of time series. These methods, often referred to as global models, can capture common patterns in different time series to improve their generalization performance.…

Machine Learning · Computer Science 2024-04-30 Vitor Cerqueira , Nuno Moniz , Ricardo Inácio , Carlos Soares

Sensor-based human activity recognition is important in daily scenarios such as smart healthcare and homes due to its non-intrusive privacy and low cost advantages, but the problem of out-of-domain generalization caused by differences in…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Jianguo Pan , Zhengxin Hu , Lingdun Zhang , Xia Cai

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

Machine Learning · Computer Science 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan

Continuous Sign Language Recognition (CSLR) is a challenging research task due to the lack of accurate annotation on the temporal sequence of sign language data. The recent popular usage is a hybrid model based on "CNN + RNN" for CSLR.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Qidan Zhu , Jing Li , Fei Yuan , Quan Gan

With the growing availability of multi-domain time series data, there is an increasing demand for general forecasting models pre-trained on multi-source datasets to support diverse downstream prediction scenarios. Existing time series…

Machine Learning · Computer Science 2025-09-09 Yihang Wang , Yuying Qiu , Peng Chen , Kai Zhao , Yang Shu , Zhongwen Rao , Lujia Pan , Bin Yang , Chenjuan Guo

Long-term time series forecasting (LTSF) is hampered by the challenge of modeling complex dependencies that span multiple temporal scales and frequency resolutions. Existing methods, including Transformer and MLP-based models, often…

Machine Learning · Computer Science 2025-09-22 Qianyang Li , Xingjun Zhang , Shaoxun Wang , Jia Wei

Traffic flow forecasting is considered a critical task in the field of intelligent transportation systems. In this paper, to address the issue of low accuracy in long-term forecasting of spatial-temporal big data on traffic flow, we propose…

Machine Learning · Computer Science 2024-07-17 Baichao Long , Wang Zhu , Jianli Xiao

Predicting multivariate time series is crucial, demanding precise modeling of intricate patterns, including inter-series dependencies and intra-series variations. Distinctive trend characteristics in each time series pose challenges, and…

Machine Learning · Computer Science 2024-07-08 Guoqi Yu , Jing Zou , Xiaowei Hu , Angelica I. Aviles-Rivero , Jing Qin , Shujun Wang

The quality of data representation in deep learning methods is directly related to the prior model imposed on the representations; however, generally used fixed priors are not capable of adjusting to the context in the data. To address this…

Machine Learning · Computer Science 2013-03-18 Rakesh Chalasani , Jose C. Principe

Various deep learning models, especially some latest Transformer-based approaches, have greatly improved the state-of-art performance for long-term time series forecasting.However, those transformer-based models suffer a severe…

Machine Learning · Computer Science 2022-06-27 Tian Zhou , Jianqing Zhu , Xue Wang , Ziqing Ma , Qingsong Wen , Liang Sun , Rong Jin

Evolving networks are complex data structures that emerge in a wide range of systems in science and engineering. Learning expressive representations for such networks that encode their structural connectivity and temporal evolution is…

Machine Learning · Computer Science 2024-08-26 Amirhossein Nouranizadeh , Fatemeh Tabatabaei Far , Mohammad Rahmati

Recent deep learning models for Long-term Time Series Forecasting (LTSF) often emphasize complex, handcrafted designs, while simpler architectures like linear models or MLPs have often outperformed these intricate solutions. In this paper,…

Machine Learning · Computer Science 2025-05-26 Yihang Lu , Yangyang Xu , Qitao Qing , Xianwei Meng

Time-series data exists in every corner of real-world systems and services, ranging from satellites in the sky to wearable devices on human bodies. Learning representations by extracting and inferring valuable information from these time…

Machine Learning · Computer Science 2026-05-19 Patara Trirat , Yooju Shin , Junhyeok Kang , Youngeun Nam , Jihye Na , Minyoung Bae , Joeun Kim , Byunghyun Kim , Jae-Gil Lee