English
Related papers

Related papers: Scalable Transformer for High Dimensional Multivar…

200 papers

The structured time series (STS) classification problem requires the modeling of interweaved spatiotemporal dependency. most previous STS classification methods model the spatial and temporal dependencies independently. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Shuchen Weng , Wenbo Li , Yi Zhang , Siwei Lyu

Multidimensional scaling (MDS) is a popular dimensionality reduction techniques that has been widely used for network visualization and cooperative localization. However, the traditional stress minimization formulation of MDS necessitates…

Optimization and Control · Mathematics 2016-12-22 Ketan Rajawat , Sandeep Kumar

In current research, machine and deep learning solutions for the classification of temporal data are shifting from single-channel datasets (univariate) to problems with multiple channels of information (multivariate). The majority of these…

Machine Learning · Computer Science 2023-04-13 Leonardos Pantiskas , Kees Verstoep , Mark Hoogendoorn , Henri Bal

Recently, diffusion probabilistic models have attracted attention in generative time series forecasting due to their remarkable capacity to generate high-fidelity samples. However, the effective utilization of their strong modeling ability…

Machine Learning · Computer Science 2024-03-19 Xinyao Fan , Yueying Wu , Chang Xu , Yuhao Huang , Weiqing Liu , Jiang Bian

Research on long-term time series prediction has primarily relied on Transformer and MLP models, while the potential of convolutional networks in this domain remains underexplored. To address this, we propose a novel multi-scale time series…

Machine Learning · Computer Science 2025-10-03 Chenghan Li , Mingchen Li , Yipu Liao , Ruisheng Diao

Diffusion models have been used for probabilistic time series forecasting and show strong potential. However, fixed noise schedules often produce intermediate states that are hard to invert and a terminal state that deviates from the near…

Machine Learning · Computer Science 2026-03-03 Jintao Zhang , Zirui Liu , Mingyue Cheng , Xianquan Wang , Zhiding Liu , Qi Liu

Time series forecasting is an important task in many fields ranging from supply chain management to weather forecasting. Recently, Transformer neural network architectures have shown promising results in forecasting on common time series…

Machine Learning · Computer Science 2024-08-08 Rares Cristian , Pavithra Harsha , Clemente Ocejo , Georgia Perakis , Brian Quanz , Ioannis Spantidakis , Hamza Zerhouni

Time series analysis has gained significant attention due to its critical applications in diverse fields such as healthcare, finance, and sensor networks. The complexity and non-stationarity of time series make it challenging to capture the…

Machine Learning · Computer Science 2024-10-31 Guancen Lin , Cong Shen , Aijing Lin

In this paper, we present SSDNet, a novel deep learning approach for time series forecasting. SSDNet combines the Transformer architecture with state space models to provide probabilistic and interpretable forecasts, including trend and…

Machine Learning · Computer Science 2021-12-21 Yang Lin , Irena Koprinska , Mashud Rana

Time Series Anomaly Detection (TSAD) is essential for uncovering rare and potentially harmful events in unlabeled time series data. Existing methods are highly dependent on clean, high-quality inputs, making them susceptible to noise and…

Machine Learning · Computer Science 2025-04-04 Sinchee Chin , Fan Zhang , Xiaochen Yang , Jing-Hao Xue , Wenming Yang , Peng Jia , Guijin Wang , Luo Yingqun

Multivariate time series forecasting with hierarchical structure is widely used in real-world applications, e.g., sales predictions for the geographical hierarchy formed by cities, states, and countries. The hierarchical time series (HTS)…

Machine Learning · Computer Science 2023-10-10 Fan Zhou , Chen Pan , Lintao Ma , Yu Liu , Shiyu Wang , James Zhang , Xinxin Zhu , Xuanwei Hu , Yunhua Hu , Yangfei Zheng , Lei Lei , Yun Hu

Non-stationarity is an intrinsic property of real-world time series and plays a crucial role in time series forecasting. Previous studies primarily adopt instance normalization to attenuate the non-stationarity of original series for better…

Machine Learning · Computer Science 2025-03-05 Tianyu Jia , Zongxia Xie , Yanru Sun , Dilfira Kudrat , Qinghua Hu

Accurate forecasting of long-term time series has important applications for decision making and planning. However, it remains challenging to capture the long-term dependencies in time series data. To better extract long-term dependencies,…

Machine Learning · Computer Science 2024-05-15 Feifei Li , Suhan Guo , Feng Han , Jian Zhao , Furao Shen

High-dimensional time series prediction is needed in applications as diverse as demand forecasting and climatology. Often, such applications require methods that are both highly scalable, and deal with noisy data in terms of corruptions or…

Machine Learning · Computer Science 2016-02-18 Hsiang-Fu Yu , Nikhil Rao , Inderjit S. Dhillon

Traffic flow forecasting is a crucial task in transportation management and planning. The main challenges for traffic flow forecasting are that (1) as the length of prediction time increases, the accuracy of prediction will decrease; (2)…

Artificial Intelligence · Computer Science 2024-05-13 Jianli Xiao , Baichao Long

In practical time series forecasting, covariates provide rich contextual information that can potentially enhance the forecast of target variables. Although some covariates extend into the future forecasting horizon (e.g., calendar events,…

Machine Learning · Computer Science 2025-08-07 Yosuke Yamaguchi , Issei Suemitsu , Wenpeng Wei

3D point cloud segmentation has made tremendous progress in recent years. Most current methods focus on aggregating local features, but fail to directly model long-range dependencies. In this paper, we propose Stratified Transformer that is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Xin Lai , Jianhui Liu , Li Jiang , Liwei Wang , Hengshuang Zhao , Shu Liu , Xiaojuan Qi , Jiaya Jia

Modeling neural population dynamics underlying noisy single-trial spiking activities is essential for relating neural observation and behavior. A recent non-recurrent method - Neural Data Transformers (NDT) - has shown great success in…

Neurons and Cognition · Quantitative Biology 2022-06-13 Trung Le , Eli Shlizerman

Traffic forecasting, which benefits from mobile Internet development and position technologies, plays a critical role in Intelligent Transportation Systems. It helps to implement rich and varied transportation applications and bring…

Machine Learning · Computer Science 2023-10-26 Chengzhi Yao , Zhi Li , Junbo Wang

Recently, channel-independent methods have achieved state-of-the-art performance in multivariate time series (MTS) forecasting. Despite reducing overfitting risks, these methods miss potential opportunities in utilizing channel dependence…

Machine Learning · Computer Science 2024-08-14 Lifan Zhao , Yanyan Shen