中文
相关论文

相关论文: A temporal scale transformer framework for precise…

200 篇论文

Irregular multivariate time series forecasting (IMTSF) is challenging due to non-uniform sampling and variable asynchronicity. These irregularities violate the equidistant assumptions of standard models, hindering local temporal modeling…

机器学习 · 计算机科学 2026-02-03 Xiangfei Qiu , Kangjia Yan , Xvyuan Liu , Xingjian Wu , Jilin Hu

Deep models have demonstrated remarkable performance in time series forecasting. However, due to the partially-observed nature of real-world applications, solely focusing on the target of interest, so-called endogenous variables, is usually…

机器学习 · 计算机科学 2024-11-12 Yuxuan Wang , Haixu Wu , Jiaxiang Dong , Guo Qin , Haoran Zhang , Yong Liu , Yunzhong Qiu , Jianmin Wang , Mingsheng Long

Recent work has shown that either (1) increasing the input length or (2) increasing model size can improve the performance of Transformer-based neural models. In this paper, we present a new model, called LongT5, with which we explore the…

计算与语言 · 计算机科学 2022-05-04 Mandy Guo , Joshua Ainslie , David Uthus , Santiago Ontanon , Jianmo Ni , Yun-Hsuan Sung , Yinfei Yang

Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a high prediction capacity of the model, which is the ability…

机器学习 · 计算机科学 2021-03-30 Haoyi Zhou , Shanghang Zhang , Jieqi Peng , Shuai Zhang , Jianxin Li , Hui Xiong , Wancai Zhang

Traffic flow forecasting is challenging due to the intricate spatio-temporal correlations in traffic flow data. Existing Transformer-based methods usually treat traffic flow forecasting as multivariate time series (MTS) forecasting.…

机器学习 · 计算机科学 2023-03-15 Junhao Zhang , Junjie Tang , Juncheng Jin , Zehui Qu

Periodicity is a fundamental characteristic of time series data and has long played a central role in forecasting. Recent deep learning methods strengthen the exploitation of periodicity by treating patches as basic tokens, thereby…

机器学习 · 计算机科学 2025-10-07 Yiming Niu , Jinliang Deng , Yongxin Tong

Traditional vision-based autonomous driving systems often face difficulties in navigating complex environments when relying solely on single-image inputs. To overcome this limitation, incorporating temporal data such as past image frames or…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Tuong Do , Binh X. Nguyen , Quang D. Tran , Erman Tjiputra , Te-Chuan Chiu , Anh Nguyen

Transformer-based time series forecasting has recently gained strong interest due to the ability of transformers to model sequential data. Most of the state-of-the-art architectures exploit either temporal or inter-channel dependencies,…

机器学习 · 计算机科学 2025-03-25 Davide Villaboni , Alberto Castellini , Ivan Luciano Danesi , Alessandro Farinelli

Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality…

机器学习 · 计算机科学 2020-01-07 Yuya Jeremy Ong , Mu Qiao , Divyesh Jadav

In the burgeoning ecosystem of Internet of Things, multivariate time series (MTS) data has become ubiquitous, highlighting the fundamental role of time series forecasting across numerous applications. The crucial challenge of long-term MTS…

机器学习 · 计算机科学 2024-11-06 Zhenwei Zhang , Linghang Meng , Yuantao Gu

In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in…

机器学习 · 计算机科学 2024-04-30 Zihan Wang , Fanheng Kong , Shi Feng , Ming Wang , Xiaocui Yang , Han Zhao , Daling Wang , Yifei Zhang

Compared with the vanilla transformer, the window-based transformer offers a better trade-off between accuracy and efficiency. Although the window-based transformer has made great progress, its long-range modeling capabilities are limited…

计算机视觉与模式识别 · 计算机科学 2023-01-04 Jiawei Mao , Yuanqi Chang , Xuesong Yin

Time series forecasting is essential for a wide range of real-world applications. Recent studies have shown the superiority of Transformer in dealing with such problems, especially long sequence time series input(LSTI) and long sequence…

机器学习 · 计算机科学 2022-02-15 Li Shen , Yangzhu Wang

Generative models have gained significant attention in multivariate time series forecasting (MTS), particularly due to their ability to generate high-fidelity samples. Forecasting the probability distribution of multivariate time series is…

机器学习 · 计算机科学 2025-02-13 Shibo Feng , Peilin Zhao , Liu Liu , Pengcheng Wu , Zhiqi Shen

Multivariate long-term time series forecasting is of great application across many domains, such as energy consumption and weather forecasting. With the development of transformer-based methods, the performance of multivariate long-term…

机器学习 · 计算机科学 2023-05-29 Zheng Sun , Yi Wei , Wenxiao Jia , Long Yu

Since its introduction, the transformer has shifted the development trajectory away from traditional models (e.g., RNN, MLP) in time series forecasting, which is attributed to its ability to capture global dependencies within temporal…

机器学习 · 计算机科学 2025-01-07 Xiwen Chen , Peijie Qiu , Wenhui Zhu , Huayu Li , Hao Wang , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

Recent advancements in foundation models for tabular data, such as TabPFN, demonstrated that pretrained Transformer architectures can approximate Bayesian inference with high predictive performance. However, Transformers suffer from…

机器学习 · 计算机科学 2025-12-12 Felix Koch , Marcel Wever , Fabian Raisch , Benjamin Tischler

Sufficiently modeling the correlations among variables (aka channels) is crucial for achieving accurate multivariate time series forecasting (MTSF). In this paper, we propose a novel technique called Temporal Query (TQ) to more effectively…

机器学习 · 计算机科学 2025-09-12 Shengsheng Lin , Haojun Chen , Haijie Wu , Chunyun Qiu , Weiwei Lin

To analyze multivariate time series, most previous methods assume regular subsampling of time series, where the interval between adjacent measurements and the number of samples remain unchanged. Practically, data collection systems could…

机器学习 · 计算机科学 2023-10-18 Yuxi Wei , Juntong Peng , Tong He , Chenxin Xu , Jian Zhang , Shirui Pan , Siheng Chen

Time series data is ubiquitous in research as well as in a wide variety of industrial applications. Effectively analyzing the available historical data and providing insights into the far future allows us to make effective decisions. Recent…

机器学习 · 计算机科学 2022-10-24 Kiran Madhusudhanan , Johannes Burchert , Nghia Duong-Trung , Stefan Born , Lars Schmidt-Thieme