English
Related papers

Related papers: Unify and Anchor: A Context-Aware Transformer for …

200 papers

Time series forecasting is prevalent in extensive real-world applications, such as financial analysis and energy planning. Previous studies primarily focus on time series modality, endeavoring to capture the intricate variations and…

Machine Learning · Computer Science 2024-10-08 Jiaxiang Dong , Haixu Wu , Yuxuan Wang , Li Zhang , Jianmin Wang , Mingsheng Long

Transformer-based architectures have achieved remarkable success in natural language processing and computer vision. However, their performance in multivariate long-term forecasting often falls short compared to simpler linear baselines.…

Machine Learning · Computer Science 2025-07-09 Dizhen Liang

Cross-domain time series forecasting is a valuable task in various web applications. Despite its rapid advancement, achieving effective generalization across heterogeneous time series data remains a significant challenge. Existing methods…

Artificial Intelligence · Computer Science 2025-11-04 Tingyue Pan , Mingyue Cheng , Shilong Zhang , Zhiding Liu , Xiaoyu Tao , Yucong Luo , Jintao Zhang , Qi Liu

Transformer-based models have emerged as powerful tools for multivariate time series forecasting (MTSF). However, existing Transformer models often fall short of capturing both intricate dependencies across variate and temporal dimensions…

Machine Learning · Computer Science 2024-06-10 Juncheng Liu , Chenghao Liu , Gerald Woo , Yiwei Wang , Bryan Hooi , Caiming Xiong , Doyen Sahoo

Artificial Neural Networks (ANNs) are increasingly deployed across diverse real-world settings, where they must operate under data distributions that differ from those seen during training. This challenge is central to Domain Generalization…

Machine Learning · Computer Science 2026-04-07 Jean Erik Delanois , Shruti Joshi , Ryan Golden , Teresa Nick , Maxim Bazhenov

Although Transformer has made breakthrough success in widespread domains especially in Natural Language Processing (NLP), applying it to time series forecasting is still a great challenge. In time series forecasting, the autoregressive…

Machine Learning · Computer Science 2021-06-01 Kai Chen , Guang Chen , Dan Xu , Lijun Zhang , Yuyao Huang , Alois Knoll

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

Non-stationary sequences arise naturally in control, forecasting, and decision-making. The data-generating process shifts at unknown times, and models must detect the change, discard or downweight obsolete evidence, and adapt to new…

Machine Learning · Computer Science 2026-04-21 Carson Dudley , Yutong Bi , Xiaofeng Liu , Samet Oymak

Multivariate time series forecasting plays a pivotal role in contemporary web technologies. In contrast to conventional methods that involve creating dedicated models for specific time series application domains, this research advocates for…

Machine Learning · Computer Science 2024-02-26 Xu Liu , Junfeng Hu , Yuan Li , Shizhe Diao , Yuxuan Liang , Bryan Hooi , Roger Zimmermann

Time series prediction is crucial for understanding and forecasting complex dynamics in various domains, ranging from finance and economics to climate and healthcare. Based on Transformer architecture, one approach involves encoding…

Machine Learning · Computer Science 2024-05-24 Xin Cheng , Xiuying Chen , Shuqi Li , Di Luo , Xun Wang , Dongyan Zhao , Rui Yan

Numerous industrial sectors necessitate models capable of providing robust forecasts across various horizons. Despite the recent strides in crafting specific architectures for time-series forecasting and developing pre-trained universal…

Machine Learning · Computer Science 2024-11-05 Jiawen Zhang , Shun Zheng , Xumeng Wen , Xiaofang Zhou , Jiang Bian , Jia Li

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

Machine Learning · Computer Science 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li

Time series forecasting underpins applications in finance, healthcare, and environmental monitoring. Despite the success of Time Series Foundation Models (TSFMs), existing approaches operate in a unimodal setting and rely on static prompts…

Artificial Intelligence · Computer Science 2026-03-10 Sehyuk Park , Soyeon Caren Han , Eduard Hovy

Time series forecasting is essential for a wide range of real-world applications. Recent studies have shown the superiority of Transformer in dealing with such problems, especially long sequence time series input(LSTI) and long sequence…

Machine Learning · Computer Science 2022-02-15 Li Shen , Yangzhu Wang

We propose semantic anchoring, a unified account of how large language models turn pretrained capacity into goal-directed behavior: external structure (in-context examples, retrieval, or light tuning) binds the model's latent patterns to…

Artificial Intelligence · Computer Science 2025-12-02 Edward Y. Chang , Zeyneb N. Kaya , Ethan Chang

Real-world time series often exhibit complex interdependencies that cannot be captured in isolation. Global models that model past data from multiple related time series globally while producing series-specific forecasts locally are now…

Machine Learning · Computer Science 2024-05-14 Abishek Sriramulu , Christoph Bergmeir , Slawek Smyl

Accurate long-term predictions are the foundations for many machine learning applications and decision-making processes. Traditional time series approaches for prediction often focus on either autoregressive modeling, which relies solely on…

Machine Learning · Computer Science 2025-04-22 Kshitij Tayal , Arvind Renganathan , Xiaowei Jia , Vipin Kumar , Dan Lu

Time series anomaly detection is a challenging task with a wide range of real-world applications. Due to label sparsity, training a deep anomaly detector often relies on unsupervised approaches. Recent efforts have been devoted to time…

Machine Learning · Computer Science 2023-04-18 Kwei-Herng Lai , Lan Wang , Huiyuan Chen , Kaixiong Zhou , Fei Wang , Hao Yang , Xia Hu

The recent breakthrough of Transformers in deep learning has drawn significant attention of the time series community due to their ability to capture long-range dependencies. However, like other deep learning models, Transformers face…

Machine Learning · Computer Science 2024-01-15 Subina Khanal , Seshu Tirupathi , Giulio Zizzo , Ambrish Rawat , Torben Bach Pedersen

Traditional spatiotemporal models generally rely on task-specific architectures, which limit their generalizability and scalability across diverse tasks due to domain-specific design requirements. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Chen Tang , Xinzhu Ma , Encheng Su , Xiufeng Song , Xiaohong Liu , Wei-Hong Li , Lei Bai , Wanli Ouyang , Xiangyu Yue
‹ Prev 1 2 3 10 Next ›