中文
相关论文

相关论文: TimeMachine: A Time Series is Worth 4 Mambas for L…

200 篇论文

Long-short range time series forecasting is essential for predicting future trends and patterns over extended periods. While deep learning models such as Transformers have made significant strides in advancing time series forecasting, they…

机器学习 · 计算机科学 2024-09-16 Wenqing Zhang , Junming Huang , Ruotong Wang , Changsong Wei , Wenqian Huang , Yuxin Qiao

Multivariate Time series forecasting is crucial in domains such as transportation, meteorology, and finance, especially for predicting extreme weather events. State-of-the-art methods predominantly rely on Transformer architectures, which…

机器学习 · 计算机科学 2024-10-16 Li Wu , Wenbin Pei , Jiulong Jiao , Qiang Zhang

Long-term time series forecasting (LTSF) provides longer insights into future trends and patterns. Over the past few years, deep learning models especially Transformers have achieved advanced performance in LTSF tasks. However, LTSF faces…

机器学习 · 计算机科学 2024-06-28 Aobo Liang , Xingguo Jiang , Yan Sun , Xiaohou Shi , Ke Li

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing…

机器学习 · 计算机科学 2026-05-15 Xingsheng Chen , Xianpei Mu , Deyu Yi , Yilin Yuan , Xingwei He , Bo Gao , Regina Zhang , Pietro Lio , Siu-Ming Yiu

Recent advancements in multivariate time series forecasting have been propelled by Linear-based, Transformer-based, and Convolution-based models, with Transformer-based architectures gaining prominence for their efficacy in temporal and…

机器学习 · 计算机科学 2024-09-27 Chaolv Zeng , Zhanyu Liu , Guanjie Zheng , Linghe Kong

The problem of Time-series Forecasting is generally addressed by recurrent, Transformer-based and the recently proposed Mamba-based architectures. However, existing architectures generally process their input at a single temporal scale,…

机器学习 · 计算机科学 2026-03-06 Yusuf Meric Karadag , Ismail Talaz , Ipek Gursel Dino , Sinan Kalkan

In multivariate time-series forecasting (MTSF), extracting the temporal correlations of the input sequences is crucial. While popular Transformer-based predictive models can perform well, their quadratic computational complexity results in…

机器学习 · 计算机科学 2024-07-23 Shusen Ma , Yu Kang , Peng Bai , Yun-Bo Zhao

Time series forecasting requires balancing short-term and long-term dependencies for accurate predictions. Existing methods mainly focus on long-term dependency modeling, neglecting the complexities of short-term dynamics, which may hinder…

机器学习 · 计算机科学 2024-08-29 Sijia Peng , Yun Xiong , Yangyong Zhu , Zhiqiang Shen

In long-term time series forecasting, different variables often influence the target variable over distinct time intervals, a challenge known as the multi-delay issue. Traditional models typically process all variables or time points…

机器学习 · 计算机科学 2025-05-28 Xiaowen Ma , Zhenliang Ni , Shuai Xiao , Xinghao Chen

Modern multivariate time series forecasting primarily relies on two architectures: the Transformer with attention mechanism and Mamba. In natural language processing, an approach has been used that combines local window attention for…

机器学习 · 计算机科学 2025-09-26 Itay Katav , Aryeh Kontorovich

Time-series forecasting has seen significant advancements with the introduction of token prediction mechanisms such as multi-head attention. However, these methods often struggle to achieve the same performance as in language modeling,…

机器学习 · 计算机科学 2024-12-03 Panayiotis Christou , Shichu Chen , Xupeng Chen , Parijat Dube

In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in…

机器学习 · 计算机科学 2024-04-30 Zihan Wang , Fanheng Kong , Shi Feng , Ming Wang , Xiaocui Yang , Han Zhao , Daling Wang , Yifei Zhang

In multivariate time series forecasting (MTSF), existing strategies for processing sequences are typically categorized as channel-independent and channel-mixing. The former treats all temporal information of each variable as a token,…

人工智能 · 计算机科学 2025-07-08 Bing Fan , Shusen Ma , Yun-Bo Zhao , Yu Kang

Time series foundation models have demonstrated strong performance in zero-shot learning, making them well-suited for predicting rapidly evolving patterns in real-world applications where relevant training data are scarce. However, most of…

机器学习 · 计算机科学 2024-11-06 Haoyu Ma , Yushu Chen , Wenlai Zhao , Jinzhe Yang , Yingsheng Ji , Xinghua Xu , Xiaozhu Liu , Hao Jing , Shengzhuo Liu , Guangwen Yang

In recent years, Transformers have become the de-facto architecture for long-term sequence forecasting (LTSF), but faces challenges such as quadratic complexity and permutation invariant bias. A recent model, Mamba, based on selective state…

机器学习 · 计算机科学 2024-05-28 Xiuding Cai , Yaoyao Zhu , Xueyao Wang , Yu Yao

This paper introduces Mamba4Cast, a zero-shot foundation model for time series forecasting. Based on the Mamba architecture and inspired by Prior-data Fitted Networks (PFNs), Mamba4Cast generalizes robustly across diverse time series tasks…

机器学习 · 计算机科学 2024-10-15 Sathya Kamesh Bhethanabhotla , Omar Swelam , Julien Siems , David Salinas , Frank Hutter

State Space Models (SSMs), particularly Mamba, have shown potential in long-term time series forecasting. However, existing Mamba-based architectures often struggle with datasets characterized by non-stationary patterns. A key observation…

机器学习 · 计算机科学 2026-02-11 Ruxuan Chen , Fang Sun

State space models, such as Mamba, have recently garnered attention in time series forecasting due to their ability to capture sequence patterns. However, in electricity consumption benchmarks, Mamba forecasts exhibit a mean error of…

机器学习 · 统计学 2025-07-08 Pedro Pessoa , Paul Campitelli , Douglas P. Shepherd , S. Banu Ozkan , Steve Pressé

Time series forecasting has made significant advances, including with Transformer-based models. The attention mechanism in Transformer effectively captures temporal dependencies by attending to all past inputs simultaneously. However, its…

机器学习 · 计算机科学 2025-11-04 Xiongxiao Xu , Canyu Chen , Yueqing Liang , Baixiang Huang , Guangji Bai , Liang Zhao , Kai Shu

The electricity sector is undergoing substantial transformations due to the rising electrification of demand, enhanced integration of renewable energy resources, and the emergence of new technologies. These changes are rendering the…

机器学习 · 计算机科学 2025-12-23 Ali Menati , Fatemeh Doudi , Dileep Kalathil , Le Xie
‹ 上一页 1 2 3 10 下一页 ›