中文
相关论文

相关论文: PatchMixer: A Patch-Mixing Architecture for Long-T…

200 篇论文

Time series forecasting is important across various domains for decision-making. In particular, financial time series such as stock prices can be hard to predict as it is difficult to model short-term and long-term temporal dependencies…

机器学习 · 计算机科学 2023-04-12 Zhen Zeng , Rachneet Kaur , Suchetha Siddagangappa , Saba Rahimi , Tucker Balch , Manuela Veloso

In recent years, the application of transformer-based models in time-series forecasting has received significant attention. While often demonstrating promising results, the transformer architecture encounters challenges in fully exploiting…

机器学习 · 计算机科学 2025-02-12 Artyom Stitsyuk , Jaesik Choi

Convolutional neural networks for visual recognition require large amounts of training samples and usually benefit from data augmentation. This paper proposes PatchMix, a data augmentation method that creates new samples by composing…

计算机视觉与模式识别 · 计算机科学 2022-04-04 Paola Cascante-Bonilla , Arshdeep Sekhon , Yanjun Qi , Vicente Ordonez

With the recent development and advancement of Transformer and MLP architectures, significant strides have been made in time series analysis. Conversely, the performance of Convolutional Neural Networks (CNNs) in time series analysis has…

机器学习 · 计算机科学 2025-03-12 Chenghan Li , Mingchen Li , Ruisheng Diao

Multivariate long-term time series forecasting is critical for applications such as weather prediction, and traffic analysis. In addition, the implementation of Transformer variants has improved prediction accuracy. Following these…

机器学习 · 计算机科学 2025-05-06 Minhyuk Lee , HyeKyung Yoon , MyungJoo Kang

Long-term time series forecasting requires models that simultaneously capture rapid oscillations, medium-range periodicities, and slowly evolving macro-trends from a fixed look-back window. Existing lightweight MLP-based models typically…

机器学习 · 计算机科学 2026-05-18 Ahmed Cherif

Time series forecasting is an important task in many fields ranging from supply chain management to weather forecasting. Recently, Transformer neural network architectures have shown promising results in forecasting on common time series…

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

机器学习 · 计算机科学 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li

Time-series forecasting plays an important role in many real-world scenarios, such as equipment life cycle forecasting, weather forecasting, and traffic flow forecasting. It can be observed from recent research that a variety of…

机器学习 · 计算机科学 2022-06-14 Benhan Li , Shengdong Du , Tianrui Li , Jie Hu , Zhen Jia

Recently, Convolutional Neural Network (CNN) or Transformer architecture based models have been proposed to overcome the limitations of Recurrent Neural Network (RNN) based models in spatiotemporal prediction. These models prevent the…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Hyeonseok Jin

In multivariate time series forecasting, the Transformer architecture encounters two significant challenges: effectively mining features from historical sequences and avoiding overfitting during the learning of temporal dependencies. To…

机器学习 · 计算机科学 2024-04-30 Han Zhou , Yuntian Chen

Analyzing long text data such as customer call transcripts is a cost-intensive and tedious task. Machine learning methods, namely Transformers, are leveraged to model agent-customer interactions. Unfortunately, Transformers adhere to…

计算与语言 · 计算机科学 2025-02-19 Annamalai Senthilnathan , Kristjan Arumae , Mohammed Khalilia , Zhengzheng Xing , Aaron R. Colak

Transformer-based methods have achieved impressive results in time series forecasting. However, existing Transformers still exhibit limitations in sequence modeling as they tend to overemphasize temporal dependencies. This incurs additional…

机器学习 · 计算机科学 2025-12-16 Tan Wang , Yun Wei Dong , Qi Wang

Real-world time-series datasets are often multivariate with complex dynamics. To capture this complexity, high capacity architectures like recurrent- or attention-based sequential deep learning models have become popular. However, recent…

机器学习 · 计算机科学 2023-09-12 Si-An Chen , Chun-Liang Li , Nate Yoder , Sercan O. Arik , Tomas Pfister

Transformers are increasingly adopted for modeling and forecasting time-series, yet their internal mechanisms remain poorly understood from a dynamical systems perspective. In contrast to classical autoregressive and state-space models,…

机器学习 · 计算机科学 2025-12-25 Gregory Duthé , Nikolaos Evangelou , Wei Liu , Ioannis G. Kevrekidis , Eleni Chatzi

This paper presents a hybrid model combining Transformer and CNN for predicting the current waveform in signal lines. Unlike traditional approaches such as current source models, driver linear representations, waveform functional fitting,…

信号处理 · 电气工程与系统科学 2025-06-11 Junlang Huang , Hao Chen , Li Luo , Yong Cai , Lexin Zhang , Tianhao Ma , Yitian Zhang , Zhong Guan

Time series forecasting (TSF) faces challenges in modeling complex intra-channel temporal dependencies and inter-channel correlations. Although recent research has highlighted the efficiency of linear architectures in capturing global…

机器学习 · 计算机科学 2026-01-29 Gawon Lee , Hanbyeol Park , Minseop Kim , Dohee Kim , Hyerim Bae

The classification of time-series data is pivotal for streaming data and comes with many challenges. Although the amount of publicly available datasets increases rapidly, deep neural models are only exploited in a few areas. Traditional…

机器学习 · 计算机科学 2021-09-27 Dominique Mercier , Andreas Dengel , Sheraz Ahmed

Transformer-based models have emerged as promising tools for time series forecasting. However, these model cannot make accurate prediction for long input time series. On the one hand, they failed to capture global dependencies within time…

机器学习 · 计算机科学 2023-08-16 YanJun Zhao , Ziqing Ma , Tian Zhou , Liang Sun , Mengni Ye , Yi Qian

The Transformer model has shown strong performance in multivariate time series forecasting by leveraging channel-wise self-attention. However, this approach lacks temporal constraints when computing temporal features and does not utilize…

机器学习 · 计算机科学 2025-05-06 Shiwei Guo , Ziang Chen , Yupeng Ma , Yunfei Han , Yi Wang