English
Related papers

Related papers: KARMA: A Multilevel Decomposition Hybrid Mamba Fra…

200 papers

Research on long-term time series prediction has primarily relied on Transformer and MLP models, while the potential of convolutional networks in this domain remains underexplored. To address this, we propose a novel multi-scale time series…

Machine Learning · Computer Science 2025-10-03 Chenghan Li , Mingchen Li , Yipu Liao , Ruisheng Diao

Channel prediction is a key technology for improving the performance of various functions such as precoding, adaptive modulation, and resource allocation in MIMO-OFDM systems. Especially in high-mobility scenarios with fast time-varying…

Signal Processing · Electrical Eng. & Systems 2025-12-19 Sheng Luo , Jiashu Xie , Yueling Che , Junmei Yao , Jian Tian , Daquan Feng , Kaishun Wu

For multivariate time series (MTS) tasks, previous state space models (SSMs) followed the modeling paradigm of Transformer-based methods. However, none of them explicitly model the complex dependencies of MTS: the Channel Dependency…

Machine Learning · Computer Science 2024-10-02 Haixiang Wu

Recent Transformer-based diffusion models have shown remarkable performance, largely attributed to the ability of the self-attention mechanism to accurately capture both global and local contexts by computing all-pair interactions among…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Yunxiang Fu , Chaoqi Chen , Yizhou Yu

Producing probabilistic forecasts for large collections of similar and/or dependent time series is a practically relevant and challenging task. Classical time series models fail to capture complex patterns in the data, and multivariate…

Machine Learning · Statistics 2019-05-30 Yuyang Wang , Alex Smola , Danielle C. Maddix , Jan Gasthaus , Dean Foster , Tim Januschowski

Existing models for high-dimensional time series are overwhelmingly developed within the finite-order vector autoregressive (VAR) framework. However, the more flexible vector autoregressive moving averages (VARMA) have been much less…

Methodology · Statistics 2025-05-01 Feiqing Huang , Kexin Lu , Yao Zheng

Image restoration requires simultaneously preserving fine-grained local structures and maintaining long-range spatial coherence. While convolutional networks struggle with limited receptive fields, and Transformers incur quadratic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mohammed Hassanin , Nour Moustafa , Weijian Deng , Ibrahim Radwan

Time introduces fundamental challenges in model development and deployment: models are usually trained on historical data while deployed on future data where semantic distributions and domain knowledge may evolve. Unfortunately, existing…

Computation and Language · Computer Science 2026-04-27 Weisi Liu , Guangzeng Han , Xiaolei Huang

Time series data is a key element of big data analytics, commonly found in domains such as finance, healthcare, climate forecasting, and transportation. In large scale real world settings, such data is often high dimensional and…

Machine Learning · Computer Science 2025-08-14 Younghwi Kim , Dohee Kim , Joongrock Kim , Sunghyun Sim

Time series forecasting has attracted significant attention, leading to the de-velopment of a wide range of approaches, from traditional statistical meth-ods to advanced deep learning models. Among them, the Auto-Regressive Integrated…

Machine Learning · Computer Science 2025-05-28 Thanh Son Nguyen , Van Thanh Nguyen , Dang Minh Duc Nguyen

High-definition (HD) maps are essential for autonomous driving, as they provide precise road information for downstream tasks. Recent advances highlight the potential of temporal modeling in addressing challenges like occlusions and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Ruizi Yang , Xiaolu Liu , Junbo Chen , Jianke Zhu

Recent studies have demonstrated the great power of Transformer models for time series forecasting. One of the key elements that lead to the transformer's success is the channel-independent (CI) strategy to improve the training robustness.…

Machine Learning · Computer Science 2024-02-19 Wang Xue , Tian Zhou , Qingsong Wen , Jinyang Gao , Bolin Ding , Rong Jin

Mamba, a recent selective structured state space model, excels in long sequence modeling, which is vital in the large model era. Long sequence modeling poses significant challenges, including capturing long-range dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Rui Xu , Shu Yang , Yihui Wang , Yu Cai , Bo Du , Hao Chen

Time Series Alignment is a critical task in signal processing with numerous real-world applications. In practice, signals often exhibit temporal shifts and scaling, making classification on raw data prone to errors. This paper introduces a…

Machine Learning · Computer Science 2025-02-27 Alireza Nourbakhsh , Hoda Mohammadzade

Time series forecasting is a critical and challenging task in practical application. Recent advancements in pre-trained foundation models for time series forecasting have gained significant interest. However, current methods often overlook…

Machine Learning · Computer Science 2024-08-02 Shubao Zhao , Ming Jin , Zhaoxiang Hou , Chengyi Yang , Zengxiang Li , Qingsong Wen , Yi Wang

Bearing fault detection is a critical task in predictive maintenance, where accurate and timely fault identification can prevent costly downtime and equipment damage. Traditional attention mechanisms in Transformer neural networks often…

Machine Learning · Computer Science 2024-12-17 Marzieh Mirzaeibonehkhater , Mohammad Ali Labbaf-Khaniki , Mohammad Manthouri

While Mamba models offer efficient sequence modeling, vanilla versions struggle with temporal correlations and boundary details in Arctic sea ice concentration (SIC) prediction. To address these limitations, we propose Frequency-enhanced…

Image and Video Processing · Electrical Eng. & Systems 2026-02-17 Feng Gao , Zheng Gong , Wenli Liu , Yanhai Gan , Zhuoran Zheng , Junyu Dong , Qian Du

Time series forecasting is an important application in various domains such as energy management, traffic planning, financial markets, meteorology, and medicine. However, real-time series data often present intricate temporal variability…

Machine Learning · Computer Science 2025-04-02 Reza Nematirad , Anil Pahwa , Balasubramaniam Natarajan

Motion prediction is crucial for autonomous driving, as it enables accurate forecasting of future vehicle trajectories based on historical inputs. This paper introduces Trajectory Mamba, a novel efficient trajectory prediction framework…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Yizhou Huang , Yihua Cheng , Kezhi Wang

Due to the superior ability of global dependency, transformer and its variants have become the primary choice in Masked Time-series Modeling (MTM) towards time-series classification task. In this paper, we experimentally analyze that…

Machine Learning · Computer Science 2024-12-19 Yudong Han , Haocong Wang , Yupeng Hu , Yongshun Gong , Xuemeng Song , Weili Guan