English
Related papers

Related papers: Contrast Similarity-Aware Dual-Pathway Mamba for M…

200 papers

Modern multivariate time series forecasting primarily relies on two architectures: the Transformer with attention mechanism and Mamba. In natural language processing, an approach has been used that combines local window attention for…

Machine Learning · Computer Science 2025-09-26 Itay Katav , Aryeh Kontorovich

Time series data plays a pivotal role in a wide variety of fields but faces challenges related to privacy concerns. Recently, synthesizing data via diffusion models is viewed as a promising solution. However, existing methods still struggle…

Machine Learning · Computer Science 2025-11-25 Zihao Yao , Jiankai Zuo , Yaying Zhang

Robust feature representations are essential for learning-based Multi-View Stereo (MVS), which relies on accurate feature matching. Recent MVS methods leverage Transformers to capture long-range dependencies based on local features…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jianfei Jiang , Qiankun Liu , Hongyuan Liu , Haochen Yu , Liyong Wang , Jiansheng Chen , Huimin Ma

Spatio-temporal graph (STG) forecasting is a critical task with extensive applications in the real world, including traffic and weather forecasting. Although several recent methods have been proposed to model complex dynamics in STGs,…

Machine Learning · Computer Science 2024-06-18 Jinhyeok Choi , Heehyeon Kim , Minhyeong An , Joyce Jiyoung Whang

Learning useful representations for continuous-time dynamic graphs (CTDGs) is challenging, due to the concurrent need to span long node interaction histories and grasp nuanced temporal details. In particular, two problems emerge: (1)…

Machine Learning · Computer Science 2025-06-09 Zifeng Ding , Yifeng Li , Yuan He , Antonio Norelli , Jingcheng Wu , Volker Tresp , Michael Bronstein , Yunpu Ma

Multivariate time series data provide a robust framework for future predictions by leveraging information across multiple dimensions, ensuring broad applicability in practical scenarios. However, their high dimensionality and mixing…

Machine Learning · Computer Science 2024-11-28 Xuanbing Zhu , Dunbin Shen , Zhongwen Rao , Huiyi Ma , Yingguang Hao , Hongyu Wang

Recently, the Mamba architecture based on state space models has demonstrated remarkable performance in a series of natural language processing tasks and has been rapidly applied to remote sensing change detection (CD) tasks. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haotian Zhang , Keyan Chen , Chenyang Liu , Hao Chen , Zhengxia Zou , Zhenwei Shi

Accurate long-term time series forecasting (LTSF) requires the capture of complex long-range dependencies and dynamic periodic patterns. Recent advances in frequency-domain analysis offer a global perspective for uncovering temporal…

Artificial Intelligence · Computer Science 2026-04-28 Xudong Jiang , Mingshan Loo , Hanchen Yang , Wengen Li , Mingrui Zhang , Yichao Zhang , Jihong Guan , Shuigeng Zhou

The problem of Time-series Forecasting is generally addressed by recurrent, Transformer-based and the recently proposed Mamba-based architectures. However, existing architectures generally process their input at a single temporal scale,…

Machine Learning · Computer Science 2026-03-06 Yusuf Meric Karadag , Ismail Talaz , Ipek Gursel Dino , Sinan Kalkan

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing…

Machine Learning · Computer Science 2026-05-15 Xingsheng Chen , Xianpei Mu , Deyu Yi , Yilin Yuan , Xingwei He , Bo Gao , Regina Zhang , Pietro Lio , Siu-Ming Yiu

For multivariate time series (MTS) tasks, previous state space models (SSMs) followed the modeling paradigm of Transformer-based methods. However, none of them explicitly model the complex dependencies of MTS: the Channel Dependency…

Machine Learning · Computer Science 2024-10-02 Haixiang Wu

Plant Disease Detection (PDD) is a key aspect of precision agriculture. However, existing deep learning methods often rely on extensively annotated datasets, which are time-consuming and costly to generate. Self-supervised Learning (SSL)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Abdullah Al Mamun , Miaohua Zhang , David Ahmedt-Aristizabal , Zeeshan Hayder , Mohammad Awrangjeb

Long-term multivariate time series forecasting (LTSF) plays a crucial role in various high-performance computing applications, including real-time energy grid management and large-scale traffic flow simulation. However, existing solutions…

Machine Learning · Computer Science 2026-02-03 Qianyang Li , Xingjun Zhang , Shaoxun Wang , Jia Wei , Yueqi Xing

U-shaped architectures have long dominated the field of medical image segmentation, while Transformers are widely employed for modeling long-range dependencies. The former typically handles scale variations implicitly by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanhua Zhang , Ke Zhang , Jingyu Wang , Gabriella Balestra , Samanta Rosati , Yulin Wu , Wuwei Wang , Valentina Giannini

Attention mechanisms have been widely used to capture long-range dependencies among nodes in Graph Transformers. Bottlenecked by the quadratic computational cost, attention mechanisms fail to scale in large graphs. Recent improvements in…

Machine Learning · Computer Science 2024-02-02 Chloe Wang , Oleksii Tsepa , Jun Ma , Bo Wang

Medical time series are central to healthcare, enabling continuous monitoring and supporting timely clinical decisions. Despite recent progress, existing methods struggle to jointly model local-global dynamics and handle nonstationarities…

Machine Learning · Computer Science 2026-05-26 Da Zhang , Bingyu Li , Zhiyuan Zhao , Hongyuan Zhang , Junyu Gao , Xuelong Li

Remote sensing change detection (CD) has made significant advancements with the adoption of Convolutional Neural Networks (CNNs) and Transformers. While CNNs offer powerful feature extraction, they are constrained by receptive field…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 JunYao Kaung , HongWei Ge

In electrical equipment, even minor contact issues can lead to arc faults. Traditional methods often struggle to balance the accuracy and rapid response required for effective arc fault detection. To address this challenge, we introduce…

Computational Engineering, Finance, and Science · Computer Science 2025-03-04 Lukun Wang , Ruxue Zhao , Wancheng Feng , Pu Sun , Chunpeng Tian

The effectiveness and efficiency of modeling complex spectral-spatial relations are both crucial for Hyperspectral image (HSI) classification. Most existing methods based on CNNs and transformers still suffer from heavy computational…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Jiamu Sheng , Jingyi Zhou , Jiong Wang , Peng Ye , Jiayuan Fan

Mamba has recently emerged as a promising alternative to Transformers, offering near-linear complexity in processing sequential data. However, while channels in time series (TS) data have no specific order in general, recent studies have…

Machine Learning · Computer Science 2024-11-01 Seunghan Lee , Juri Hong , Kibok Lee , Taeyoung Park