English
Related papers

Related papers: AdaMamba: Adaptive Frequency-Gated Mamba for Long-…

200 papers

Modern multivariate time series forecasting primarily relies on two architectures: the Transformer with attention mechanism and Mamba. In natural language processing, an approach has been used that combines local window attention for…

Machine Learning · Computer Science 2025-09-26 Itay Katav , Aryeh Kontorovich

State-space modeling has emerged as a powerful paradigm for sequence analysis in various tasks such as natural language processing, time-series forecasting, and signal processing. In this work, we propose an \emph{Adaptive State-Space…

Machine Learning · Computer Science 2025-07-31 Alice Zhang , Chao Li

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

Time-series forecasting has seen significant advancements with the introduction of token prediction mechanisms such as multi-head attention. However, these methods often struggle to achieve the same performance as in language modeling,…

Machine Learning · Computer Science 2024-12-03 Panayiotis Christou , Shichu Chen , Xupeng Chen , Parijat Dube

Multivariate time series (MTS) data is generated through multiple sensors across various domains such as engineering application, health monitoring, and the internet of things, characterized by its temporal changes and high dimensional…

Machine Learning · Computer Science 2025-06-19 Mingsen Du , Meng Chen , Yongjian Li , Xiuxin Zhang , Jiahui Gao , Cun Ji , Shoushui Wei

Multimodal Sentiment Analysis (MSA) requires effective modeling of cross-modal interactions and contextual dependencies while remaining computationally efficient. Existing fusion approaches predominantly rely on Transformer-based…

Computation and Language · Computer Science 2026-04-07 Minghai Jiao , Jing Xiao , Peng Xiao , Ende Zhang , Shuang Kan , Wenyan Jiang , Jinyao Li , Yixian Liu , Haidong Xin

The intricate nature of time series data analysis benefits greatly from the distinct advantages offered by time and frequency domain representations. While the time domain is superior in representing local dependencies, particularly in…

Machine Learning · Computer Science 2024-04-09 Hengyu Ye , Jiadong Chen , Shijin Gong , Fuxin Jiang , Tieying Zhang , Jianjun Chen , Xiaofeng Gao

On-device adapting to continual, unpredictable domain shifts is essential for mobile applications like autonomous driving and augmented reality to deliver seamless user experiences in evolving environments. Test-time adaptation (TTA)…

Machine Learning · Computer Science 2024-10-14 Cheng Fang , Sicong Liu , Zimu Zhou , Bin Guo , Jiaqi Tang , Ke Ma , Zhiwen Yu

Time series classification (TSC) is crucial in numerous real-world applications, such as environmental monitoring, medical diagnosis, and posture recognition. TSC tasks require models to effectively capture discriminative information for…

Machine Learning · Computer Science 2025-12-10 Da Zhang , Bingyu Li , Zhiyuan Zhao , Yanhan Zhang , Junyu Gao , Feiping Nie , Xuelong Li

Long-term forecasting of chaotic systems remains a fundamental challenge due to the intrinsic sensitivity to initial conditions and the complex geometry of strange attractors. Conventional approaches, such as reservoir computing, typically…

Machine Learning · Computer Science 2025-09-29 Chang Liu , Bohao Zhao , Jingtao Ding , Huandong Wang , Yong Li

Magnetic Resonance Fingerprinting (MRF) enables fast quantitative imaging by matching signal evolutions to a predefined dictionary. However, conventional dictionary matching suffers from exponential growth in computational cost and memory…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Tianyi Ding , Hongli Chen , Yang Gao , Zhuang Xiong , Feng Liu , Martijn A. Cloos , Hongfu Sun

Training urban spatio-temporal foundation models that generalize well across diverse regions and cities is critical for deploying urban services in unseen or data-scarce regions. Recent studies have typically focused on fusing cross-domain…

Machine Learning · Computer Science 2026-02-04 Rui An , Yifeng Zhang , Ziran Liang , Wenqi Fan , Yuxuan Liang , Xuequn Shang , Qing Li

Recent 2D CNN-based domain adaptation approaches struggle with long-range dependencies due to limited receptive fields, making it difficult to adapt to target domains with significant spatial distribution changes. While transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 A. Enes Doruk , Hasan F. Ates

Time series forecasting has made significant advances, including with Transformer-based models. The attention mechanism in Transformer effectively captures temporal dependencies by attending to all past inputs simultaneously. However, its…

Machine Learning · Computer Science 2025-11-04 Xiongxiao Xu , Canyu Chen , Yueqing Liang , Baixiang Huang , Guangji Bai , Liang Zhao , Kai Shu

Clinical time-series data are difficult to model with methods designed for regular sequences because they exhibit irregular sampling, frequent missing values, and heterogeneous observation patterns across variables. Existing approaches…

Machine Learning · Computer Science 2026-05-19 Jinwoong Kim , Sangjin Park

Accurate and efficient multivariate time series (MTS) analysis is increasingly critical for a wide range of intelligent applications. Within this realm, Transformers have emerged as the predominant architecture due to their strong ability…

Machine Learning · Computer Science 2026-05-19 Rui An , Haohao Qu , Wenqi Fan , Xuequn Shang , Qing Li

Balancing fine-grained local modeling with long-range dependency capture under computational constraints remains a central challenge in sequence modeling. While Transformers provide strong token mixing, they suffer from quadratic…

Machine Learning · Computer Science 2026-03-20 Youjin Wang , Jiaqiao Zhao , Rong Fu , Run Zhou , Ruizhe Zhang , Jiani Liang , Suisuai Cao , Feng Zhou

In multivariate time series forecasting (MTSF), existing strategies for processing sequences are typically categorized as channel-independent and channel-mixing. The former treats all temporal information of each variable as a token,…

Artificial Intelligence · Computer Science 2025-07-08 Bing Fan , Shusen Ma , Yun-Bo Zhao , Yu Kang

Spatio-temporal graph (STG) forecasting is a critical task with extensive applications in the real world, including traffic and weather forecasting. Although several recent methods have been proposed to model complex dynamics in STGs,…

Machine Learning · Computer Science 2024-06-18 Jinhyeok Choi , Heehyeon Kim , Minhyeong An , Joyce Jiyoung Whang

Source-free domain adaptation (SFDA) tackles the critical challenge of adapting source-pretrained models to unlabeled target domains without access to source data, overcoming data privacy and storage limitations in real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xi Chen , Hongxun Yao , Sicheng Zhao , Jiankun Zhu , Jing Jiang , Kui Jiang