中文
相关论文

相关论文: UmambaTSF: A U-shaped Multi-Scale Long-Term Time S…

200 篇论文

The quadratic complexity of the attention mechanism in Transformer models has motivated the development of alternative architectures with sub-quadratic scaling, such as state-space models. Among these, Mamba has emerged as a leading…

机器学习 · 计算机科学 2025-12-16 Peng Lu , Jerry Huang , Qiuhao Zeng , Xinyu Wang , Boxing Chen , Philippe Langlais , Yufei Cui

The Vision Transformer (ViT) model has long struggled with the challenge of quadratic complexity, a limitation that becomes especially critical in unmanned aerial vehicle (UAV) tracking systems, where data must be processed in real time. In…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Bingxi Liu , Calvin Chen , Junhao Li , Guyang Yu , Haoqian Song , Xuchen Liu , Jinqiang Cui , Hong Zhang

Long-term time series forecasting (LTSF) offers broad utility in practical settings like energy consumption and weather prediction. Accurately predicting long-term changes, however, is demanding due to the intricate temporal patterns and…

机器学习 · 计算机科学 2025-05-19 Boshi Gao , Qingjian Ni , Fanbo Ju , Yu Chen , Ziqi Zhao

Training urban spatio-temporal foundation models that generalize well across diverse regions and cities is critical for deploying urban services in unseen or data-scarce regions. Recent studies have typically focused on fusing cross-domain…

机器学习 · 计算机科学 2026-02-04 Rui An , Yifeng Zhang , Ziran Liang , Wenqi Fan , Yuxuan Liang , Xuequn Shang , Qing Li

We utilized the Mamba model for time series data prediction tasks, and the experimental results indicate that our model performs well.

机器学习 · 计算机科学 2024-05-14 Zexue Wu , Yifeng Gong , Aoqian Zhang

Recent advancements in anomaly detection have seen the efficacy of CNN- and transformer-based approaches. However, CNNs struggle with long-range dependencies, while transformers are burdened by quadratic computational complexity.…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Haoyang He , Yuhu Bai , Jiangning Zhang , Qingdong He , Hongxu Chen , Zhenye Gan , Chengjie Wang , Xiangtai Li , Guanzhong Tian , Lei Xie

Sequential recommendation systems have become a cornerstone of personalized services, adept at modeling the temporal evolution of user preferences by capturing dynamic interaction sequences. Existing approaches predominantly rely on…

信息检索 · 计算机科学 2025-05-15 Qianru Zhang , Honggang Wen , Wei Yuan , Crystal Chen , Menglin Yang , Siu-Ming Yiu , Hongzhi Yin

State space models (SSMs) have emerged as an efficient alternative to Transformer models for language modeling, offering linear computational complexity and constant memory usage as context length increases. However, despite their…

Time series prediction plays a pivotal role across diverse domains such as finance, healthcare, energy systems, and environmental modeling. However, existing approaches often struggle to balance efficiency, scalability, and accuracy,…

机器学习 · 计算机科学 2026-01-13 Xingsheng Chen , Regina Zhang , Bo Gao , Xingwei He , Xiaofeng Liu , Pietro Lio , Kwok-Yan Lam , Siu-Ming Yiu

Recent Transformer-based diffusion models have shown remarkable performance, largely attributed to the ability of the self-attention mechanism to accurately capture both global and local contexts by computing all-pair interactions among…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Yunxiang Fu , Chaoqi Chen , Yizhou Yu

Medical time series, such as electrocardiograms (ECG) and electroencephalograms (EEG), exhibit complex temporal dynamics and structured cross-channel dependencies, posing fundamental challenges for automated analysis. Conventional…

信号处理 · 电气工程与系统科学 2026-05-08 ZhengXiao He , Huayu Li , Xiwen Chen , Janet M Roveda , Jinghao Wen , Siyuan Tian , Ao Li

Existing CNN-based speech separation models face local receptive field limitations and cannot effectively capture long time dependencies. Although LSTM and Transformer-based speech separation models can avoid this problem, their high…

声音 · 计算机科学 2024-09-11 Kai Li , Guo Chen , Runxuan Yang , Xiaolin Hu

In an era of frequent extreme weather and global warming, obtaining precise, fine-grained near-surface weather forecasts is increasingly essential for human activities. Downscaling (DS), a crucial task in meteorological forecasting, enables…

大气与海洋物理 · 物理学 2024-08-21 Zili Liu , Hao Chen , Lei Bai , Wenyuan Li , Wanli Ouyang , Zhengxia Zou , Zhenwei Shi

Time series data plays a pivotal role in a wide variety of fields but faces challenges related to privacy concerns. Recently, synthesizing data via diffusion models is viewed as a promising solution. However, existing methods still struggle…

机器学习 · 计算机科学 2025-11-25 Zihao Yao , Jiankai Zuo , Yaying Zhang

Visual tracking aims to automatically estimate the state of a target object in a video sequence, which is challenging especially in dynamic scenarios. Thus, numerous methods are proposed to introduce temporal cues to enhance tracking…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Yinchao Ma , Dengqing Yang , Zhangyu He , Wenfei Yang , Tianzhu Zhang

State-space models (SSMs), particularly the Mamba architecture, have emerged as powerful alternatives to Transformers for sequence modeling, offering linear-time complexity and competitive performance across diverse tasks. However, their…

机器学习 · 计算机科学 2025-09-30 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

Large language models (LLMs) have advanced significantly due to the attention mechanism, but their quadratic complexity and linear memory demands limit their performance on long-context tasks. Recently, researchers introduced Mamba, an…

计算与语言 · 计算机科学 2024-10-22 Wangjie You , Zecheng Tang , Juntao Li , Lili Yao , Min Zhang

Traffic flow prediction, a critical aspect of intelligent transportation systems, has been increasingly popular in the field of artificial intelligence, driven by the availability of extensive traffic data. The current challenges of traffic…

机器学习 · 计算机科学 2024-05-21 Zhiqi Shao , Michael G. H. Bell , Ze Wang , D. Glenn Geers , Haoning Xi , Junbin Gao

Robust feature representations are essential for learning-based Multi-View Stereo (MVS), which relies on accurate feature matching. Recent MVS methods leverage Transformers to capture long-range dependencies based on local features…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Jianfei Jiang , Qiankun Liu , Hongyuan Liu , Haochen Yu , Liyong Wang , Jiansheng Chen , Huimin Ma

Time series forecasting in real world environments faces significant challenges non stationarity, multi scale temporal patterns, and distributional shifts that degrade model stability and accuracy. This study propose AdaMamba, a unified…

机器学习 · 计算机科学 2025-12-09 MinCheol Jeon