中文
相关论文

相关论文: KARMA: A Multilevel Decomposition Hybrid Mamba Fra…

200 篇论文

Long-range sequence processing poses a significant challenge for Transformers due to their quadratic complexity in input length. A promising alternative is Mamba, which demonstrates high performance and achieves Transformer-level…

机器学习 · 计算机科学 2025-04-11 Assaf Ben-Kish , Itamar Zimerman , Shady Abu-Hussein , Nadav Cohen , Amir Globerson , Lior Wolf , Raja Giryes

We propose ss-Mamba, a novel foundation model that enhances time series forecasting by integrating semantic-aware embeddings and adaptive spline-based temporal encoding within a selective state-space modeling framework. Building upon the…

机器学习 · 计算机科学 2025-06-19 Zuochen Ye

Remote sensing images are frequently obscured by cloud cover, posing significant challenges to data integrity and reliability. Effective cloud detection requires addressing both short-range spatial redundancies and long-range atmospheric…

计算机视觉与模式识别 · 计算机科学 2025-09-08 Tianxiang Xue , Jiayi Zhao , Jingsheng Li , Changlu Chen , Kun Zhan

We utilized the Mamba model for time series data prediction tasks, and the experimental results indicate that our model performs well.

机器学习 · 计算机科学 2024-05-14 Zexue Wu , Yifeng Gong , Aoqian Zhang

Change detection in remote sensing images is an essential tool for analyzing a region at different times. It finds varied applications in monitoring environmental changes, man-made changes as well as corresponding decision-making and…

计算机视觉与模式识别 · 计算机科学 2024-07-10 Jay N. Paranjape , Celso de Melo , Vishal M. Patel

Balancing fine-grained local modeling with long-range dependency capture under computational constraints remains a central challenge in sequence modeling. While Transformers provide strong token mixing, they suffer from quadratic…

机器学习 · 计算机科学 2026-03-20 Youjin Wang , Jiaqiao Zhao , Rong Fu , Run Zhou , Ruizhe Zhang , Jiani Liang , Suisuai Cao , Feng Zhou

Although MODIS time series data are critical for supporting dynamic, large-scale land cover land use classification, it is a challenging task to capture the subtle class signature information due to key MODIS difficulties, e.g., high…

图像与视频处理 · 电气工程与系统科学 2025-08-06 Zack Dewis , Zhengsen Xu , Yimin Zhu , Motasem Alkayid , Mabel Heffring , Lincoln Linlin Xu

Multimodal medical image fusion integrates complementary information from different imaging modalities to enhance diagnostic accuracy and treatment planning. While deep learning methods have advanced performance, existing approaches face…

图像与视频处理 · 电气工程与系统科学 2025-08-06 Meng Zhou , Farzad Khalvati

Ultrasound imaging frequently encounters challenges, such as those related to elevated noise levels, diminished spatiotemporal resolution, and the complexity of anatomical structures. These factors significantly hinder the model's ability…

图像与视频处理 · 电气工程与系统科学 2025-01-14 Xiaoxian Yang , Qi Wang , Kaiqi Zhang , Ke Wei , Jun Lyu , Lingchao Chen

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

Sequential recommendation systems have become a cornerstone of personalized services, adept at modeling the temporal evolution of user preferences by capturing dynamic interaction sequences. Existing approaches predominantly rely on…

信息检索 · 计算机科学 2025-05-15 Qianru Zhang , Honggang Wen , Wei Yuan , Crystal Chen , Menglin Yang , Siu-Ming Yiu , Hongzhi Yin

With the evolution of large language models, traditional Transformer models become computationally demanding for lengthy sequences due to the quadratic growth in computation with respect to the sequence length. Mamba, emerging as a…

机器学习 · 计算机科学 2024-08-22 Haoran Xu , Ziqian Liu , Rong Fu , Zhongling Su , Zerui Wang , Zheng Cai , Zhilin Pei , Xingcheng Zhang

Generating forecasts for time series with multiple seasonal cycles is an important use-case for many industries nowadays. Accounting for the multi-seasonal patterns becomes necessary to generate more accurate and meaningful forecasts in…

应用统计 · 统计学 2020-04-28 Kasun Bandara , Christoph Bergmeir , Hansika Hewamalage

Transformers are the cornerstone of modern large language models, but their quadratic computational complexity limits efficiency in long-sequence processing. Recent advancements in Mamba, a state space model (SSM) with linear complexity,…

机器学习 · 计算机科学 2026-01-08 Yixing Li , Ruobing Xie , Zhen Yang , Xingwu Sun , Shuaipeng Li , Weidong Han , Zhanhui Kang , Yu Cheng , Chengzhong Xu , Di Wang , Jie Jiang

Time series classification (TSC) is crucial in numerous real-world applications, such as environmental monitoring, medical diagnosis, and posture recognition. TSC tasks require models to effectively capture discriminative information for…

机器学习 · 计算机科学 2025-12-10 Da Zhang , Bingyu Li , Zhiyuan Zhao , Yanhan Zhang , Junyu Gao , Feiping Nie , Xuelong Li

Handling lengthy context is crucial for enhancing the recognition and understanding capabilities of multimodal large language models (MLLMs) in applications such as processing high-resolution images or high frame rate videos. The rise in…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Jianing Zhou , Han Li , Shuai Zhang , Ning Xie , Ruijie Wang , Xiaohan Nie , Sheng Liu , Lingyun Wang

Precise alignment of multi-modal images with inherent feature discrepancies poses a pivotal challenge in deformable image registration. Traditional learning-based approaches often consider registration networks as black boxes without…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Kaiang Wen , Bin Xie , Bin Duan , Yan Yan

Long-term time series forecasting (LTSF) represents a critical frontier in time series analysis, characterized by extensive input sequences, as opposed to the shorter spans typical of traditional approaches. While longer sequences…

机器学习 · 计算机科学 2024-10-17 Jinliang Deng , Feiyang Ye , Du Yin , Xuan Song , Ivor W. Tsang , Hui Xiong

Recent advancements in the Mamba architecture, with its linear computational complexity, being a promising alternative to transformer architectures suffering from quadratic complexity. While existing works primarily focus on adapting Mamba…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Jie Hu , Junwei Zheng , Jiale Wei , Jiaming Zhang , Rainer Stiefelhagen

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

机器学习 · 计算机科学 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi