中文
相关论文

相关论文: TimeMachine: A Time Series is Worth 4 Mambas for L…

200 篇论文

Recent deep learning models for Long-term Time Series Forecasting (LTSF) often emphasize complex, handcrafted designs, while simpler architectures like linear models or MLPs have often outperformed these intricate solutions. In this paper,…

机器学习 · 计算机科学 2025-05-26 Yihang Lu , Yangyang Xu , Qitao Qing , Xianwei Meng

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

State-space models (SSMs), exemplified by S4, have introduced a novel context modeling method by integrating state-space techniques into deep learning. However, they struggle with global context modeling due to their data-independent…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Hamid Suleman , Syed Talal Wasim , Muzammal Naseer , Juergen Gall

Deep Learning based Weather Prediction (DLWP) models have been improving rapidly over the last few years, surpassing state of the art numerical weather forecasts by significant margins. While much of the optimization effort is focused on…

大气与海洋物理 · 物理学 2024-08-15 Haoyu Qin , Yungang Chen , Qianchuan Jiang , Pengchao Sun , Xiancai Ye , Chao Lin

With the rapid growth of the Internet of Things ecosystem, Automatic Modulation Classification (AMC) has become increasingly paramount. However, extended signal lengths offer a bounty of information, yet impede the model's adaptability,…

信号处理 · 电气工程与系统科学 2024-05-21 Yezhuo Zhang , Zinan Zhou , Yichao Cao , Guangyu Li , Xuanpeng Li

In scene text detection, Transformer-based methods have addressed the global feature extraction limitations inherent in traditional convolution neural network-based methods. However, most directly rely on native Transformer attention layers…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Qiyan Zhao , Yue Yan , Da-Han Wang

Recent advancements in recurrent architectures, such as Mamba and RWKV, have showcased strong language capabilities. Unlike transformer-based models, these architectures encode all contextual information into a fixed-size state, leading to…

计算与语言 · 计算机科学 2026-01-14 Yingfa Chen , Xinrong Zhang , Shengding Hu , Xu Han , Zhiyuan Liu , Maosong Sun

The explosion of Time Series (TS) data, driven by advancements in technology, necessitates sophisticated analytical methods. Modern management systems increasingly rely on analyzing this data, highlighting the importance of effcient…

机器学习 · 计算机科学 2025-03-27 Seyedeh Azadeh Fallah Mortezanejad , Ruochen Wang

Designing computationally efficient network architectures remains an ongoing necessity in computer vision. In this paper, we adapt Mamba, a state-space language model, into VMamba, a vision backbone with linear time complexity. At the core…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Yue Liu , Yunjie Tian , Yuzhong Zhao , Hongtian Yu , Lingxi Xie , Yaowei Wang , Qixiang Ye , Jianbin Jiao , Yunfan Liu

Data mining, particularly the analysis of multivariate time series data, plays a crucial role in extracting insights from complex systems and supporting informed decision-making across diverse domains. However, assessing the similarity of…

Multivariate time series forecasting is extensively studied throughout the years with ubiquitous applications in areas such as finance, traffic, environment, etc. Still, concerns have been raised on traditional methods for incapable of…

机器学习 · 计算机科学 2018-09-10 Yen-Yu Chang , Fan-Yun Sun , Yueh-Hua Wu , Shou-De Lin

Sequential recommendation methods are crucial in modern recommender systems for their remarkable capability to understand a user's changing interests based on past interactions. However, a significant challenge faced by current methods…

信息检索 · 计算机科学 2025-01-17 Haohao Qu , Yifeng Zhang , Liangbo Ning , Wenqi Fan , Qing Li

Producing probabilistic forecasts for large collections of similar and/or dependent time series is a practically relevant and challenging task. Classical time series models fail to capture complex patterns in the data, and multivariate…

机器学习 · 统计学 2019-05-30 Yuyang Wang , Alex Smola , Danielle C. Maddix , Jan Gasthaus , Dean Foster , Tim Januschowski

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this paradigm due to their…

Traffic flow estimation (TFE) is crucial for urban intelligent traffic systems. While traditional on-road detectors are hindered by limited coverage and high costs, cloud computing and data mining of vehicular network data, such as driving…

人工智能 · 计算机科学 2024-07-12 Doncheng Yuan , Jianzhe Xue , Jinshan Su , Wenchao Xu , Haibo Zhou

Leveraging its robust linear global modeling capability, Mamba has notably excelled in computer vision. Despite its success, existing Mamba-based vision models have overlooked the nuances of event-driven tasks, especially in video…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Chengjie Ge , Xueyang Fu , Peng He , Kunyu Wang , Chengzhi Cao , Zheng-Jun Zha

Transformers are the cornerstone of modern large language models, but their quadratic computational complexity limits efficiency in long-sequence processing. Recent advancements in Mamba, a state space model (SSM) with linear complexity,…

机器学习 · 计算机科学 2026-01-08 Yixing Li , Ruobing Xie , Zhen Yang , Xingwu Sun , Shuaipeng Li , Weidong Han , Zhanhui Kang , Yu Cheng , Chengzhong Xu , Di Wang , Jie Jiang

Real-world time series often exhibit complex interdependencies that cannot be captured in isolation. Global models that model past data from multiple related time series globally while producing series-specific forecasts locally are now…

机器学习 · 计算机科学 2024-05-14 Abishek Sriramulu , Christoph Bergmeir , Slawek Smyl

Time series forecasting is essential for operational intelligence in the hospitality industry, and particularly challenging in large-scale, distributed systems. This study evaluates the performance of statistical, machine learning (ML),…

机器学习 · 计算机科学 2025-02-06 Issar Arab , Rodrigo Benitez

Sequence modeling faces challenges in capturing long-range dependencies across diverse tasks. Recent linear and transformer-based forecasters have shown superior performance in time series forecasting. However, they are constrained by their…

机器学习 · 计算机科学 2024-11-25 Bong Gyun Kang , Dongjun Lee , HyunGi Kim , DoHyun Chung , Sungroh Yoon