English
Related papers

Related papers: Mamba4Cast: Efficient Zero-Shot Time Series Foreca…

200 papers

Predicting Bitcoin price remains a challenging problem due to the high volatility and complex non-linear dynamics of cryptocurrency markets. Traditional time-series models, such as ARIMA and GARCH, and recurrent neural networks, like LSTMs,…

Machine Learning · Computer Science 2025-05-06 Mohammad Shahab Sepehri , Asal Mehradfar , Mahdi Soltanolkotabi , Salman Avestimehr

Multi-modal image fusion integrates complementary information from different modalities to produce enhanced and informative images. Although State-Space Models, such as Mamba, are proficient in long-range modeling with linear complexity,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Ke Cao , Xuanhua He , Tao Hu , Chengjun Xie , Man Zhou , Jie Zhang

Recently, Mamba-based methods have demonstrated impressive performance in point cloud representation learning by leveraging State Space Model (SSM) with the efficient context modeling ability and linear complexity. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Chuxin Wang , Yixin Zha , Wenfei Yang , Tianzhu Zhang

State space models (SSMs) have emerged as an efficient alternative to Transformer models for language modeling, offering linear computational complexity and constant memory usage as context length increases. However, despite their…

Computation and Language · Computer Science 2025-04-23 Zhifan Ye , Kejing Xia , Yonggan Fu , Xin Dong , Jihoon Hong , Xiangchi Yuan , Shizhe Diao , Jan Kautz , Pavlo Molchanov , Yingyan Celine Lin

Time series forecasting is essential for operational intelligence in the hospitality industry, and particularly challenging in large-scale, distributed systems. This study evaluates the performance of statistical, machine learning (ML),…

Machine Learning · Computer Science 2025-02-06 Issar Arab , Rodrigo Benitez

State Space Models (SSMs) have emerged as a potent tool in sequence modeling tasks in recent years. These models approximate continuous systems using a set of basis functions and discretize them to handle input data, making them well-suited…

Machine Learning · Computer Science 2024-07-16 Jiaxi Hu , Disen Lan , Ziyu Zhou , Qingsong Wen , Yuxuan Liang

We introduce VideoMamba, a novel adaptation of the pure Mamba architecture, specifically designed for video recognition. Unlike transformers that rely on self-attention mechanisms leading to high computational costs by quadratic complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jinyoung Park , Hee-Seon Kim , Kangwook Ko , Minbeom Kim , Changick Kim

Event cameras capture asynchronous pixel-level brightness changes with microsecond temporal resolution, offering unique advantages for high-speed vision tasks. Existing methods often convert event streams into intermediate representations…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Hanfang Liang , Bing Wang , Shizhen Zhang , Wen Jiang , Yizhuo Yang , Weixiang Guo , Shenghai Yuan

Time series forecasting has recently achieved significant progress with multi-scale models to address the heterogeneity between long and short range patterns. Despite their state-of-the-art performance, we identify two potential areas for…

Machine Learning · Computer Science 2025-02-18 Zihao Wu , Juncheng Dong , Haoming Yang , Vahid Tarokh

Human experts typically integrate numerical and textual multimodal information to analyze time series. However, most traditional deep learning predictors rely solely on unimodal numerical data, using a fixed-length window for training and…

Computation and Language · Computer Science 2024-12-17 Chengsen Wang , Qi Qi , Jingyu Wang , Haifeng Sun , Zirui Zhuang , Jinming Wu , Lei Zhang , Jianxin Liao

Autonomous driving systems demand trajectory planners that not only model the inherent uncertainty of future motions but also respect complex temporal dependencies and underlying physical laws. While diffusion-based generative models excel…

Robotics · Computer Science 2026-02-03 Hang Zhou , Qiang Zhang , Peiran Liu , Yihao Qin , Zhaoxu Yan , Yiding Ji

In recent developments, the Mamba architecture, known for its selective state space approach, has shown potential in the efficient modeling of long sequences. However, its application in image generation remains underexplored. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Shentong Mo , Yapeng Tian

Multicategory remote object counting is a fundamental task in computer vision, aimed at accurately estimating the number of objects of various categories in remote images. Existing methods rely on CNNs and Transformers, but CNNs struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Peng Liu , Sen Lei , Heng-Chao Li

The goal of style transfer is, given a content image and a style source, generating a new image preserving the content but with the artistic representation of the style source. Most of the state-of-the-art architectures use transformers or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Filippo Botti , Alex Ergasti , Leonardo Rossi , Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

Behavioral Foundation Models (BFMs) proved successful in producing policies for arbitrary tasks in a zero-shot manner, requiring no test-time training or task-specific fine-tuning. Among the most promising BFMs are the ones that estimate…

Machine Learning · Computer Science 2026-05-05 Maksim Bobrin , Ilya Zisman , Alexander Nikulin , Vladislav Kurenkov , Dmitry Dylov

A comprehensive understanding of molecular structures is important for the prediction of molecular ground-state conformation involving property information. Meanwhile, state space model (e.g., Mamba) has recently emerged as a promising…

Chemical Physics · Physics 2025-11-14 Yuxin Gou , Aming Wu , Richang Hong , Meng Wang

3D object detection is critical for autonomous driving, yet it remains fundamentally challenging to simultaneously maximize computational efficiency and capture long-range spatial dependencies. We observed that Mamba-based models, with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Longhui Zheng , Qiming Xia , Xiaolu Chen , Zhaoliang Liu , Chenglu Wen

Efficiently modeling sequences with infinite context length has long been a challenging problem. Previous approaches have either suffered from quadratic computational complexity or limited extrapolation ability in length generalization. In…

Computation and Language · Computer Science 2025-03-03 Liliang Ren , Yang Liu , Yadong Lu , Yelong Shen , Chen Liang , Weizhu Chen

We propose ss-Mamba, a novel foundation model that enhances time series forecasting by integrating semantic-aware embeddings and adaptive spline-based temporal encoding within a selective state-space modeling framework. Building upon the…

Machine Learning · Computer Science 2025-06-19 Zuochen Ye

Accurate probabilistic weather forecasting demands both high accuracy and efficient uncertainty quantification, challenges that overburden both ensemble numerical weather prediction (NWP) and recent machine-learning methods. We introduce…

Machine Learning · Computer Science 2025-06-12 Yilin Zhuang , Karthik Duraisamy