English
Related papers

Related papers: DyG-Mamba: Continuous State Space Modeling on Dyna…

200 papers

Graph neural networks (GNNs) have become the state of the art for various graph-related tasks and are particularly prominent in heterogeneous graphs (HetGs). However, several issues plague this paradigm: first, the difficulty in fully…

Machine Learning · Computer Science 2025-02-25 Xuqi Mao , Zhenying He , X. Sean Wang

Continuous glucose monitoring (CGM) generates dense data streams critical for diabetes management, but most used forecasting models lack interpretability for clinical use. We present SSM-CGM, a Mamba-based neural state-space forecasting…

Machine Learning · Computer Science 2025-10-07 Shakson Isaac , Yentl Collin , Chirag Patel

Micro-gesture recognition (MGR) targets the identification of subtle and fine-grained human motions and requires accurate modeling of both long-range and local spatiotemporal dependencies. While CNNs are effective at capturing local…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Deng Li , Jun Shao , Bohao Xing , Rong Gao , Bihan Wen , Heikki Kälviäinen , Xin Liu

Accurate 3D medical image segmentation demands architectures capable of reconciling global context modeling with spatial topology preservation. While State Space Models (SSMs) like Mamba show potential for sequence modeling, existing…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Hangyu Ji

Predicting user preferences and sequential dependencies based on historical behavior is the core goal of sequential recommendation. Although attention-based models have shown effectiveness in this field, they often struggle with inference…

Machine Learning · Computer Science 2024-06-11 Yuda Wang , Xuxin He , Shengxin Zhu

Deep image hashing aims to enable effective large-scale image retrieval by mapping the input images into simple binary hash codes through deep neural networks. More recently, Vision Mamba with linear time complexity has attracted extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Chao He , Hongxi Wei

Mamba-based vision models have gained extensive attention as a result of being computationally more efficient than attention-based models. However, spatial redundancy still exists in these models, represented by token and block redundancy.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Mengxuan Wu , Zekai Li , Zhiyuan Liang , Moyang Li , Xuanlei Zhao , Samir Khaki , Zheng Zhu , Xiaojiang Peng , Konstantinos N. Plataniotis , Kai Wang , Wangbo Zhao , Yang You

The Vision Transformer (ViT) model has long struggled with the challenge of quadratic complexity, a limitation that becomes especially critical in unmanned aerial vehicle (UAV) tracking systems, where data must be processed in real time. In…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Bingxi Liu , Calvin Chen , Junhao Li , Guyang Yu , Haoqian Song , Xuchen Liu , Jinqiang Cui , Hong Zhang

Most of the dynamic graph representation learning methods involve dividing a dynamic graph into discrete snapshots to capture the evolving behavior of nodes over time. Existing methods primarily capture only local or global structures of…

Machine Learning · Computer Science 2025-12-23 Bizhan Alipour Pijan , Serdar Bozdag

Efficient extraction of spectral sequences and geospatial information has always been a hot topic in hyperspectral image classification. In terms of spectral sequence feature capture, RNN and Transformer have become mainstream…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Aitao Yang , Min Li , Yao Ding , Leyuan Fang , Yaoming Cai , Yujie He

Place recognition is the foundation for enabling autonomous systems to achieve independent decision-making and safe operations. It is also crucial in tasks such as loop closure detection and global localization within SLAM. Previous methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Qiuchi Xiang , Jintao Cheng , Jiehao Luo , Jin Wu , Rui Fan , Xieyuanli Chen , Xiaoyu Tang

The quadratic complexity of the attention mechanism in Transformer models has motivated the development of alternative architectures with sub-quadratic scaling, such as state-space models. Among these, Mamba has emerged as a leading…

Machine Learning · Computer Science 2025-12-16 Peng Lu , Jerry Huang , Qiuhao Zeng , Xinyu Wang , Boxing Chen , Philippe Langlais , Yufei Cui

Dynamic graph neural networks (DyGNNs) have demonstrated powerful predictive abilities by exploiting graph structural and temporal dynamics. However, the existing DyGNNs fail to handle distribution shifts, which naturally exist in dynamic…

Machine Learning · Computer Science 2024-03-11 Zeyang Zhang , Xin Wang , Ziwei Zhang , Haoyang Li , Wenwu Zhu

Graphs are essential representations of many real-world data such as social networks. Recent years have witnessed the increasing efforts made to extend the neural network models to graph-structured data. These methods, which are usually…

Machine Learning · Computer Science 2018-11-07 Yao Ma , Ziyi Guo , Zhaochun Ren , Eric Zhao , Jiliang Tang , Dawei Yin

Surgical phase recognition is crucial for enhancing the efficiency and safety of computer-assisted interventions. One of the fundamental challenges involves modeling the long-distance temporal relationships present in surgical videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Rui Cao , Jiangliu Wang , Yun-Hui Liu

Skeleton-based action recognition has garnered significant attention in the computer vision community. Inspired by the recent success of the selective state-space model (SSM) Mamba in modeling 1D temporal sequences, we propose TSkel-Mamba,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Yanan Liu , Jun Liu , Hao Zhang , Dan Xu , Hossein Rahmani , Mohammed Bennamoun , Qiuhong Ke

In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in…

Machine Learning · Computer Science 2024-04-30 Zihan Wang , Fanheng Kong , Shi Feng , Ming Wang , Xiaocui Yang , Han Zhao , Daling Wang , Yifei Zhang

Recent State Space Models (SSM), especially Mamba, have demonstrated impressive performance in visual modeling and possess superior model efficiency. However, the application of Mamba to visual tasks suffers inferior performance due to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Fei Xie , Jiahao Nie , Yujin Tang , Wenkang Zhang , Hongshen Zhao

The analysis of tabular data has traditionally been dominated by gradient-boosted decision trees (GBDTs), known for their proficiency with mixed categorical and numerical features. However, recent deep learning innovations are challenging…

Machine Learning · Computer Science 2025-03-26 Anton Frederik Thielmann , Manish Kumar , Christoph Weisser , Arik Reuter , Benjamin Säfken , Soheila Samiee

In this paper, we conduct an empirical evaluation of Temporal Graph Benchmark (TGB) by extending our Dynamic Graph Library (DyGLib) to TGB. Compared with TGB, we include eleven popular dynamic graph learning methods for more exhaustive…

Machine Learning · Computer Science 2023-10-17 Le Yu