English
Related papers

Related papers: CloudMamba: Grouped Selective State Spaces for Poi…

200 papers

Unsupervised graph-level anomaly detection (UGLAD) is a critical and challenging task across various domains, such as social network analysis, anti-cancer drug discovery, and toxic molecule identification. However, existing methods often…

Machine Learning · Computer Science 2025-12-29 Yali Fu , Jindong Li , Qi Wang , Qianli Xing

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this paradigm due to their…

Noise is an inevitable aspect of point cloud acquisition, necessitating filtering as a fundamental task within the realm of 3D vision. Existing learning-based filtering methods have shown promising capabilities on small-scale synthetic or…

Multimedia · Computer Science 2025-01-10 Qingyuan Zhou , Weidong Yang , Ben Fei , Jingyi Xu , Rui Zhang , Keyi Liu , Yeqi Luo , Ying He

Point cloud videos can faithfully capture real-world spatial geometries and temporal dynamics, which are essential for enabling intelligent agents to understand the dynamically changing world. However, designing an effective 4D backbone…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Jiuming Liu , Jinru Han , Lihao Liu , Angelica I. Aviles-Rivero , Chaokang Jiang , Zhe Liu , Hesheng Wang

State Space models (SSMs) such as PointMamba enable efficient feature extraction for point cloud self-supervised learning with linear complexity, outperforming Transformers in computational efficiency. However, existing PointMamba-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Linshuang Diao , Sensen Song , Yurong Qian , Dayong Ren

Sequential Recommenders have been widely applied in various online services, aiming to model users' dynamic interests from their sequential interactions. With users increasingly engaging with online platforms, vast amounts of lifelong user…

Information Retrieval · Computer Science 2024-03-26 Jiyuan Yang , Yuanzi Li , Jingyu Zhao , Hanbing Wang , Muyang Ma , Jun Ma , Zhaochun Ren , Mengqi Zhang , Xin Xin , Zhumin Chen , Pengjie Ren

Multimodal fusion has made great progress in the field of remote sensing image classification due to its ability to exploit the complementary spatial-spectral information. Deep learning methods such as CNN and Transformer have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Qingyu Wang , Xue Jiang , Guozheng Xu

In various domains, Sequential Recommender Systems (SRS) have become essential due to their superior capability to discern intricate user preferences. Typically, SRS utilize transformer-based architectures to forecast the subsequent item…

Artificial Intelligence · Computer Science 2024-12-25 Ziwei Liu , Qidong Liu , Yejing Wang , Wanyu Wang , Pengyue Jia , Maolin Wang , Zitao Liu , Yi Chang , Xiangyu Zhao

Serving the Intelligent Transport System (ITS) and Vehicle-to-Everything (V2X) tasks, roadside perception has received increasing attention in recent years, as it can extend the perception range of connected vehicles and improve traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Zhang Zhang , Chao Sun , Chao Yue , Da Wen , Tianze Wang , Jianghao Leng

Mamba, a special case of the State Space Model, is gaining popularity as an alternative to template-based deep learning approaches in medical image analysis. While transformers are powerful architectures, they have drawbacks, including…

State-Space Models (SSMs) have emerged as efficient alternatives to transformers for sequential data tasks, offering linear or near-linear scalability with sequence length, making them ideal for long-sequence applications in NLP, vision,…

Machine Learning · Computer Science 2025-04-01 Arghadip Das , Arnab Raha , Shamik Kundu , Soumendu Kumar Ghosh , Deepak Mathaikutty , Vijay Raghunathan

We present PlainMamba: a simple non-hierarchical state space model (SSM) designed for general visual recognition. The recent Mamba model has shown how SSMs can be highly competitive with other architectures on sequential data and initial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Chenhongyi Yang , Zehui Chen , Miguel Espinosa , Linus Ericsson , Zhenyu Wang , Jiaming Liu , Elliot J. Crowley

The recent empirical success of Mamba and other selective state space models (SSMs) has renewed interest in non-attention architectures for sequence modeling, yet their theoretical foundations remain underexplored. We present a first-step…

Machine Learning · Computer Science 2026-02-16 Mugunthan Shandirasegaran , Hongkang Li , Songyang Zhang , Meng Wang , Shuai Zhang

The Mamba layer offers an efficient selective state space model (SSM) that is highly effective in modeling multiple domains, including NLP, long-range sequence processing, and computer vision. Selective SSMs are viewed as dual models, in…

Machine Learning · Computer Science 2024-04-02 Ameen Ali , Itamar Zimerman , Lior Wolf

State Space Model (SSM)-based machine learning architectures have recently gained significant attention for processing sequential data. Mamba, a recent sequence-to-sequence SSM, offers competitive accuracy with superior computational…

Machine Learning · Computer Science 2025-08-15 Jiyong Kim , Jaeho Lee , Jiahao Lin , Alish Kanani , Miao Sun , Umit Y. Ogras , Jaehyun Park

Semantic segmentation is a vital task in the field of remote sensing (RS). However, conventional convolutional neural network (CNN) and transformer-based models face limitations in capturing long-range dependencies or are often…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Yin Hu , Xianping Ma , Jialu Sui , Man-On Pun

Topological deep learning has emerged as a powerful paradigm for modeling higher-order relational structures beyond pairwise interactions that standard graph neural networks fail to capture. While combinatorial complexes (CCs) offer a…

Machine Learning · Computer Science 2026-03-16 Jiawen Chen , Qi Shao , Mingtong Zhou , Duxin Chen , Wenwu Yu

Sequential recommendation aims to estimate the dynamic user preferences and sequential dependencies among historical user behaviors. Although Transformer-based models have proven to be effective for sequential recommendation, they suffer…

Information Retrieval · Computer Science 2024-07-02 Chengkai Liu , Jianghao Lin , Jianling Wang , Hanzhou Liu , James Caverlee

Recent years have witnessed significant advancements in light field image super-resolution (LFSR) owing to the progress of modern neural networks. However, these methods often face challenges in capturing long-range dependencies (CNN-based)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Wang xia , Yao Lu , Shunzhou Wang , Ziqi Wang , Peiqi Xia , Tianfei Zhou

Mesh saliency enhances the adaptability of 3D vision by identifying and emphasizing regions that naturally attract visual attention. To investigate the interaction between geometric structure and texture in shaping visual attention, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Kaiwei Zhang , Dandan Zhu , Xiongkuo Min , Guangtao Zhai