English
Related papers

Related papers: SUM: Saliency Unification through Mamba for Visual…

200 papers

Traditionally for improving the segmentation performance of models, most approaches prefer to use adding more complex modules. And this is not suitable for the medical field, especially for mobile medical devices, where computationally…

Image and Video Processing · Electrical Eng. & Systems 2025-06-30 Renkai Wu , Yinghao Liu , Pengchen Liang , Qing Chang

Transformers have revolutionized deep learning across various tasks, including audio representation learning, due to their powerful modeling capabilities. However, they often suffer from quadratic complexity in both GPU memory usage and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Siavash Shams , Sukru Samet Dindar , Xilin Jiang , Nima Mesgarani

Point cloud segmentation is an important topic in 3D understanding that has traditionally has been tackled using either the CNN or Transformer. Recently, Mamba has emerged as a promising alternative, offering efficient long-range contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yong Xien Chng , Xuchong Qiu , Yizeng Han , Yifan Pu , Jiewei Cao , Gao Huang

Multi-view depth estimation has achieved impressive performance over various benchmarks. However, almost all current multi-view systems rely on given ideal camera poses, which are unavailable in many real-world scenarios, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zelin Meng , Zhichen Wang

Diffusion Models have become very popular for Semantic Image Synthesis (SIS) of human faces. Nevertheless, their training and inference is computationally expensive and their computational requirements are high due to the quadratic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Filippo Botti , Alex Ergasti , Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

Domain Generalization (DG) aims to enable models to generalize to unseen target domains by learning from multiple source domains. Existing DG methods primarily rely on convolutional neural networks (CNNs), which inherently learn texture…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Jintao Guo , Lei Qi , Yinghuan Shi , Yang Gao

Image correction and rectangling are valuable tasks in practical photography systems such as smartphones. Recent remarkable advancements in deep learning have undeniably brought about substantial performance improvements in these fields.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Linwei Qiu , Gongzhe Li , Xiaozhe Zhang , Qilin Sun , Fengying Xie

State-space models (SSMs) have recently emerged as a compelling alternative to Transformers for sequence modeling tasks. This paper presents a theoretical generalization analysis of selective SSMs, the core architectural component behind…

Machine Learning · Computer Science 2025-11-05 Arya Honarpisheh , Mustafa Bozdag , Octavia Camps , Mario Sznaier

Hyperspectral image (HSI) classification remains challenging due to high spectral dimensionality, redundancy, and limited labeled data. Although convolutional neural networks (CNNs) and Vision Transformers (ViTs) achieve strong performance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Mohammed Q. Alkhatib

Visual and audio events simultaneously occur and both attract attention. However, most existing saliency prediction works ignore the influence of audio and only consider vision modality. In this paper, we propose a multitask learning method…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Minglang Qiao , Yufan Liu , Mai Xu , Xin Deng , Bing Li , Weiming Hu , Ali Borji

Recent advances in speech enhancement have shown that models combining Mamba and attention mechanisms yield superior cross-corpus generalization performance. At the same time, integrating Mamba in a U-Net structure has yielded…

Sound · Computer Science 2026-01-22 Nikolai Lund Kühne , Jesper Jensen , Jan Østergaard , Zheng-Hua Tan

Current image tampering localization methods primarily rely on Convolutional Neural Networks (CNNs) and Transformers. While CNNs suffer from limited local receptive fields, Transformers offer global context modeling at the expense of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Kun Guo , Gang Cao , Zijie Lou , Xianglin Huang , Jiaoyun Liu

Weakly supervised semantic segmentation offers a label-efficient solution to train segmentation models for volumetric medical imaging. However, existing approaches often rely on 2D encoders that neglect the inherent volumetric nature of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yiheng Lyu , Lian Xu , Mohammed Bennamoun , Farid Boussaid , Coen Arrow , Girish Dwivedi

Radiography imaging protocols target on specific anatomical regions, resulting in highly consistent images with recurrent structural patterns across patients. Recent advances in medical anomaly detection have demonstrated the effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Rui Pan , Ruiying Lu

In the realm of medical image segmentation, both CNN-based and Transformer-based models have been extensively explored. However, CNNs exhibit limitations in long-range modeling capabilities, whereas Transformers are hampered by their…

Image and Video Processing · Electrical Eng. & Systems 2024-11-11 Jiacheng Ruan , Jincheng Li , Suncheng Xiang

Video understanding requires the extraction of rich spatio-temporal representations, which transformer models achieve through self-attention. Unfortunately, self-attention poses a computational burden. In NLP, Mamba has surfaced as an…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Hui Lu , Albert Ali Salah , Ronald Poppe

Skeleton Action Recognition (SAR) involves identifying human actions using skeletal joint coordinates and their interconnections. While plain Transformers have been attempted for this task, they still fall short compared to the current…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Soumyabrata Chaudhuri , Saumik Bhattacharya

In this work, we propose an accurate and real-time optical flow and disparity estimation model by fusing pairwise input images in the proposed non-causal selective state space for dense perception tasks. We propose a non-causal Mamba…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tushar Anand , Advik Sinha , Abhijit Das

"This work has been submitted to the lEEE for possible publication. Copyright may be transferred without noticeafter which this version may no longer be accessible." Time series modeling serves as the cornerstone of real-world applications,…

Machine Learning · Computer Science 2025-04-04 Sijie Xiong , Shuqing Liu , Cheng Tang , Fumiya Okubo , Haoling Xiong , Atsushi Shimada

Image inpainting, or image completion, is a crucial task in computer vision that aims to restore missing or damaged regions of images with semantically coherent content. This technique requires a precise balance of local texture replication…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Shuang Chen , Amir Atapour-Abarghouei , Haozheng Zhang , Hubert P. H. Shum