English
Related papers

Related papers: DA-Mamba: Domain Adaptive Hybrid Mamba-Transformer…

200 papers

Domain adaptive detection aims to improve the generalization of detectors on target domain. To reduce discrepancy in feature distributions between two domains, recent approaches achieve domain adaption through feature alignment in different…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Libo Zhang , Wenzhang Zhou , Heng Fan , Tiejian Luo , Haibin Ling

Object detection is essential in space applications targeting Space Domain Awareness and also applications involving relative navigation scenarios. Current deep learning models for Object Detection in space applications are often trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Samet Hicsonmez , Abd El Rahman Shabayek , Arunkumar Rathinam , Djamila Aouada

Anomaly detection in time series is essential for industrial monitoring and environmental sensing, yet distinguishing anomalies from complex patterns remains challenging. Existing methods like the Anomaly Transformer and DCdetector have…

Machine Learning · Computer Science 2025-05-20 Abdellah Zakaria Sellam , Ilyes Benaissa , Abdelmalik Taleb-Ahmed , Luigi Patrono , Cosimo Distante

The Transformer model, particularly its cross-attention module, is widely used for feature fusion in target sound extraction which extracts the signal of interest based on given clues. Despite its effectiveness, this approach suffers from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-26 Donghang Wu , Yiwen Wang , Xihong Wu , Tianshu Qu

Remote sensing change detection (CD) has made significant advancements with the adoption of Convolutional Neural Networks (CNNs) and Transformers. While CNNs offer powerful feature extraction, they are constrained by receptive field…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 JunYao Kaung , HongWei Ge

Transformer-based methods have achieved remarkable performance in event-based object detection, owing to the global modeling ability. However, they neglect the influence of non-event and noisy regions and process them uniformly, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Nan Yang , Yang Wang , Zhanwen Liu , Meng Li , Yisheng An , Xiangmo Zhao

Cell detection in pathological images presents unique challenges due to densely packed objects, subtle inter-class differences, and severe background clutter. In this paper, we propose CellMamba, a lightweight and accurate one-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Ruochen Liu , Yi Tian , Jiahao Wang , Hongbin Liu , Xianxu Hou , Jingxin Liu

Existing salient object detection (SOD) models are generally constrained by the limited receptive fields of convolutional neural networks (CNNs) and quadratic computational complexity of Transformers. Recently, the emerging state-space…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Wenzhuo Zhao , Keren Fu , Jiahao He , Xiaohong Liu , Qijun Zhao , Guangtao Zhai

Mitosis detection in histopathology images plays a key role in tumor assessment. Although machine learning algorithms could be exploited for aiding physicians in accurately performing such a task, these algorithms suffer from significative…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Gennaro Percannella , Mattia Sarno , Francesco Tortorella , Mario Vento

Recent State Space Models (SSM), especially Mamba, have demonstrated impressive performance in visual modeling and possess superior model efficiency. However, the application of Mamba to visual tasks suffers inferior performance due to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Fei Xie , Jiahao Nie , Yujin Tang , Wenkang Zhang , Hongshen Zhao

Balancing fine-grained local modeling with long-range dependency capture under computational constraints remains a central challenge in sequence modeling. While Transformers provide strong token mixing, they suffer from quadratic…

Machine Learning · Computer Science 2026-03-20 Youjin Wang , Jiaqiao Zhao , Rong Fu , Run Zhou , Ruizhe Zhang , Jiani Liang , Suisuai Cao , Feng Zhou

Attention mechanisms have been widely used to capture long-range dependencies among nodes in Graph Transformers. Bottlenecked by the quadratic computational cost, attention mechanisms fail to scale in large graphs. Recent improvements in…

Machine Learning · Computer Science 2024-02-02 Chloe Wang , Oleksii Tsepa , Jun Ma , Bo Wang

Mamba is an effective state space model with linear computation complexity. It has recently shown impressive efficiency in dealing with high-resolution inputs across various vision tasks. In this paper, we reveal that the powerful Mamba…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Dongchen Han , Ziyi Wang , Zhuofan Xia , Yizeng Han , Yifan Pu , Chunjiang Ge , Jun Song , Shiji Song , Bo Zheng , Gao Huang

Depression is a prevalent mental health disorder that severely impairs daily functioning and quality of life. While recent deep learning approaches for depression detection have shown promise, most rely on limited feature types, overlook…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Bowen Zhou , Marc-André Fiedler , Ayoub Al-Hamadi

Human engagement estimation in conversational scenarios is essential for applications such as adaptive tutoring, remote healthcare assessment, and socially aware human--computer interaction. Engagement is a dynamic, multimodal signal…

Artificial Intelligence · Computer Science 2025-09-23 Shenwei Kang , Xin Zhang , Wen Liu , Bin Li , Yujie Liu , Bo Gao

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing…

Machine Learning · Computer Science 2026-05-15 Xingsheng Chen , Xianpei Mu , Deyu Yi , Yilin Yuan , Xingwei He , Bo Gao , Regina Zhang , Pietro Lio , Siu-Ming Yiu

Cracks pose safety risks to infrastructure and cannot be overlooked. The prevailing structures in existing crack segmentation networks predominantly consist of CNNs or Transformers. However, CNNs exhibit a deficiency in global modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhili He , Yu-Hsing Wang

Semantic segmentation of remote sensing imagery is a fundamental task in computer vision, supporting a wide range of applications such as land use classification, urban planning, and environmental monitoring. However, this task is often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Qinfeng Zhu , Han Li , Liang He , Lei Fan

As one of the most representative DL techniques, Transformer architecture has empowered numerous advanced models, especially the large language models (LLMs) that comprise billions of parameters, becoming a cornerstone in deep learning.…

Machine Learning · Computer Science 2026-04-07 Haohao Qu , Liangbo Ning , Rui An , Wenqi Fan , Tyler Derr , Hui Liu , Xin Xu , Qing Li

Underwater images often suffer from severe degradation, such as color distortion, low contrast, and blurred details, due to light absorption and scattering in water. While learning-based methods like CNNs and Transformers have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Tejeswar Pokuri , Shivarth Rai