English
Related papers

Related papers: Context-Gated Cross-Modal Perception with Visual M…

200 papers

In the field of multimodal medical data analysis, leveraging diverse types of data and understanding their hidden relationships continues to be a research focus. The main challenges lie in effectively modeling the complex interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xuhao Shan , Ruiquan Ge , Jikui Liu , Linglong Wu , Chi Zhang , Siqi Liu , Wenjian Qin , Wenwen Min , Ahmed Elazab , Changmiao Wang

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

Multi-modal fusion is crucial for Internet of Things (IoT) perception, widely deployed in smart homes, intelligent transport, industrial automation, and healthcare. However, existing systems often face challenges: high model complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Weiqi Yang , Xu Zhou , Jingfu Guan , Hao Du , Tianyu Bai

Cell detection in pathological images presents unique challenges due to densely packed objects, subtle inter-class differences, and severe background clutter. In this paper, we propose CellMamba, a lightweight and accurate one-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Ruochen Liu , Yi Tian , Jiahao Wang , Hongbin Liu , Xianxu Hou , Jingxin Liu

In recent years, deep learning has shown near-expert performance in segmenting complex medical tissues and tumors. However, existing models are often task-specific, with performance varying across modalities and anatomical regions.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 T-Mai Bui , Fares Bougourzi , Fadi Dornaika , Vinh Truong Hoang

Deep learning, particularly convolutional neural networks (CNNs) and Transformers, has significantly advanced 3D medical image segmentation. While CNNs are highly effective at capturing local features, their limited receptive fields may…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Chenyuan Bian , Nan Xia , Xia Yang , Feifei Wang , Fengjiao Wang , Bin Wei , Qian Dong

Contrast-enhanced computed tomography (CECT) is the primary imaging technique that provides valuable spatial-temporal information about lesions, enabling the accurate diagnosis and subclassification of pancreatic tumors. However, the high…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Zhifang Gong , Shuo Gao , Ben Zhao , Yingjing Xu , Yijun Yang , Shenghong Ju , Guangquan Zhou

Nuclei panoptic segmentation supports cancer diagnostics by integrating both semantic and instance segmentation of different cell types to analyze overall tissue structure and individual nuclei in histopathology images. Major challenges…

Image and Video Processing · Electrical Eng. & Systems 2026-01-26 Ming Kang , Fung Fung Ting , Raphaël C. -W. Phan , Zongyuan Ge , Chee-Ming Ting

In recent years, Visual Question Localized-Answering in robotic surgery (Surgical-VQLA) has gained significant attention for its potential to assist medical students and junior doctors in understanding surgical scenes. Recently, the rapid…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Pengfei Hao , Hongqiu Wang , Shuaibo Li , Zhaohu Xing , Guang Yang , Kaishun Wu , Lei Zhu

Medical visual question answering (Med-VQA) is a crucial multimodal task in clinical decision support and telemedicine. Recent self-attention based methods struggle to effectively handle cross-modal semantic alignments between vision and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Qiangguo Jin , Xianyao Zheng , Hui Cui , Changming Sun , Yuqi Fang , Cong Cong , Ran Su , Leyi Wei , Ping Xuan , Junbo Wang

Semantic segmentation of multi-source remote sensing images is a fundamental task for Earth observation applications. Existing methods often struggle with insufficient multi-scale context modeling and suboptimal cross-modal feature fusion,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Feng Gao , Zhilin Jin , Yanhai Gan , Junyu Dong , Qian Du

Reliable 3D object detection is fundamental to autonomous driving, and multimodal fusion algorithms using cameras and LiDAR remain a persistent challenge. Cameras provide dense visual cues but ill posed depth; LiDAR provides a precise 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Venkatraman Narayanan , Bala Sai , Rahul Ahuja , Pratik Likhar , Varun Ravi Kumar , Senthil Yogamani

Polyp segmentation in colonoscopy is crucial for detecting colorectal cancer. However, it is challenging due to variations in the structure, color, and size of polyps, as well as the lack of clear boundaries with surrounding tissues.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Tapas Kumar Dutta , Snehashis Majhi , Deepak Ranjan Nayak , Debesh Jha

Multi-modality image fusion aims to integrate the merits of images from different sources and render high-quality fusion images. However, existing feature extraction and fusion methods are either constrained by inherent local reduction bias…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Chenguang Zhu , Shan Gao , Huafeng Chen , Guangqian Guo , Chaowei Wang , Yaoxing Wang , Chen Shu Lei , Quanjiang Fan

Cross-modal alignment is crucial for multimodal representation fusion due to the inherent heterogeneity between modalities. While Transformer-based methods have shown promising results in modeling inter-modal relationships, their quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

State-space models (SSMs) have recently shown promise in capturing long-range dependencies with subquadratic computational complexity, making them attractive for various applications. However, purely SSM-based models face critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Abdelrahman Shaker , Syed Talal Wasim , Salman Khan , Juergen Gall , Fahad Shahbaz Khan

Active Surveillance (AS) is a treatment option for managing low and intermediate-risk prostate cancer (PCa), aiming to avoid overtreatment while monitoring disease progression through serial MRI and clinical follow-up. Accurate prostate…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yovin Yahathugoda , Davide Prezzi , Piyalitt Ittichaiwong , Vicky Goh , Sebastien Ourselin , Michela Antonelli

Image segmentation holds a vital position in the realms of diagnosis and treatment within the medical domain. Traditional convolutional neural networks (CNNs) and Transformer models have made significant advancements in this realm, but they…

Image and Video Processing · Electrical Eng. & Systems 2024-05-06 Hao Tang , Lianglun Cheng , Guoheng Huang , Zhengguang Tan , Junhao Lu , Kaihong Wu

Image fusion integrates complementary information from different modalities to generate high-quality fused images, thereby enhancing downstream tasks such as object detection and semantic segmentation. Unlike task-specific techniques that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yingying Wang , Rongjin Zhuang , Hui Zheng , Xuanhua He , Ke Cao , Xiaotong Tu , Xinghao Ding

Achieving both high accuracy and topological continuity in road segmentation from satellite imagery is a critical goal for applications ranging from urban planning to disaster response. State-of-the-art methods often rely on Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jules Decaestecker , Nicolas Vigne