English
Related papers

Related papers: Multi-Modal Mamba Modeling for Survival Prediction…

200 papers

Convolutional neural networks and Transformer have made significant progresses in multi-modality medical image super-resolution. However, these methods either have a fixed receptive field for local learning or significant computational…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Zexin Ji , Beiji Zou , Xiaoyan Kui , Sebastien Thureau , Su Ruan

Existing salient object detection (SOD) models are generally constrained by the limited receptive fields of convolutional neural networks (CNNs) and quadratic computational complexity of Transformers. Recently, the emerging state-space…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Wenzhuo Zhao , Keren Fu , Jiahao He , Xiaohong Liu , Qijun Zhao , Guangtao Zhai

In the design of surgical guides for implant placement, determining the precise implant position is a critical step. However, the implant region itself is often characterized by a lack of distinctive texture in medical images. Consequently,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Xinquan Yang , Congmin Wang , Xuguang Li , Yulei Li , Linlin Shen , Yongqiang Deng He Meng

Accurate medical image segmentation demands the integration of multi-scale information, spanning from local features to global dependencies. However, it is challenging for existing methods to model long-range global information, where…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Jiarun Liu , Hao Yang , Hong-Yu Zhou , Yan Xi , Lequan Yu , Yizhou Yu , Yong Liang , Guangming Shi , Shaoting Zhang , Hairong Zheng , Shanshan Wang

Mamba-based models have recently demonstrated significant potential in hyperspectral image (HSI) classification, primarily due to their ability to perform contextual modeling with linear computational complexity. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Yichu Xu , Di Wang , Hongzan Jiao , Lefei Zhang , Liangpei Zhang

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this paradigm due to their…

Effective understanding of a disease such as cancer requires fusing multiple sources of information captured across physical scales by multimodal data. In this work, we propose a novel feature embedding module that derives from canonical…

Machine Learning · Computer Science 2021-03-10 Vaishnavi Subramanian , Tanveer Syeda-Mahmood , Minh N. Do

Molecular representation learning plays a crucial role in various downstream tasks, such as molecular property prediction and drug design. To accurately represent molecules, Graph Neural Networks (GNNs) and Graph Transformers (GTs) have…

Machine Learning · Computer Science 2025-02-07 Jingjing Hu , Dan Guo , Zhan Si , Deguang Liu , Yunfeng Diao , Jing Zhang , Jinxing Zhou , Meng Wang

Accurate survival prediction is essential for personalised cancer treatment. We propose ModalSurv, a multimodal deep survival framework integrating clinical, MRI, histopathology, and RNA-sequencing data via modality-specific projections and…

Machine Learning · Computer Science 2025-12-19 Noorul Wahab , Ethar Alzaid , Jiaqi Lv , Fayyaz Minhas , Adam Shephard , Shan E Ahmed Raza

Reliable 3D object detection is fundamental to autonomous driving, and multimodal fusion algorithms using cameras and LiDAR remain a persistent challenge. Cameras provide dense visual cues but ill posed depth; LiDAR provides a precise 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Venkatraman Narayanan , Bala Sai , Rahul Ahuja , Pratik Likhar , Varun Ravi Kumar , Senthil Yogamani

The Mamba architecture has been widely applied to various low-level vision tasks due to its exceptional adaptability and strong performance. Although the Mamba architecture has been adopted for spectral reconstruction, it still faces the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Yuze Zhang , Lingjie Li , Qiuzhen Lin , Zhong Ming , Fei Yu , Victor C. M. Leung

Although Mamba models greatly improve Hyperspectral Image (HSI) classification, they have critical challenges in terms defining efficient and adaptive token sequences for improve performance. This paper therefore presents CSSMamba…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Zack Dewis , Yimin Zhu , Zhengsen Xu , Mabel Heffring , Saeid Taleghanidoozdoozan , Quinn Ledingham , Lincoln Linlin Xu

Early and accurate prediction of overall survival (OS) time can help to obtain better treatment planning for brain tumor patients. Although many OS time prediction methods have been developed and obtain promising results, there are still…

Image and Video Processing · Electrical Eng. & Systems 2020-07-16 Tao Zhou , Huazhu Fu , Yu Zhang , Changqing Zhang , Xiankai Lu , Jianbing Shen , Ling Shao

In computed tomography imaging, metal implants frequently generate severe artifacts that compromise image quality and hinder diagnostic accuracy. There are three main challenges in the existing methods: the deterioration of organ and tissue…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Weikai Qu , Sijun Liang , Xianfeng Li , Cheng Pan , An Yan , Ahmed Elazab , Shanzhou Niu , Dong Zeng , Xiang Wan , Changmiao Wang

We propose a novel hybrid Mamba-Transformer backbone, MambaVision, specifically tailored for vision applications. Our core contribution includes redesigning the Mamba formulation to enhance its capability for efficient modeling of visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ali Hatamizadeh , Jan Kautz

Survival prediction of cancers is crucial for clinical practice, as it informs mortality risks and influences treatment plans. However, a static model trained on a single dataset fails to adapt to the dynamically evolving clinical…

Machine Learning · Computer Science 2026-01-21 Dianzhi Yu , Conghao Xiong , Yankai Chen , Wenqian Cui , Xinni Zhang , Yifei Zhang , Hao Chen , Joseph J. Y. Sung , Irwin King

Multimodal survival prediction, a crucial yet challenging task, demands the integration of multimodal medical data (\eg Whole Slide Images (WSIs) and Genomic Profiles) to achieve accurate prognostic modeling. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Huayi Wang , Haochao Ying , Yuyang Xu , Qiyao Zheng , jun wang , Cheng Zhang , Ying Sun , Jian Wu

Traditionally for improving the segmentation performance of models, most approaches prefer to use adding more complex modules. And this is not suitable for the medical field, especially for mobile medical devices, where computationally…

Image and Video Processing · Electrical Eng. & Systems 2025-06-30 Renkai Wu , Yinghao Liu , Pengchen Liang , Qing Chang

"This work has been submitted to the lEEE for possible publication. Copyright may be transferred without noticeafter which this version may no longer be accessible." Time series modeling serves as the cornerstone of real-world applications,…

Machine Learning · Computer Science 2025-04-04 Sijie Xiong , Shuqing Liu , Cheng Tang , Fumiya Okubo , Haoling Xiong , Atsushi Shimada

Computer-aided cancer survival risk prediction plays an important role in the timely treatment of patients. This is a challenging weakly supervised ordinal regression task associated with multiple clinical factors involved such as…

Machine Learning · Computer Science 2024-09-05 Zekang Yang , Hong Liu , Xiangdong Wang