English
Related papers

Related papers: MMSF: Multitask and Multimodal Supervised Framewor…

200 papers

Multimodal data provides heterogeneous information for a holistic understanding of the tumor microenvironment. However, existing AI models often struggle to harness the rich information within multimodal data and extract poorly…

Machine Learning · Computer Science 2025-09-17 Huajun Zhou , Fengtao Zhou , Jiabo Ma , Yingxue Xu , Xi Wang , Xiuming Zhang , Li Liang , Zhenhui Li , Hao Chen

Gait recognition is a biometric technology that has received extensive attention. Most existing gait recognition algorithms are unimodal, and a few multimodal gait recognition algorithms perform multimodal fusion only once. None of these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Shinan Zou , Jianbo Xiong , Chao Fan , Shiqi Yu , Jin Tang

Multimodal Fusion Learning (MFL), leveraging disparate data from various imaging modalities (e.g., MRI, CT, SPECT), has shown great potential for addressing medical problems such as skin cancer and brain tumor prediction. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Joy Dhar , Nayyar Zaidi , Maryam Haghighat

Advancements in digital imaging technologies have sparked increased interest in using multiplexed immunofluorescence (mIF) images to visualise and identify the interactions between specific immunophenotypes with the tumour microenvironment…

Image and Video Processing · Electrical Eng. & Systems 2024-07-01 Piumi Sandarenu , Julia Chen , Iveta Slapetova , Lois Browne , Peter H. Graham , Alexander Swarbrick , Ewan K. A. Millar , Yang Song , Erik Meijering

The integration of DNA methylation data with a Whole Slide Image (WSI) offers significant potential for enhancing the diagnostic precision of central nervous system (CNS) tumor classification in neuropathology. While existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Omnia Alwazzan , Amaya Gallagher-Syed , Thomas O. Millner , Sebastian Brandner , Ioannis Patras , Silvia Marino , Gregory Slabaugh

With the rapid advances in high-throughput sequencing technologies, the focus of survival analysis has shifted from examining clinical indicators to incorporating genomic profiles with pathological images. However, existing methods either…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Fengtao Zhou , Hao Chen

Software vulnerability detection can be formulated as a binary classification problem that determines whether a given code snippet contains security defects. Existing multimodal methods typically fuse Natural Code Sequence (NCS)…

Software Engineering · Computer Science 2026-04-24 Yun Bian , Yi Chen , HaiQuan Wang , ShiHao Li , Zhe Cui

Leveraging multimodal information from Magnetic Resonance Imaging (MRI) plays a vital role in lesion segmentation, especially for brain tumors. However, in clinical practice, multimodal MRI data are often incomplete, making it challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yulong Zou , Bo Liu , Cun-Jing Zheng , Yuan-ming Geng , Siyue Li , Qiankun Zuo , Shuihua Wang , Yudong Zhang , Jin Hong

The integration of pathologic images and genomic data for survival analysis has gained increasing attention with advances in multimodal learning. However, current methods often ignore biological characteristics, such as heterogeneity and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Shuaiyu Zhang , Xun Lin , Rongxiang Zhang , Yu Bai , Yong Xu , Tao Tan , Xunbin Zheng , Zitong Yu

Feature selection is essential for high-dimensional biomedical data, enabling stronger predictive performance, reduced computational cost, and improved interpretability in precision medicine applications. Existing approaches face notable…

Machine Learning · Computer Science 2026-01-07 Xiaoyan Sun , Qingyu Meng , Yalu Wen

Multimodal survival prediction, a crucial yet challenging task, demands the integration of multimodal medical data (\eg Whole Slide Images (WSIs) and Genomic Profiles) to achieve accurate prognostic modeling. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Huayi Wang , Haochao Ying , Yuyang Xu , Qiyao Zheng , jun wang , Cheng Zhang , Ying Sun , Jian Wu

Whole Slide Image (WSI) analysis is pivotal in computational pathology, enabling cancer diagnosis by integrating morphological and architectural cues across magnifications. Multiple Instance Learning (MIL) serves as the standard framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Sicheng Chen , Chad Wong , Tianyi Zhang , Enhui Chai , Zeyu Liu , Fei Xia

Representation learning of pathology whole-slide images (WSIs) has primarily relied on weak supervision with Multiple Instance Learning (MIL). This approach leads to slide representations highly tailored to a specific clinical task.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tim Lenz , Peter Neidlinger , Marta Ligero , Georg Wölflein , Marko van Treeck , Jakob Nikolas Kather

With the emergence of multimodal electronic health records, the evidence for an outcome may be captured across multiple modalities ranging from clinical to imaging and genomic data. Predicting outcomes effectively requires fusion frameworks…

Multivariate time series classification (MTSC) plays a crucial role in various domains, including biomedical signal analysis and motion monitoring. However, existing approaches, particularly deep learning models, often require high…

Machine Learning · Computer Science 2026-04-20 Fernando Moro , Vinicius M. A. Souza

Chest X-ray imaging is a critical diagnostic tool for identifying pulmonary diseases. However, manual interpretation of these images is time-consuming and error-prone. Automated systems utilizing convolutional neural networks (CNNs) have…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Saurabh Agarwal , K. V. Arya , Yogesh Kumar Meena

Magnetic resonance imaging (MRI) image segmentation is crucial in diagnosing and treating many diseases, such as brain tumors. Existing MRI image segmentation methods mainly fall into a centralized multimodal paradigm, which is inapplicable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Guyue Hu , Siyuan Song , Jingpeng Sun , Zhe Jin , Chenglong Li , Jin Tang

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

We present a tool for resolution recovery in multimodal clinical magnetic resonance imaging (MRI). Such images exhibit great variability, both biological and instrumental. This variability makes automated processing with neuroimaging…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Mikael Brudfors , Yael Balbastre , Parashkev Nachev , John Ashburner

Multimode fibers (MMFs) can transmit multiple guided modes simultaneously, making them a promising platform for high-resolution biomedical imaging, endoscopy and high-bandwidth optical communication. However, their complex modal behavior,…

Optics · Physics 2026-05-28 Dvir Marsh , Lior Fridman , Stav Lotan , Amit Kam , Shie Mannor , Guy Bartal