English
Related papers

Related papers: RobSurv: Vector Quantization-Based Multi-Modal Lea…

200 papers

Deep learning has shown great potential for automated medical image segmentation to improve the precision and speed of disease diagnostics. However, the task presents significant difficulties due to variations in the scale, shape, texture,…

Image and Video Processing · Electrical Eng. & Systems 2024-09-06 Shahzaib Iqbal , Tariq M. Khan , Syed S. Naqvi , Asim Naveed , Erik Meijering

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Cross-modal retrieval maps data under different modality via semantic relevance. Existing approaches implicitly assume that data pairs are well-aligned and ignore the widely existing annotation noise, i.e., noisy correspondence (NC).…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Shuai Lyu , Zijing Tian , Zhonghong Ou , Yifan Zhu , Xiao Zhang , Qiankun Ha , Haoran Luo , Meina Song

Accurate prognosis for an individual patient is a key component of precision oncology. Recent advances in machine learning have enabled the development of models using a wider range of data, including imaging. Radiomics aims to extract…

Deep learning for regression tasks on medical imaging data has shown promising results. However, compared to other approaches, their power is strongly linked to the dataset size. In this study, we evaluate 3D-convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Yannick Suter , Alain Jungo , Michael Rebsamen , Urspeter Knecht , Evelyn Herrmann , Roland Wiest , Mauricio Reyes

Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly. Accurate identification of the type and grade of tumor in the early stages plays an important role in choosing a precise…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Dunyuan Xu , Xi Wang , Jinyue Cai , Pheng-Ann Heng

Vector Quantization (VQ) has become the cornerstone of tokenization for many multimodal Large Language Models and diffusion synthesis. However, existing VQ paradigms suffer from a fundamental conflict: they enforce discretization before the…

Machine Learning · Computer Science 2026-03-25 Wenhao Zhao , Qiran Zou , Zhouhan Lin , Dianbo Liu

In tissue characterization and cancer diagnostics, multimodal imaging has emerged as a powerful technique. Thanks to computational advances, large datasets can be exploited to discover patterns in pathologies and improve diagnosis. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Eva Breznik , Elisabeth Wetzer , Joakim Lindblad , Nataša Sladoje

Breast cancer survival prediction in computational pathology presents a remarkable challenge due to tumor heterogeneity. For instance, different regions of the same tumor in the pathology image can show distinct morphological and molecular…

Image and Video Processing · Electrical Eng. & Systems 2025-03-25 Yang Luo , Shiru Wang , Jun Liu , Jiaxuan Xiao , Rundong Xue , Zeyu Zhang , Hao Zhang , Yu Lu , Yang Zhao , Yutong Xie

Multimodal machine learning integrating histopathology and molecular data shows promise for cancer prognostication. We systematically reviewed studies combining whole slide images (WSIs) and high-throughput omics to predict overall…

Quantitative Methods · Quantitative Biology 2025-07-30 Charlotte Jennings , Andrew Broad , Lucy Godson , Emily Clarke , David Westhead , Darren Treanor

Deep neural networks have reached remarkable achievements in medical image processing tasks, specifically in classifying and detecting various diseases. However, when confronted with limited data, these networks face a critical…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Matina Mahdizadeh Sani , Ali Royat , Mahdieh Soleymani Baghshah

Accurately predicting early recurrence in brain tumor patients following surgical resection remains a clinical challenge. This study proposes a multi-modal machine learning framework that integrates structural MRI features with clinical…

Machine Learning · Computer Science 2025-09-03 Cheng Cheng , Zeping Chen , Rui Xie , Peiyao Zheng , Xavier Wang

In the last few years, deep learning classifiers have shown promising results in image-based medical diagnosis. However, interpreting the outputs of these models remains a challenge. In cancer diagnosis, interpretability can be achieved by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Kangning Liu , Yiqiu Shen , Nan Wu , Jakub Chłędowski , Carlos Fernandez-Granda , Krzysztof J. Geras

Consistency learning with feature perturbation is a widely used strategy in semi-supervised medical image segmentation. However, many existing perturbation methods rely on dropout, and thus require a careful manual tuning of the dropout…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Sicheng Yang , Zhaohu Xing , Lei Zhu

Thyroid nodule classification using ultrasound imaging is essential for early diagnosis and clinical decision-making; however, despite promising performance on in-distribution data, existing deep learning methods often exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yangmei Chen , Zhongyuan Zhang , Xikun Zhang , Xinyu Hao , Mingliang Hou , Renqiang Luo , Ziqi Xu

Neural network quantization methods often involve simulating the quantization process during training, making the trained model highly dependent on the target bit-width and precise way quantization is performed. Robust quantization offers…

Machine Learning · Computer Science 2020-10-23 Moran Shkolnik , Brian Chmiel , Ron Banner , Gil Shomron , Yury Nahshan , Alex Bronstein , Uri Weiser

Cancer is one of the leading causes of death worldwide, making the development of rapid, minimally invasive, label-free and scalable diagnostic strategies a major challenge in modern oncology. In this context, spectroscopic liquid biopsy…

This research presents a machine-learning approach for tumor detection in medical images using convolutional neural networks (CNNs). The study focuses on preprocessing techniques to enhance image features relevant to tumor detection,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-01 Ha Anh Vu

Label noise in medical image classification datasets significantly hampers the training of supervised deep learning methods, undermining their generalizability. The test performance of a model tends to decrease as the label noise rate…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Bidur Khanal , Prashant Shrestha , Sanskar Amgain , Bishesh Khanal , Binod Bhattarai , Cristian A. Linte

Neurite Orientation Dispersion and Density Imaging (NODDI) is an important imaging technology used to evaluate the microstructure of brain tissue, which is of great significance for the discovery and treatment of various neurological…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Taohui Xiao , Jian Cheng , Wenxin Fan , Jing Yang , Cheng Li , Enqing Dong , Shanshan Wang