English
Related papers

Related papers: A Multimodal Object-level Contrast Learning Method…

200 papers

Classification-based image retrieval systems are built by training convolutional neural networks (CNNs) on a relevant classification problem and using the distance in the resulting feature space as a similarity metric. However, in practical…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Maxim Pisov , Gleb Makarchuk , Valery Kostjuchenko , Alexandra Dalechina , Andrey Golanov , Mikhail Belyaev

With the long-term rapid increase in incidences of colorectal cancer (CRC), there is an urgent clinical need to improve risk stratification. The conventional pathology report is usually limited to only a few histopathological features.…

Image and Video Processing · Electrical Eng. & Systems 2020-07-08 Christian Abbet , Inti Zlobec , Behzad Bozorgtabar , Jean-Philippe Thiran

Identifying important biomarkers that are predictive for cancer patients' prognosis is key in gaining better insights into the biological influences on the disease and has become a critical component of precision medicine. The emergence of…

Methodology · Statistics 2016-03-22 Hyokyoung Grace Hong , Jian Kang , Yi Li

Multimodal pathology-genomic analysis is critical for cancer survival prediction. However, existing approaches predominantly integrate formalin-fixed paraffin-embedded (FFPE) slides with genomic data, while neglecting the availability of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Mingcheng Qu , Guang Yang , Donglin Di , Yue Gao , Tonghua Su , Yang Song , Lei Fan

Deep Learning (DL) can predict biomarkers from cancer histopathology. Several clinically approved applications use this technology. Most approaches, however, predict categorical labels, whereas biomarkers are often continuous measurements.…

Contrastive learning has emerged as a competitive pretraining method for object detection. Despite this progress, there has been minimal investigation into the robustness of contrastively pretrained detectors when faced with domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Kyle Buettner , Adriana Kovashka

Computational pathology models that use digitized histopathology whole-slide images have the potential to become a cost-effective and scalable alternative to molecular assays for the prediction of genomic biomarkers, a key task in precision…

Quantitative Methods · Quantitative Biology 2026-03-03 Ekaterina Redekop , Eric Zimmermann , Ava P Amini , Alex X Lu , Neil Tenenholtz , James Brian Hall , Lorin Crawford , Kristen A Severson

As the real propagation environment becomes in creasingly complex and dynamic, millimeter wave beam prediction faces huge challenges. However, the powerful cross modal representation capability of vision-language model (VLM) provides a…

Signal Processing · Electrical Eng. & Systems 2025-08-18 Ji Wang , Bin Tang , Jian Xiao , Qimei Cui , Xingwang Li , Tony Q. S. Quek

Large medical imaging datasets can be cheaply and quickly annotated with low-confidence, weak labels (e.g., radiological scores). Access to high-confidence labels, such as histology-based diagnoses, is rare and costly. Pretraining…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Emma Sarfati , Alexandre Bône , Marc-Michel Rohé , Pietro Gori , Isabelle Bloch

Medical image segmentation is a fundamental yet challenging task due to the arduous process of acquiring large volumes of high-quality labeled data from experts. Contrastive learning offers a promising but still problematic solution to this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shuang Zeng , Lei Zhu , Xinliang Zhang , Micky C Nnamdi , Wenqi Shi , J Ben Tamo , Qian Chen , Hangzhou He , Lujia Jin , Zifeng Tian , Qiushi Ren , Zhaoheng Xie , Yanye Lu

Survival analysis is essential for clinical decision-making, as it allows practitioners to estimate time-to-event outcomes, stratify patient risk profiles, and guide treatment planning. Deep learning has revolutionized this field with…

Machine Learning · Computer Science 2026-02-03 Pinar Erbil , Alberto Archetti , Eugenio Lomurno , Matteo Matteucci

Lung cancer is the leading cause of death among different types of cancers. Every year, the lives lost due to lung cancer exceed those lost to pancreatic, breast, and prostate cancer combined. The survival rate for lung cancer patients is…

Image and Video Processing · Electrical Eng. & Systems 2023-02-17 Saleh Abunajm , Nelly Elsayed , Zag ElSayed , Murat Ozer

Recently, we have witnessed impressive achievements in cancer survival analysis by integrating multimodal data, e.g., pathology images and genomic profiles. However, the heterogeneity and high dimensionality of these modalities pose…

Image and Video Processing · Electrical Eng. & Systems 2024-12-30 Huajun Zhou , Fengtao Zhou , Hao Chen

A two-stage training paradigm consisting of sequential pre-training and meta-training stages has been widely used in current few-shot learning (FSL) research. Many of these methods use self-supervised learning and contrastive learning to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Zhanyuan Yang , Jinghua Wang , Yingying Zhu

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

Contrastive learning is a cornerstone underlying recent progress in multi-view and multimodal learning, e.g., in representation learning with image/caption pairs. While its effectiveness is not yet fully understood, a line of recent work…

Machine Learning · Computer Science 2023-03-17 Imant Daunhawer , Alice Bizeul , Emanuele Palumbo , Alexander Marx , Julia E. Vogt

Cancer is a complex disease that provides various types of information depending on the scale of observation. While most tumor diagnostics are performed by observing histopathological slides, radiology images should yield additional…

Image and Video Processing · Electrical Eng. & Systems 2020-10-07 Marvin Lerousseau , Eric Deutsh , Nikos Paragios

Multi-modal contrastive learning with language supervision has presented a paradigm shift in modern machine learning. By pre-training on a web-scale dataset, multi-modal contrastive learning can learn high-quality representations that…

Machine Learning · Computer Science 2024-11-06 Wei Huang , Andi Han , Yongqiang Chen , Yuan Cao , Zhiqiang Xu , Taiji Suzuki

The ability to evolve is fundamental for any valuable autonomous agent whose knowledge cannot remain limited to that injected by the manufacturer. Consider for example a home assistant robot: it should be able to incrementally learn new…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Francesco Cappio Borlino , Silvia Bucci , Tatiana Tommasi

Risk stratification is a key tool in clinical decision-making, yet current approaches often fail to translate sophisticated survival analysis into actionable clinical criteria. We present a novel method for unsupervised machine learning…