English
Related papers

Related papers: A Large-Scale Benchmark of Cross-Modal Learning fo…

200 papers

Universal, transferable whole-slide image (WSI) representations are central to computational pathology. Incorporating multiple markers (e.g., immunohistochemistry, IHC) alongside H&E enriches H&E-based features with diverse, biologically…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Yizhi Zhang , Lei Fan , Zhulin Tao , Donglin Di , Yang Song , Sidong Liu , Cong Cong

Recent studies have shown that code language models at scale demonstrate significant performance gains on downstream tasks, i.e., code generation. However, most of the existing works on code representation learning train models at a hundred…

Computation and Language · Computer Science 2024-02-06 Dejiao Zhang , Wasi Ahmad , Ming Tan , Hantian Ding , Ramesh Nallapati , Dan Roth , Xiaofei Ma , Bing Xiang

Medical vision-language pre-training methods mainly leverage the correspondence between paired medical images and radiological reports. Although multi-view spatial images and temporal sequences of image-report pairs are available in…

Artificial Intelligence · Computer Science 2024-05-31 Jinxia Yang , Bing Su , Wayne Xin Zhao , Ji-Rong Wen

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathology whole-slide images, gene expression, and pathology reports, yet most existing approaches require fully paired and complete…

Machine Learning · Computer Science 2026-04-08 Kai Yu , Shuang Zhou , Yiran Song , Zaifu Zhan , Jie Peng , Kaixiong Zhou , Tianlong Chen , Feng Xie , Meng Wang , Huazhu Fu , Mingquan Lin , Rui Zhang

Recently, there has been great interest in learning how to best represent proteins, specifically with fixed-length embeddings. Deep learning has become a popular tool for protein representation learning as a model's hidden layers produce…

Biomolecules · Quantitative Biology 2020-11-09 Amir Shanehsazzadeh , David Belanger , David Dohan

Predicting gene function from its DNA sequence is a fundamental challenge in biology. Many deep learning models have been proposed to embed DNA sequences and predict their enzymatic function, leveraging information in public databases…

The pre-training and fine-tuning methods have gained widespread attention in the field of heterogeneous graph neural networks due to their ability to leverage large amounts of unlabeled data during the pre-training phase, allowing the model…

Machine Learning · Computer Science 2025-07-11 Pengfei Jiao , Jialong Ni , Di Jin , Xuan Guo , Huan Liu , Hongjiang Chen , Yanxian Bi

In biological research, fluorescence staining is a key technique to reveal the locations and morphology of subcellular structures. However, it is slow, expensive, and harmful to cells. In this paper, we model it as a deep learning task…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Donghao Zhou , Chunbin Gu , Junde Xu , Furui Liu , Qiong Wang , Guangyong Chen , Pheng-Ann Heng

Molecular subtyping of breast cancer is crucial for personalized treatment and prognosis. Traditional classification approaches rely on either histopathological images or gene expression profiling, limiting their predictive power. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Amin Honarmandi Shandiz

Protein language models often take into consideration the alignment between a protein sequence and its textual description. However, they do not take structural information into consideration. Traditional methods treat sequence and…

Machine Learning · Computer Science 2026-03-10 Aditya Ranganath , Hasin Us Sami , Kowshik Thopalli , Bhavya Kailkhura , Wesam Sakla

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Zhe Li , Laurence T. Yang , Bocheng Ren , Xin Nie , Zhangyang Gao , Cheng Tan , Stan Z. Li

The self-supervised pretraining paradigm has achieved great success in learning 3D action representations for skeleton-based action recognition using contrastive learning. However, learning effective representations for skeleton-based…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Qiushuo Cheng , Jingjing Liu , Catherine Morgan , Alan Whone , Majid Mirmehdi

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Zhiyun Song , Penghui Du , Junpeng Yan , Kailu Li , Jianzhong Shou , Maode Lai , Yubo Fan , Yan Xu

Modeling the relationship between chemical structure and molecular activity is a key goal in drug development. Many benchmark tasks have been proposed for molecular property prediction, but these tasks are generally aimed at specific,…

Quantitative Methods · Quantitative Biology 2020-10-05 Samuel G. Finlayson , Matthew B. A. McDermott , Alex V. Pickering , Scott L. Lipnick , Isaac S. Kohane

Sleep stage classification is crucial for detecting patients' health conditions. Existing models, which mainly use Convolutional Neural Networks (CNN) for modelling Euclidean data and Graph Convolution Networks (GNN) for modelling…

Machine Learning · Computer Science 2023-09-06 Yuze Liu , Ziming Zhao , Tiehua Zhang , Kang Wang , Xin Chen , Xiaowei Huang , Jun Yin , Zhishu Shen

Limited availability of labeled physiological data often prohibits the use of powerful supervised deep learning models in the biomedical machine intelligence domain. We approach this problem and propose a novel encoding framework that…

Machine Learning · Computer Science 2023-06-13 Philipp Hallgarten , David Bethge , Ozan Özdenizci , Tobias Grosse-Puppendahl , Enkelejda Kasneci

We propose a Deep learning-based weak label learning method for analyzing whole slide images (WSIs) of Hematoxylin and Eosin (H&E) stained tumor tissue not requiring pixel-level or tile-level annotations using Self-supervised pre-training…

Image and Video Processing · Electrical Eng. & Systems 2023-06-29 Yoni Schirris , Efstratios Gavves , Iris Nederlof , Hugo Mark Horlings , Jonas Teuwen

Digital pathology has fundamentally altered diagnostic workflows by enabling the computational analysis of gigapixel Whole Slide Images (WSIs), yet effectively deciphering their complex tumor microenvironments remains a formidable…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xuemei Qiu , Dawei Fan , Yebin Huang , Yanping Chen , Lifang Wei

With growing emphasis on personalized cancer-therapies,radiogenomics has shown promise in identifying target tumor mutational status on routine imaging (i.e. MRI) scans. These approaches fall into 2 categories: (1) deep-learning/radiomics…