English
Related papers

Related papers: ProPath: Disease-Specific Protein Language Model f…

200 papers

With the rapid development of computational pathology, many AI-assisted diagnostic tasks have emerged. Cellular nuclei segmentation can segment various types of cells for downstream analysis, but it relies on predefined categories and lacks…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Chunlin Zhong , Shuang Hao , Junhua Wu , Xiaona Chang , Jiwei Jiang , Xiu Nie , He Tang , Xiang Bai

Recent advances in vision language models (VLMs) have enabled broad progress in the general medical field. However, pathology still remains a more challenging subdomain, with current pathology specific VLMs exhibiting limitations in both…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenchuan Zhang , Penghao Zhang , Jingru Guo , Tao Cheng , Jie Chen , Shuwan Zhang , Zhang Zhang , Yuhao Yi , Hong Bu

Using language models (LMs) pre-trained in a self-supervised setting on large corpora and then fine-tuning for a downstream task has helped to deal with the problem of limited label data for supervised learning tasks such as Named Entity…

Computation and Language · Computer Science 2023-08-21 Pavlova Vera , Mohammed Makhlouf

A visual-language model (VLM) pre-trained on natural images and text pairs poses a significant barrier when applied to medical contexts due to domain shift. Yet, adapting or fine-tuning these VLMs for medical use presents considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Aisha Urooj Khan , John Garrett , Tyler Bradshaw , Lonie Salkowski , Jiwoong Jason Jeong , Amara Tariq , Imon Banerjee

Large pre-trained vision-language models, such as CLIP, have shown remarkable generalization capabilities across various tasks when appropriate text prompts are provided. However, adapting these models to specific domains, like remote…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Qinglong Cao , Zhengqin Xu , Yuntian Chen , Chao Ma , Xiaokang Yang

Background: Recruitment for cohorts involving complex liver diseases, such as hepatocellular carcinoma and liver cirrhosis, often requires interpreting semantically complex criteria. Traditional manual screening methods are time-consuming…

Artificial Intelligence · Computer Science 2025-02-27 Xiongbin Gui , Hanlin Lv , Xiao Wang , Longting Lv , Yi Xiao , Lei Wang

State of the art speech enhancement (SE) models achieve strong performance on neurotypical speech, but their effectiveness is substantially reduced for pathological speech. In this paper, we investigate strategies to address this gap for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Mingchi Hou , Ante Jukic , Ina Kodrasi

Proteins govern most biological functions essential for life, but achieving controllable protein discovery and optimization remains challenging. Recently, machine learning-assisted protein editing (MLPE) has shown promise in accelerating…

Artificial Intelligence · Computer Science 2024-11-19 Mingze Yin , Hanjing Zhou , Yiheng Zhu , Miao Lin , Yixuan Wu , Jialu Wu , Hongxia Xu , Chang-Yu Hsieh , Tingjun Hou , Jintai Chen , Jian Wu

Multimodal large language models (MLLMs) have emerged as powerful tools for computational pathology, offering unprecedented opportunities to integrate pathological images with language context for comprehensive diagnostic analysis. These…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Zhe Xu , Ziyi Liu , Junlin Hou , Jiabo Ma , Cheng Jin , Yihui Wang , Zhixuan Chen , Zhengyu Zhang , Fuxiang Huang , Zhengrui Guo , Fengtao Zhou , Yingxue Xu , Xi Wang , Ronald Cheong Kin Chan , Li Liang , Hao Chen

Accurately predicting gene mutations, mutation subtypes and their exons in lung cancer is critical for personalized treatment planning and prognostic assessment. Faced with regional disparities in medical resources and the high cost of…

Genomics · Quantitative Biology 2025-12-01 Liangrui Pan , Qingchun Liang , Shen Zhao , Songqing Fan , Shaoliang Peng

Prompt-based fine-tuning for pre-trained models has proven effective for many natural language processing tasks under few-shot settings in general domain. However, tuning with prompt in biomedical domain has not been investigated…

Computation and Language · Computer Science 2023-04-17 Haochun Wang , Chi Liu , Nuwa Xi , Sendong Zhao , Meizhi Ju , Shiwei Zhang , Ziheng Zhang , Yefeng Zheng , Bing Qin , Ting Liu

Medical decision-making requires integrating diverse medical information, from imaging to clinical narratives. These medical modalities are often acquired in a many-to-many manner. However, current medical vision-language pretraining models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuan Gao , Sangwook Kim , Jianzhong You , Chris McIntosh

Pre-trained models have been successful in many protein engineering tasks. Most notably, sequence-based models have achieved state-of-the-art performance on protein fitness prediction while structure-based models have been used…

Machine Learning · Computer Science 2023-07-25 Antonia Boca , Simon Mathis

Pretrained biomedical vision-language models (VLMs) such as BioMedCLIP perform well on average but often degrade on challenging modalities where inter-class margins are small and acquisition-specific variations are pronounced, especially…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Mainak Singha , Tanisha Gupta , Ankit Jha , Muhammad Haris Khan , Sayantani Ghosh , Biplab Banerjee

Recent advances in protein language models (PLMs) have demonstrated remarkable capabilities in understanding protein sequences. However, the extent to which different model architectures capture antibody-specific biological properties…

Machine Learning · Computer Science 2025-12-11 Mengren , Liu , Yixiang Zhang , Yiming , Zhang

As natural image understanding moves towards the pretrain-finetune era, research in pathology imaging is concurrently evolving. Despite the predominant focus on pretraining pathological foundation models, how to adapt foundation models to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jiaxuan Lu , Fang Yan , Xiaofan Zhang , Yue Gao , Shaoting Zhang

Prompt learning is one of the most effective paradigms for adapting pre-trained vision-language models (VLMs) to the biomedical image classification tasks in few shot scenarios. However, most of the current prompt learning methods only used…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Wei Peng , Kang Liu , Jianchen Hu , Meng Zhang

Antibody therapeutics are among the most successful modern medicines, yet computationally designing antibodies with desirable binding and developability properties remains challenging. While protein language models (pLMs) have emerged as…

Machine Learning · Computer Science 2026-05-11 Justin Sanders , Luca Giancardo , Lan Guo , Yue Zhao , Kemal Sonmez , Nina Cheng , Melih Yilmaz

Prototype-based neural networks offer interpretable predictions by comparing inputs to learned, representative signal patterns anchored in training data. While such models have shown promise in the classification of physiological data, it…

Machine Learning · Computer Science 2026-05-28 Sahil Sethi , David Chen , Michael C. Burkhart , Nipun Bhandari , Bashar Ramadan , Brett Beaulieu-Jones

Whole slide pathology image classification presents challenges due to gigapixel image sizes and limited annotation labels, hindering model generalization. This paper introduces a prompt learning method to adapt large vision-language models…