English
Related papers

Related papers: ProPath: Disease-Specific Protein Language Model f…

200 papers

Pre-trained language models (PLMs), such as BERT and GPT, have revolutionized the field of NLP, not only in the general domain but also in the biomedical domain. Most prior efforts in building biomedical PLMs have resorted simply to domain…

Computation and Language · Computer Science 2022-03-03 Quan Wang , Songtai Dai , Benfeng Xu , Yajuan Lyu , Yong Zhu , Hua Wu , Haifeng Wang

Cell and immunotherapy offer transformative potential for treating diseases like cancer and autoimmune disorders by modulating the immune system. The development of these therapies is resource-intensive, with the majority of drug candidates…

Machine Learning · Computer Science 2024-12-04 Katarzyna Janocha , Annabel Ling , Alice Godson , Yulia Lampi , Simon Bornschein , Nils Y. Hammerla

Predicting protein function from sequence is a central challenge in computational biology. While existing methods rely heavily on structured ontologies or similarity-based techniques, they often lack the flexibility to express…

Computational Engineering, Finance, and Science · Computer Science 2025-10-27 Xiao Fei , Michail Chatzianastasis , Sarah Almeida Carneiro , Hadi Abdine , Lawrence P. Petalidis , Michalis Vazirgiannis

In this paper, we consider the problem of visual representation learning for computational pathology, by exploiting large-scale image-text pairs gathered from public resources, along with the domain-specific knowledge in pathology.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Xiao Zhou , Xiaoman Zhang , Chaoyi Wu , Ya Zhang , Weidi Xie , Yanfeng Wang

Computational pathology foundation models (CPathFMs) have emerged as a powerful approach for analyzing histopathological data, leveraging self-supervised learning to extract robust feature representations from unlabeled whole-slide images.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Ajit J. Nirmal , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

Ancestry-specific proteome-wide association studies (PWAS) based on genetically predicted protein expression can reveal complex disease etiology specific to certain ancestral groups. These studies require ancestry-specific models for…

Applications · Statistics 2024-04-26 Aaron J. Molstad , Yanwei Cai , Alexander P. Reiner , Charles Kooperberg , Wei Sun , Li Hsu

Protein language models are a powerful tool for learning protein representations through pre-training on vast protein sequence datasets. However, traditional protein language models lack explicit structural supervision, despite its…

Biomolecules · Quantitative Biology 2024-02-09 Zuobai Zhang , Jiarui Lu , Vijil Chenthamarakshan , Aurélie Lozano , Payel Das , Jian Tang

Language models often pre-train on large unsupervised text corpora, then fine-tune on additional task-specific data. However, typical fine-tuning schemes do not prioritize the examples that they tune on. We show that, if you can prioritize…

Computation and Language · Computer Science 2023-05-12 Ian Osband , Seyed Mohammad Asghari , Benjamin Van Roy , Nat McAleese , John Aslanides , Geoffrey Irving

Cell-level dense prediction is central to computational pathology, but remains challenging due to fine-grained histological structures, strong domain shifts, and costly dense annotations. Existing ViT-based pathology foundation models rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Weiming Chen , Xitong Ling , Zhenyang Cai , Xidong Wang , Jiawen Li , Tian Guan , Benyou Wang , Yonghong He

Predictive uncertainty-a model's self awareness regarding its accuracy on an input-is key for both building robust models via training interventions and for test-time applications such as selective classification. We propose a novel…

Machine Learning · Computer Science 2024-01-04 Nishant Jain , Karthikeyan Shanmugam , Pradeep Shenoy

The generalizability of speech enhancement (SE) models across speaker conditions remains largely unexplored, despite its critical importance for broader applicability. This paper investigates the performance of the hybrid variational…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-19 Mingchi Hou , Ina Kodrasi

As the pre-trained language models (PLMs) continue to grow, so do the hardware and data requirements for fine-tuning PLMs. Therefore, the researchers have come up with a lighter method called \textit{Prompt Learning}. However, during the…

Computation and Language · Computer Science 2022-09-07 Yundi Shi , Piji Li , Changchun Yin , Zhaoyang Han , Lu Zhou , Zhe Liu

Deep learning based automated pathological diagnosis has markedly improved diagnostic efficiency and reduced variability between observers, yet its clinical adoption remains limited by opaque model decisions and a lack of traceable…

Understanding protein solubility is essential for their functional applications. Computational methods for predicting protein solubility are crucial for reducing experimental costs and enhancing the efficiency and success rates of protein…

Quantitative Methods · Quantitative Biology 2024-07-01 Yang Tan , Jia Zheng , Liang Hong , Bingxin Zhou

Curating datasets that span multiple languages is challenging. To make the collection more scalable, researchers often incorporate one or more imperfect classifiers in the process, like language identification models. These models, however,…

Computation and Language · Computer Science 2024-10-08 Farhan Samir , Emily P. Ahn , Shreya Prakash , Márton Soskuthy , Vered Shwartz , Jian Zhu

The genetic etiologies of common diseases are highly complex and heterogeneous. Classic statistical methods, such as linear regression, have successfully identified numerous genetic variants associated with complex diseases. Nonetheless,…

Applications · Statistics 2020-10-28 Jinghang Lin , Xiaoran Tong , Chenxi Li , Qing Lu

Pathology diagnosis based on EEG signals and decoding brain activity holds immense importance in understanding neurological disorders. With the advancement of artificial intelligence methods and machine learning techniques, the potential…

Proteins inherently possess a consistent sequence-structure duality. The abundance of protein sequence data, which can be readily represented as discrete tokens, has driven fruitful developments in protein language models (pLMs). A key…

Computational Engineering, Finance, and Science · Computer Science 2026-05-29 Yi Zhou , Haohao Qu , Yunqing Liu , Shanru Lin , Le Song , Wenqi Fan

Effective protein representation learning is crucial for predicting protein functions. Traditional methods often pretrain protein language models on large, unlabeled amino acid sequences, followed by finetuning on labeled data. While…

Biomolecules · Quantitative Biology 2024-09-05 Jiangbin Zheng , Stan Z. Li

Fine-grained glomerular subtyping is central to kidney biopsy interpretation, but clinically valuable labels are scarce and difficult to obtain. Existing computational pathology approaches instead tend to evaluate coarse diseased…