English
Related papers

Related papers: ProtST: Multi-Modality Learning of Protein Sequenc…

200 papers

Protein analysis tasks arising in healthcare settings often require accurate reasoning under protein sequence constraints, involving tasks such as functional interpretation of disease-related variants, protein-level analysis for clinical…

Artificial Intelligence · Computer Science 2026-03-03 Congying Liu , Taihao Li , Ming Huang , Xingyuan Wei , Peipei Liu , Yiqing Shen , Yanxu Mao , Tiehan Cui

With the increasing attention to pre-trained vision-language models (VLMs), \eg, CLIP, substantial efforts have been devoted to many downstream tasks, especially in test-time adaptation (TTA). However, previous works focus on learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xingyu Zhu , Shuo Wang , Beier Zhu , Miaoge Li , Yunfan Li , Junfeng Fang , Zhicai Wang , Dongsheng Wang , Hanwang Zhang

Pre-trained Language Models (PLMs) have achieved great success on Machine Reading Comprehension (MRC) over the past few years. Although the general language representation learned from large-scale corpora does benefit MRC, the poor support…

Computation and Language · Computer Science 2021-05-19 Fangkai Jiao , Yangyang Guo , Yilin Niu , Feng Ji , Feng-Lin Li , Liqiang Nie

Proteins, as essential biomolecules, play a central role in biological processes, including metabolic reactions and DNA replication. Accurate prediction of their properties and functions is crucial in biological applications. Recent…

Computation and Language · Computer Science 2025-05-30 Wei Wu , Chao Wang , Liyi Chen , Mingze Yin , Yiheng Zhu , Kun Fu , Jieping Ye , Hui Xiong , Zheng Wang

Although Large Language Models (LLMs) excel in many tasks, their application to Speech-to-Speech Translation (S2ST) is underexplored and hindered by data scarcity. To bridge this gap, we propose PROST-LLM (PROgressive Speech-to-speech…

Computation and Language · Computer Science 2026-01-26 Jing Xu , Jiaqi Wang , Daxin Tan , Xiao Chen

The prediction of protein structures from sequences is an important task for function prediction, drug design, and related biological processes understanding. Recent advances have proved the power of language models (LMs) in processing the…

Quantitative Methods · Quantitative Biology 2022-12-01 Bozhen Hu , Jun Xia , Jiangbin Zheng , Cheng Tan , Yufei Huang , Yongjie Xu , Stan Z. Li

There is increasing adoption of artificial intelligence in drug discovery. However, existing studies use machine learning to mainly utilize the chemical structures of molecules but ignore the vast textual knowledge available in chemistry.…

Machine Learning · Computer Science 2024-01-31 Shengchao Liu , Weili Nie , Chengpeng Wang , Jiarui Lu , Zhuoran Qiao , Ling Liu , Jian Tang , Chaowei Xiao , Anima Anandkumar

Multimodal Large Language Models (MLLMs) have seen growing adoption across various scientific disciplines. These advancements encourage the investigation of molecule-text modeling within synthetic chemistry, a field dedicated to designing…

Machine Learning · Computer Science 2024-06-21 He Cao , Yanjun Shao , Zhiyuan Liu , Zijing Liu , Xiangru Tang , Yuan Yao , Yu Li

Directed evolution plays an indispensable role in protein engineering that revises existing protein sequences to attain new or enhanced functions. Accurately predicting the effects of protein variants necessitates an in-depth understanding…

Quantitative Methods · Quantitative Biology 2023-06-09 Yang Tan , Bingxin Zhou , Yuanhong Jiang , Yu Guang Wang , Liang Hong

Pre-trained protein models (PTPMs) represent a protein with one fixed embedding and thus are not capable for diverse tasks. For example, protein structures can shift, namely protein folding, between several conformations in various…

Artificial Intelligence · Computer Science 2022-02-08 Qiang Zhang , Zeyuan Wang , Yuqiang Han , Haoran Yu , Xurui Jin , Huajun Chen

Current AI-assisted protein design mainly utilizes protein sequential and structural information. Meanwhile, there exists tremendous knowledge curated by humans in the text format describing proteins' high-level functionalities. Yet,…

Pre-trained vision-language models (VLMs) have shown remarkable generalization capabilities via prompting, which leverages VLMs as knowledge bases to extract information beneficial for downstream tasks. However, existing methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xiaoyu Qiu , Hao Feng , Yuechen Wang , Wengang Zhou , Houqiang Li

Recent advances in Protein Language Models (PLMs) have transformed protein engineering, yet unlike their counterparts in Natural Language Processing (NLP), current PLMs exhibit a fundamental limitation: they excel in either Protein Language…

Computational Engineering, Finance, and Science · Computer Science 2025-09-16 Liuzhenghao Lv , Zongying Lin , Hao Li , Yuyang Liu , Jiaxi Cui , Calvin Yu-Chian Chen , Li Yuan , Yonghong Tian

Pre-trained vision-language models are able to interpret visual concepts and language semantics. Prompt learning, a method of constructing prompts for text encoders or image encoders, elicits the potentials of pre-trained models and readily…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Jianxi Gao

Protein language models (PLMs) learn contextual representations from protein sequences and are profoundly impacting various scientific disciplines spanning protein design, drug discovery, and structural predictions. One particular research…

Quantitative Methods · Quantitative Biology 2024-02-07 Andreas Dounas , Tudor-Stefan Cotet , Alexander Yermanos

Recent advances in protein large language models, such as ProtTeX, represent both side-chain amino acids and backbone structure as discrete token sequences of residue length. While this design enables unified modeling of multimodal protein…

Machine Learning · Computer Science 2025-08-19 Chuanliu Fan , Zicheng Ma , Jun Gao , Nan Yu , Jun Zhang , Ziqiang Cao , Yi Qin Gao , Guohong Fu

Prompt-based fine-tuning has boosted the performance of Pre-trained Language Models (PLMs) on few-shot text classification by employing task-specific prompts. Yet, PLMs are unfamiliar with prompt-style expressions during pre-training, which…

Computation and Language · Computer Science 2022-05-12 Jianing Wang , Chengyu Wang , Fuli Luo , Chuanqi Tan , Minghui Qiu , Fei Yang , Qiuhui Shi , Songfang Huang , Ming Gao

Protein Language Models (PLMs) have emerged as performant and scalable tools for predicting the functional impact and clinical significance of protein-coding variants, but they still lag experimental accuracy. Here, we present a novel…

Recent advances in protein language models (PLMs) have demonstrated remarkable capabilities in understanding protein sequences. However, the extent to which different model architectures capture antibody-specific biological properties…

Machine Learning · Computer Science 2025-12-11 Mengren , Liu , Yixiang Zhang , Yiming , Zhang

Protein language models (PLMs) have demonstrated remarkable capabilities in learning relationships between protein sequences and functions. However, finetuning these large models requires substantial computational resources, often with…

Machine Learning · Computer Science 2025-12-09 Shuo Zhang , Jian K. Liu