English
Related papers

Related papers: Integration of Pre-trained Protein Language Models…

200 papers

Protein structure-based property prediction has emerged as a promising approach for various biological tasks, such as protein function prediction and sub-cellular location estimation. The existing methods highly rely on experimental protein…

Machine Learning · Computer Science 2023-10-20 Yufei Huang , Siyuan Li , Jin Su , Lirong Wu , Odin Zhang , Haitao Lin , Jingqi Qi , Zihan Liu , Zhangyang Gao , Yuyang Liu , Jiangbin Zheng , Stan. ZQ. Li

Molecular property prediction is one of the fastest-growing applications of deep learning with critical real-world impacts. Including 3D molecular structure as input to learned models improves their performance for many molecular tasks.…

Deep learning has transformed protein design, enabling accurate structure prediction, sequence optimization, and de novo protein generation. Advances in single-chain protein structure prediction via AlphaFold2, RoseTTAFold, ESMFold, and…

Machine Learning · Computer Science 2025-02-27 Gregory W. Kyro , Tianyin Qiu , Victor S. Batista

Many scientific fields study data with an underlying structure that is a non-Euclidean space. Some examples include social networks in computational social sciences, sensor networks in communications, functional networks in brain imaging,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Michael M. Bronstein , Joan Bruna , Yann LeCun , Arthur Szlam , Pierre Vandergheynst

Recent advances in computational modelling of atomic systems, spanning molecules, proteins, and materials, represent them as geometric graphs with atoms embedded as nodes in 3D Euclidean space. In these graphs, the geometric attributes…

Proteins are the fundamental macromolecules that play diverse and crucial roles in all living matter and have tremendous implications in healthcare, manufacturing, and biotechnology. Their functions are largely determined by the sequences…

Biomolecules · Quantitative Biology 2024-09-17 Boqiao Lai

Accurately modeling and designing protein complex structures is a central problem in computational structural biology, with broad implications for understanding cellular function and developing therapeutics. This thesis investigates two…

Machine Learning · Computer Science 2026-05-13 Ziwei Xie

Proteins, essential to biological systems, perform functions intricately linked to their three-dimensional structures. Understanding the relationship between protein structures and their amino acid sequences remains a core challenge in…

Quantitative Methods · Quantitative Biology 2024-11-04 Liang He , Peiran Jin , Yaosen Min , Shufang Xie , Lijun Wu , Tao Qin , Xiaozhuan Liang , Kaiyuan Gao , Yuliang Jiang , Tie-Yan Liu

We introduce a pioneering methodology for boosting large language models in the domain of protein representation learning. Our primary contribution lies in the refinement process for correlating the over-reliance on co-evolution knowledge,…

Artificial Intelligence · Computer Science 2024-12-05 Yaoyao Xu , Xinjian Zhao , Xiaozhuang Song , Benyou Wang , Tianshu Yu

Protein language models (PLMs) have emerged as powerful tools to detect complex patterns of protein sequences. However, the capability of PLMs to fully capture information on protein sequences might be limited by focusing on single…

Machine Learning · Computer Science 2025-05-27 Hazem Alsamkary , Mohamed Elshaffei , Mohamed Elkerdawy , Ahmed Elnaggar

Protein engineering seeks to identify protein sequences with optimized properties. When guided by machine learning, protein sequence generation methods can draw on prior knowledge and experimental efforts to improve this process. In this…

Quantitative Methods · Quantitative Biology 2021-05-28 Zachary Wu , Kadina E. Johnston , Frances H. Arnold , Kevin K. Yang

MOTIVATION: Proteins fold into complex structures that are crucial for their biological functions. Experimental determination of protein structures is costly and therefore limited to a small fraction of all known proteins. Hence, different…

Biomolecules · Quantitative Biology 2018-04-18 David Menéndez Hurtado , Karolis Uziela , Arne Elofsson

Protein representation learning is critical in various tasks in biology, such as drug design and protein structure or function prediction, which has primarily benefited from protein language models and graph neural networks. These models…

Biomolecules · Quantitative Biology 2024-02-16 Bozhen Hu , Zelin Zang , Cheng Tan , Stan Z. Li

This paper demonstrates that language models are strong structure-based protein designers. We present LM-Design, a generic approach to reprogramming sequence-based protein language models (pLMs), that have learned massive sequential…

Machine Learning · Computer Science 2023-02-10 Zaixiang Zheng , Yifan Deng , Dongyu Xue , Yi Zhou , Fei YE , Quanquan Gu

Predicting molecular properties is a critical component of drug discovery. Recent advances in deep learning, particularly Graph Neural Networks (GNNs), have enabled end-to-end learning from molecular structures, reducing reliance on manual…

Computation and Language · Computer Science 2025-09-26 Peng Zhou , Lai Hou Tim , Zhixiang Cheng , Kun Xie , Chaoyi Li , Wei Liu , Xiangxiang Zeng

Pre-trained language models have recently emerged as a powerful tool for fine-tuning a variety of language tasks. Ideally, when models are pre-trained on large amount of data, they are expected to gain implicit knowledge. In this paper, we…

Computation and Language · Computer Science 2023-06-22 Mohamad Ballout , Ulf Krumnack , Gunther Heidemann , Kai-Uwe Kühnberger

By folding into particular 3D structures, proteins play a key role in living beings. To learn meaningful representation from a protein structure for downstream tasks, not only the global backbone topology but the local fine-grained…

Biomolecules · Quantitative Biology 2025-02-05 Jiahan Li , Shitong Luo , Congyue Deng , Chaoran Cheng , Jiaqi Guan , Leonidas Guibas , Jian Peng , Jianzhu Ma

Accurately modeling the protein fitness landscapes holds great importance for protein engineering. Recently, due to their capacity and representation ability, pre-trained protein language models have achieved state-of-the-art performance in…

Biomolecules · Quantitative Biology 2024-02-06 Ziyi Zhou , Liang Zhang , Yuanxi Yu , Mingchen Li , Liang Hong , Pan Tan

Protein interactions are important in a broad range of biological processes. Traditionally, computational methods have been developed to automatically predict protein interface from hand-crafted features. Recent approaches employ deep…

Machine Learning · Computer Science 2020-07-21 Yi Liu , Hao Yuan , Lei Cai , Shuiwang Ji

Deep learning has become a powerful tool in computational biology, revolutionising the analysis and interpretation of biological data over time. In our article review, we delve into various aspects of deep learning in computational biology.…