English
Related papers

Related papers: A Survey on Protein Representation Learning: Retro…

200 papers

Protein sequence design, determined by amino acid sequences, are essential to protein engineering problems in drug discovery. Prior approaches have resorted to evolutionary strategies or Monte-Carlo methods for protein design, but often…

The evolutionary trajectory of a protein through sequence space is constrained by function and three-dimensional (3D) structure. Residues in spatial proximity tend to co-evolve, yet attempts to invert the evolutionary record to identify…

Biomolecules · Quantitative Biology 2015-03-13 Debora S. Marks , Lucy J. Colwell , Robert Sheridan , Thomas A. Hopf , Andrea Pagnani , Riccardo Zecchina , Chris Sander

Proteins are inherently multiscale physical systems whose functional properties emerge from coordinated structural organization across multiple spatial resolutions, ranging from atomic interactions to global fold topology. However, existing…

Machine Learning · Computer Science 2026-05-13 Viet Thanh Duy Nguyen , John K. Johnstone , Truong-Son Hy

Deep generative models that learn from the distribution of natural protein sequences and structures may enable the design of new proteins with valuable functions. While the majority of today's models focus on generating either sequences or…

Biomolecules · Quantitative Biology 2024-10-03 Chentong Wang , Sarah Alamdari , Carles Domingo-Enrich , Ava Amini , Kevin K. Yang

Classification of proteins based on their structure provides a valuable resource for studying protein structure, function and evolutionary relationships. With the rapidly increasing number of known protein structures, manual and…

Computational Engineering, Finance, and Science · Computer Science 2009-07-14 Oktie Hassanzadeh

Protein representation learning is critical for numerous biological tasks. Recently, large transformer-based protein language models (pLMs) pretrained on large scale protein sequences have demonstrated significant success in sequence-based…

Machine Learning · Computer Science 2025-08-12 Xuefeng Liu , Songhao Jiang , Chih-chan Tien , Jinbo Xu , Rick Stevens

Proteins are essential macromolecules defined by their amino acid sequences, which determine their three-dimensional structures and, consequently, their functions in all living organisms. Therefore, generative protein modeling necessitates…

Machine Learning · Computer Science 2024-10-18 Xinyou Wang , Zaixiang Zheng , Fei Ye , Dongyu Xue , Shujian Huang , Quanquan Gu

Intrinsically disordered regions (IDRs) account for one-third of the human proteome and play essential biological roles. However, predicting the functions of IDRs remains a major challenge due to their lack of stable structures, rapid…

Biomolecules · Quantitative Biology 2025-07-04 Đesika Kolarić , Chi Fung Willis Chow , Rita Zi Zhu , Agnes Toth-Petroczy , T. Reid Alderson , Iva Pritišanac

To effectively perform the task of next-word prediction, long short-term memory networks (LSTMs) must keep track of many types of information. Some information is directly related to the next word's identity, but some is more secondary…

Computation and Language · Computer Science 2021-06-01 Qingfeng Lan , Luke Kumar , Martha White , Alona Fyshe

A central problem in computational biophysics is protein structure prediction, i.e., finding the optimal folding of a given amino acid sequence. This problem has been studied in a classical abstract model, the HP model, where the protein is…

Machine Learning · Computer Science 2023-03-14 Kaiyuan Yang , Houjing Huang , Olafs Vandans , Adithya Murali , Fujia Tian , Roland H. C. Yap , Liang Dai

Recent computational advances in the accurate prediction of protein three-dimensional (3D) structures from amino acid sequences now present a unique opportunity to decipher the interrelationships between proteins. This task entails--but is…

Biomolecules · Quantitative Biology 2020-05-19 Menuka Jaiswal , Saad Saleem , Yonghyeon Kweon , Eli J Draizen , Stella Veretnik , Cameron Mura , Philip E. Bourne

The capability of accurate prediction of protein functions and properties is essential in the biotechnology industry, e.g. drug development and artificial protein synthesis, etc. The main challenges of protein function prediction are the…

Quantitative Methods · Quantitative Biology 2021-12-02 Wei-Cheng Tseng , Po-Han Chi , Jia-Hua Wu , Min Sun

Deciphering the function of unseen protein sequences is a fundamental challenge with broad scientific impact, yet most existing methods depend on task-specific adapters or large-scale supervised fine-tuning. We introduce the…

Machine Learning · Computer Science 2025-10-14 Xinhui Chen , Zuchao Li , Mengqi Gao , Yufeng Zhang , Chak Tou Leong , Haoyang Li , Jiaqi Chen

Understanding protein sequences is vital and urgent for biology, healthcare, and medicine. Labeling approaches are expensive yet time-consuming, while the amount of unlabeled data is increasing quite faster than that of the labeled data due…

Computation and Language · Computer Science 2021-11-01 Liang He , Shizhuo Zhang , Lijun Wu , Huanhuan Xia , Fusong Ju , He Zhang , Siyuan Liu , Yingce Xia , Jianwei Zhu , Pan Deng , Bin Shao , Tao Qin , Tie-Yan Liu

By folding into particular 3D structures, proteins play a key role in living beings. To learn meaningful representation from a protein structure for downstream tasks, not only the global backbone topology but the local fine-grained…

Biomolecules · Quantitative Biology 2025-02-05 Jiahan Li , Shitong Luo , Congyue Deng , Chaoran Cheng , Jiaqi Guan , Leonidas Guibas , Jian Peng , Jianzhu Ma

Deep neural-network-based language models (LMs) are increasingly applied to large-scale protein sequence data to predict protein function. However, being largely black-box models and thus challenging to interpret, current protein LM…

Quantitative Methods · Quantitative Biology 2024-08-06 Mai Ha Vu , Rahmad Akbar , Philippe A. Robert , Bartlomiej Swiatczak , Victor Greiff , Geir Kjetil Sandve , Dag Trygve Truslew Haug

After AlphaFold won the Nobel Prize, protein prediction with deep learning once again became a hot topic. We comprehensively explore advanced deep learning methods applied to protein structure prediction and design. It begins by examining…

The increasing number of protein sequences decoded from genomes is opening up new avenues of research on linking protein sequence to function with transformer neural networks. Recent research has shown that the number of known protein…

Machine Learning · Computer Science 2022-06-23 Anowarul Kabir , Amarda Shehu

While protein language models (PLMs) are one of the most promising avenues of research for future de novo protein design, the way in which they transform sequences to hidden representations, as well as the information encoded in such…

Machine Learning · Computer Science 2026-05-29 Kosio Beshkov , Anders Malthe-Sørenssen

Proteins are fundamental components of biological systems and can be represented through various modalities, including sequences, structures, and textual descriptions. Despite the advances in deep learning and scientific large language…

Machine Learning · Computer Science 2024-07-15 Zhiyuan Chen , Tianhao Chen , Chenggang Xie , Yang Xue , Xiaonan Zhang , Jingbo Zhou , Xiaomin Fang