English
Related papers

Related papers: Transformers in Protein: A Survey

200 papers

The rapid progress of research aimed at interpreting the inner workings of advanced language models has highlighted a need for contextualizing the insights gained from years of work in this area. This primer provides a concise technical…

Computation and Language · Computer Science 2024-10-15 Javier Ferrando , Gabriele Sarti , Arianna Bisazza , Marta R. Costa-jussà

Structural dynamics of macromolecules is critical to their structural-function relationship. Cryogenic electron microscopy (CryoEM) provides snapshots of vitrified protein at different compositional and conformational states, and the…

Quantitative Methods · Quantitative Biology 2026-01-27 Muyuan Chen , Muchen Li , Renjie Liao

Complexes of physically interacting proteins are one of the fundamental functional units responsible for driving key biological mechanisms within the cell. Their identification is therefore necessary not only to understand complex formation…

Computational Engineering, Finance, and Science · Computer Science 2012-11-27 Sriganesh Srihari , Hon Wai Leong

Deep learning has been widely used for protein engineering. However, it is limited by the lack of sufficient experimental data to train an accurate model for predicting the functional fitness of high-order mutants. Here, we develop SESNet,…

Quantitative Methods · Quantitative Biology 2023-04-10 Mingchen Li , Liqi Kang , Yi Xiong , Yu Guang Wang , Guisheng Fan , Pan Tan , Liang Hong

Recently, Transformer model, which has achieved great success in many artificial intelligence fields, has demonstrated its great potential in modeling graph-structured data. Till now, a great variety of Transformers has been proposed to…

Machine Learning · Computer Science 2022-02-18 Erxue Min , Runfa Chen , Yatao Bian , Tingyang Xu , Kangfei Zhao , Wenbing Huang , Peilin Zhao , Junzhou Huang , Sophia Ananiadou , Yu Rong

We report a flexible language-model based deep learning strategy, applied here to solve complex forward and inverse problems in protein modeling, based on an attention neural network that integrates transformer and graph convolutional…

Biomolecules · Quantitative Biology 2023-10-20 Markus J. Buehler

Deep Learning and big data have shown tremendous success in bioinformatics and computational biology in recent years; artificial intelligence methods have also significantly contributed in the task of protein function classification. This…

Biomolecules · Quantitative Biology 2022-11-18 Divyanshu Aggarwal , Yasha Hasija

In recent times, Transformer-based language models are making quite an impact in the field of natural language processing. As relevant parallels can be drawn between biological sequences and natural languages, the models used in NLP can be…

Computation and Language · Computer Science 2025-12-25 Nimisha Ghosh , Daniele Santoni , Indrajit Saha , Giovanni Felici

Transformers have been at the heart of the Natural Language Processing (NLP) and Computer Vision (CV) revolutions. The significant success in NLP and CV inspired exploring the use of Transformers in point cloud processing. However, how do…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Dening Lu , Qian Xie , Mingqiang Wei , Kyle Gao , Linlin Xu , Jonathan Li

Understanding protein solubility is essential for their functional applications. Computational methods for predicting protein solubility are crucial for reducing experimental costs and enhancing the efficiency and success rates of protein…

Quantitative Methods · Quantitative Biology 2024-07-01 Yang Tan , Jia Zheng , Liang Hong , Bingxin Zhou

Protein language models are a powerful tool for learning protein representations through pre-training on vast protein sequence datasets. However, traditional protein language models lack explicit structural supervision, despite its…

Biomolecules · Quantitative Biology 2024-02-09 Zuobai Zhang , Jiarui Lu , Vijil Chenthamarakshan , Aurélie Lozano , Payel Das , Jian Tang

Accurate protein structural ensembles can be determined with metainference, a Bayesian inference method that integrates experimental information with prior knowledge of the system and deals with all sources of uncertainty and errors as well…

Quantitative Methods · Quantitative Biology 2019-01-24 Thomas Löhr , Carlo Camilloni , Massimiliano Bonomi , Michele Vendruscolo

While many good textbooks are available on Protein Structure, Molecular Simulations, Thermodynamics and Bioinformatics methods in general, there is no good introductory level book for the field of Structural Bioinformatics. This book aims…

Mass spectrometry is the dominant technology in the field of proteomics, enabling high-throughput analysis of the protein content of complex biological samples. Due to the complexity of the instrumentation and resulting data, sophisticated…

Learning effective protein representations is critical in a variety of tasks in biology such as predicting protein function or structure. Existing approaches usually pretrain protein language models on a large number of unlabeled amino acid…

Machine Learning · Computer Science 2023-01-31 Zuobai Zhang , Minghao Xu , Arian Jamasb , Vijil Chenthamarakshan , Aurelie Lozano , Payel Das , Jian Tang

Protein interactions are important in a broad range of biological processes. Traditionally, computational methods have been developed to automatically predict protein interface from hand-crafted features. Recent approaches employ deep…

Machine Learning · Computer Science 2020-07-21 Yi Liu , Hao Yuan , Lei Cai , Shuiwang Ji

Proteins play a vital role in biological processes and are indispensable for living organisms. Accurate representation of proteins is crucial, especially in drug development. Recently, there has been a notable increase in interest in…

Biomolecules · Quantitative Biology 2026-05-28 Dan Kalifa , Uriel Singer , Kira Radinsky

This paper provides a comprehensive review of mechanical equipment fault diagnosis methods, focusing on the advancements brought by Transformer-based models. It details the structure, working principles, and benefits of Transformers,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Guiran Liu , Binrong Zhu

Disordered proteins play essential roles in myriad cellular processes, yet their structural characterization remains a major challenge due to their dynamic and heterogeneous nature. We here present a community-driven initiative to address…

The growing interest for comparing protein internal dynamics owes much to the realization that protein function can be accompanied or assisted by structural fluctuations and conformational changes. Analogously to the case of functional…

Biomolecules · Quantitative Biology 2012-12-19 C. Micheletti