English
Related papers

Related papers: Learning protein sequence embeddings using informa…

200 papers

Knowing the location of a protein within the cell is important for understanding its function, role in biological processes, and potential use as a drug target. Much progress has been made in developing computational methods that predict…

Quantitative Methods · Quantitative Biology 2013-08-02 Ramanuja Simha , Hagit Shatkay

Machine learning and the use of neural networks has increased precipitously over the past few years primarily due to the ever-increasing accessibility to data and the growth of computation power. It has become increasingly easy to harness…

Machine Learning · Computer Science 2020-08-05 Aaron Hein , Casey Cole , Homayoun Valafar

In this perspective article, we present a multidisciplinary approach for characterizing protein structure networks. We first place our approach in its historical context and describe the manner in which it synthesizes concepts from quantum…

Molecular Networks · Quantitative Biology 2019-12-30 Vasundhara Gadiyaram , Smitha Vishveshwara , Saraswathi Vishveshwara

All known terrestrial proteins are coded as continuous strings of ~20 amino acids. The patterns formed by the repetitions of elements in groups of finite sequences describes the natural architectures of protein families. We present a method…

Biomolecules · Quantitative Biology 2018-07-30 Pablo Turjanski , Diego U. Ferreiro

We present a neural model for representing snippets of code as continuous distributed vectors ("code embeddings"). The main idea is to represent a code snippet as a single fixed-length $\textit{code vector}$, which can be used to predict…

Machine Learning · Computer Science 2018-10-31 Uri Alon , Meital Zilberstein , Omer Levy , Eran Yahav

The sequence of a protein is not only constrained by its physical and biochemical properties under current selection, but also by features of its past evolutionary history. Understanding the extent and the form that these evolutionary…

Populations and Evolution · Quantitative Biology 2015-06-22 Mathieu Hemery , Olivier Rivoire

Fine-tuning Pre-trained protein language models (PLMs) has emerged as a prominent strategy for enhancing downstream prediction tasks, often outperforming traditional supervised learning approaches. As a widely applied powerful technique in…

Computation and Language · Computer Science 2024-04-24 Yang Tan , Mingchen Li , Bingxin Zhou , Bozitao Zhong , Lirong Zheng , Pan Tan , Ziyi Zhou , Huiqun Yu , Guisheng Fan , Liang Hong

Tokenization is a promising path to multi-modal models capable of jointly understanding protein sequences, structure, and function. Existing protein structure tokenizers create tokens by pooling information from local neighborhoods, an…

Machine Learning · Computer Science 2026-02-09 Rohit Dilip , Ayush Varshney , David Van Valen

Background: The inception of next generations sequencing technologies have exponentially increased the volume of biological sequence data. Protein sequences, being quoted as the `language of life', has been analyzed for a multitude of…

Quantitative Methods · Quantitative Biology 2020-12-08 Nabil Ibtehaz , S. M. Shakhawat Hossain Sourav , Md. Shamsuzzoha Bayzid , M. Sohel Rahman

Understanding the intricate interplay among sequence, structure, and function remains a fundamental challenge in proteomics. The sequence-structure-function paradigm posits that biological roles are governed by the tertiary geometric…

Biomolecules · Quantitative Biology 2026-05-14 Hongwang Xiao , Wenjun Lin , Xi Chen , Hui Wang , Kai Chen , Jiashan Li , Yuancheng Sun , Sicheng Dai , Boya Wu , Qiwei Ye

Proteins are essential macromolecules defined by their amino acid sequences, which determine their three-dimensional structures and, consequently, their functions in all living organisms. Therefore, generative protein modeling necessitates…

Machine Learning · Computer Science 2024-10-18 Xinyou Wang , Zaixiang Zheng , Fei Ye , Dongyu Xue , Shujian Huang , Quanquan Gu

We are now witnessing significant progress of deep learning methods in a variety of tasks (or datasets) of proteins. However, there is a lack of a standard benchmark to evaluate the performance of different methods, which hinders the…

Machine Learning · Computer Science 2022-09-20 Minghao Xu , Zuobai Zhang , Jiarui Lu , Zhaocheng Zhu , Yangtian Zhang , Chang Ma , Runcheng Liu , Jian Tang

Representation learning is an important step in the machine learning pipeline. Given the current biological sequencing data volume, learning an explicit representation is prohibitive due to the dimensionality of the resulting feature…

Machine Learning · Computer Science 2023-04-04 Sarwan Ali , Usama Sardar , Murray Patterson , Imdad Ullah Khan

This paper demonstrates that language models are strong structure-based protein designers. We present LM-Design, a generic approach to reprogramming sequence-based protein language models (pLMs), that have learned massive sequential…

Machine Learning · Computer Science 2023-02-10 Zaixiang Zheng , Yifan Deng , Dongyu Xue , Yi Zhou , Fei YE , Quanquan Gu

The characterization of drug-protein interactions is crucial in the high-throughput screening for drug discovery. The deep learning-based approaches have attracted attention because they can predict drug-protein interactions without…

Machine Learning · Computer Science 2020-12-22 QHwan Kim , Joon-Hyuk Ko , Sunghoon Kim , Nojun Park , Wonho Jhe

An embedding is a mapping from a set of nodes of a network into a real vector space. Embeddings can have various aims like capturing the underlying graph topology and structure, node-to-node relationship, or other relevant information about…

Machine Learning · Computer Science 2023-06-21 Ashkan Dehghan , Kinga Siuta , Agata Skorupka , Andrei Betlen , David Miller , Bogumil Kaminski , Pawel Pralat

Deep Learning (DL) algorithms hold great promise for applications in the field of computational biophysics. In fact, the vast amount of available molecular structures, as well as their notable complexity, constitutes an ideal context in…

Soft Condensed Matter · Physics 2019-01-07 Marco Giulini , Raffaello Potestio

Predicting protein properties is paramount for biological and medical advancements. Current protein engineering mutates on a typical protein, called the wild-type, to construct a family of homologous proteins and study their properties.…

Machine Learning · Computer Science 2024-06-26 Zhiqiang Zhong , Davide Mottin

Protein sequences are abundant in repeating segments, both as exact copies and as approximate segments with mutations. These repeats are important for protein structure and function, motivating decades of algorithmic work on repeat…

Machine Learning · Computer Science 2026-05-26 Gal Pomerants , Yaniv Nikankin , Anja Reusch , Tomer Tsaban , Ora Schueler-Furman , Yonatan Belinkov

Despite an explosion in the number of experimentally determined, atomically detailed structures of biomolecules, many critical tasks in structural biology remain data-limited. Whether performance in such tasks can be improved by using large…

Biomolecules · Quantitative Biology 2019-12-30 Raphael J. L. Townshend , Rishi Bedi , Patricia A. Suriana , Ron O. Dror