English
Related papers

Related papers: ProtAlign: Contrastive learning paradigm for Seque…

200 papers

Understanding the relationships between protein sequence, structure and function is a long-standing biological challenge with manifold implications from drug design to our understanding of evolution. Recently, protein language models have…

Quantitative Methods · Quantitative Biology 2024-01-29 Dexiong Chen , Philip Hartout , Paolo Pellizzoni , Carlos Oliver , Karsten Borgwardt

In the face of rapidly accumulating genomic data, our understanding of the RNA regulatory code remains incomplete. Recent self-supervised methods in other domains have demonstrated the ability to learn rules underlying the data-generating…

Machine Learning · Computer Science 2023-10-18 Philip Fradkin , Ruian Shi , Bo Wang , Brendan Frey , Leo J. Lee

Protein structure tokenization converts 3D structures into discrete or vectorized representations, enabling the integration of structural and sequence data. Despite many recent works on structure tokenization, the properties of the…

Machine Learning · Computer Science 2025-11-14 Zijing Liu , Bin Feng , He Cao , Yu Li

Proteins, essential to biological systems, perform functions intricately linked to their three-dimensional structures. Understanding the relationship between protein structures and their amino acid sequences remains a core challenge in…

Quantitative Methods · Quantitative Biology 2024-11-04 Liang He , Peiran Jin , Yaosen Min , Shufang Xie , Lijun Wu , Tao Qin , Xiaozhuan Liang , Kaiyuan Gao , Yuliang Jiang , Tie-Yan Liu

Protein language models (pLMs) produce per-residue representations that capture evolutionary and structural information, yet their mean-pooled sequence embeddings are not explicitly trained to reflect functional, evolutionary or structural…

Machine Learning · Computer Science 2026-05-11 Dan Ofer , Oriel Perets , Michal Linial , Nadav Rappoport

Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is…

Machine Learning · Computer Science 2023-11-22 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Roman Vaculin

Computational prediction of the interaction of T cell receptors (TCRs) and their ligands is a grand challenge in immunology. Despite advances in high-throughput assays, specificity-labelled TCR data remains sparse. In other domains, the…

Learning effective protein representations is critical in a variety of tasks in biology such as predicting protein function or structure. Existing approaches usually pretrain protein language models on a large number of unlabeled amino acid…

Machine Learning · Computer Science 2023-01-31 Zuobai Zhang , Minghao Xu , Arian Jamasb , Vijil Chenthamarakshan , Aurelie Lozano , Payel Das , Jian Tang

Predicting protein function from sequence is a central challenge in computational biology. While existing methods rely heavily on structured ontologies or similarity-based techniques, they often lack the flexibility to express…

Computational Engineering, Finance, and Science · Computer Science 2025-10-27 Xiao Fei , Michail Chatzianastasis , Sarah Almeida Carneiro , Hadi Abdine , Lawrence P. Petalidis , Michalis Vazirgiannis

The design of protein sequences with desired functionalities is a fundamental task in protein engineering. Deep generative methods, such as autoregressive models and diffusion models, have greatly accelerated the discovery of novel protein…

Machine Learning · Computer Science 2025-04-16 Zitai Kong , Yiheng Zhu , Yinlong Xu , Hanjing Zhou , Mingzhe Yin , Jialu Wu , Hongxia Xu , Chang-Yu Hsieh , Tingjun Hou , Jian Wu

Sequencing a genome to determine an individual's DNA produces an enormous number of short nucleotide subsequences known as reads, which must be reassembled to reconstruct the full genome. We present a method for analyzing this type of data…

Machine Learning · Computer Science 2025-05-23 Filip Thor , Carl Nettelblad

Virtual screening (VS) is an essential task in drug discovery, focusing on the identification of small-molecule ligands that bind to specific protein pockets. Existing deep learning methods, from early regression models to recent…

Machine Learning · Computer Science 2025-11-11 Bowei He , Bowen Gao , Yankai Chen , Yanyan Lan , Chen Ma , Philip S. Yu , Ya-Qin Zhang , Wei-Ying Ma

Generative modeling has become a central paradigm in protein research, extending machine learning beyond structure prediction toward sequence design, backbone generation, inverse folding, and biomolecular interaction modeling. However, the…

Machine Learning · Computer Science 2026-03-30 Senura Hansaja Wanasekara , Minh-Duong Nguyen , Xiaochen Liu , Nguyen H. Tran , Ken-Tye Yong

Sequences of nucleotides (for DNA and RNA) or amino acids (for proteins) are central objects in biology. Among the most important computational problems is that of sequence alignment, i.e. arranging sequences from different organisms in…

Quantitative Methods · Quantitative Biology 2020-12-08 Anna Paola Muntoni , Andrea Pagnani , Martin Weigt , Francesco Zamponi

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

Machine Learning · Computer Science 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

Vector representations of natural language are ubiquitous in search applications. Recently, various methods based on contrastive learning have been proposed to learn textual representations from unlabelled data; by maximizing alignment…

Computation and Language · Computer Science 2023-07-17 Sachin J. Chanchani , Ruihong Huang

While many good textbooks are available on Protein Structure, Molecular Simulations, Thermodynamics and Bioinformatics methods in general, there is no good introductory level book for the field of Structural Bioinformatics. This book aims…

Protein language models are a powerful tool for learning protein representations through pre-training on vast protein sequence datasets. However, traditional protein language models lack explicit structural supervision, despite its…

Biomolecules · Quantitative Biology 2024-02-09 Zuobai Zhang , Jiarui Lu , Vijil Chenthamarakshan , Aurélie Lozano , Payel Das , Jian Tang

This paper aims to retrieve proteins with similar structures and semantics from large-scale protein dataset, facilitating the functional interpretation of protein structures derived by structural determination methods like cryo-Electron…

Biomolecules · Quantitative Biology 2025-06-11 Qifeng Wu , Zhengzhe Liu , Han Zhu , Yizhou Zhao , Daisuke Kihara , Min Xu

In this paper, we introduce LInK, a novel framework that integrates contrastive learning of performance and design space with optimization techniques for solving complex inverse problems in engineering design with discrete and continuous…

Machine Learning · Computer Science 2025-02-11 Amin Heyrani Nobari , Akash Srivastava , Dan Gutfreund , Kai Xu , Faez Ahmed