English
Related papers

Related papers: Integration of Pre-trained Protein Language Models…

200 papers

Protein engineering is experiencing a paradigmatic shift through the integration of geometric deep learning into computational design workflows. While traditional strategies, such as rational design and directed evolution, have enabled…

Protein representation learning aims to learn informative protein embeddings capable of addressing crucial biological questions, such as protein function prediction. Although sequence-based transformer models have shown promising results by…

Quantitative Methods · Quantitative Biology 2024-10-22 Michail Chatzianastasis , Yang Zhang , George Dasoulas , Michalis Vazirgiannis

Learning effective protein representations is critical in a variety of tasks in biology such as predicting protein function or structure. Existing approaches usually pretrain protein language models on a large number of unlabeled amino acid…

Machine Learning · Computer Science 2023-01-31 Zuobai Zhang , Minghao Xu , Arian Jamasb , Vijil Chenthamarakshan , Aurelie Lozano , Payel Das , Jian Tang

Learning effective protein representations is critical in a variety of tasks in biology such as predicting protein functions. Recent sequence representation learning methods based on Protein Language Models (PLMs) excel in sequence-based…

Quantitative Methods · Quantitative Biology 2023-10-19 Zuobai Zhang , Chuanrui Wang , Minghao Xu , Vijil Chenthamarakshan , Aurélie Lozano , Payel Das , Jian Tang

Latent representation alignment has become a foundational technique for constructing multimodal large language models (MLLM) by mapping embeddings from different modalities into a shared space, often aligned with the embedding space of…

Machine Learning · Computer Science 2025-03-06 Dong Shu , Bingbing Duan , Kai Guo , Kaixiong Zhou , Jiliang Tang , Mengnan Du

Graphs as a type of data structure have recently attracted significant attention. Representation learning of geometric graphs has achieved great success in many fields including molecular, social, and financial networks. It is natural to…

Machine Learning · Computer Science 2021-07-08 Tian Xia , Wei-Shinn Ku

Learning on 3D structures of large biomolecules is emerging as a distinct area in machine learning, but there has yet to emerge a unifying network architecture that simultaneously leverages the graph-structured and geometric aspects of the…

Biomolecules · Quantitative Biology 2021-05-18 Bowen Jing , Stephan Eismann , Patricia Suriana , Raphael J. L. Townshend , Ron Dror

Geometric Graph Neural Networks (GNNs) and Transformers have become state-of-the-art for learning from 3D protein structures. However, their reliance on message passing prevents them from capturing the hierarchical interactions that govern…

Machine Learning · Computer Science 2025-12-09 Chang Liu , Vivian Li , Linus Leong , Vladimir Radenkovic , Pietro Liò , Chaitanya K. Joshi

Numerous cellular functions rely on protein$\unicode{x2013}$protein interactions. Efforts to comprehensively characterize them remain challenged however by the diversity of molecular recognition mechanisms employed within the proteome. Deep…

Biomolecules · Quantitative Biology 2023-12-08 Julia R. Rogers , Gergő Nikolényi , Mohammed AlQuraishi

Protein representation learning plays a crucial role in understanding the structure and function of proteins, which are essential biomolecules involved in various biological processes. In recent years, deep learning has emerged as a…

Biomolecules · Quantitative Biology 2024-03-11 Bozhen Hu , Cheng Tan , Lirong Wu , Jiangbin Zheng , Jun Xia , Zhangyang Gao , Zicheng Liu , Fandi Wu , Guijun Zhang , Stan Z. Li

Proteins perform much of the work in living organisms, and consequently the development of efficient computational methods for protein representation is essential for advancing large-scale biological research. Most current approaches…

Quantitative Methods · Quantitative Biology 2023-06-09 Francesco Ceccarelli , Lorenzo Giusti , Sean B. Holden , Pietro Liò

The field of geometric deep learning has had a profound impact on the development of innovative and powerful graph neural network architectures. Disciplines such as computer vision and computational biology have benefited significantly from…

Machine Learning · Computer Science 2023-04-28 Alex Morehead , Jianlin Cheng

Deep learning approaches have produced substantial breakthroughs in fields such as image classification and natural language processing and are making rapid inroads in the area of protein design. Many generative models of proteins have been…

Machine Learning · Computer Science 2021-09-29 Alexey Strokach , Philip M. Kim

Protein representation learning is critical for numerous biological tasks. Recently, large transformer-based protein language models (pLMs) pretrained on large scale protein sequences have demonstrated significant success in sequence-based…

Machine Learning · Computer Science 2025-08-12 Xuefeng Liu , Songhao Jiang , Chih-chan Tien , Jinbo Xu , Rick Stevens

Protein is linked to almost every life process. Therefore, analyzing the biological structure and property of protein sequences is critical to the exploration of life, as well as disease detection and drug discovery. Traditional protein…

Machine Learning · Computer Science 2021-12-08 Yijia Xiao , Jiezhong Qiu , Ziang Li , Chang-Yu Hsieh , Jie Tang

Understanding protein structure-function relationships is a key challenge in computational biology, with applications across the biotechnology and pharmaceutical industries. While it is known that protein structure directly impacts protein…

Biomolecules · Quantitative Biology 2020-11-02 Nicolas Swenson , Aditi S. Krishnapriyan , Aydin Buluc , Dmitriy Morozov , Katherine Yelick

Proteins are sequences of amino acids that serve as the basic building blocks of living organisms. Despite rapidly growing databases documenting structural and functional information for various protein sequences, our understanding of…

Biomolecules · Quantitative Biology 2025-01-06 Weihang Dai

Learning meaningful protein representation is important for a variety of biological downstream tasks such as structure-based drug design. Having witnessed the success of protein sequence pretraining, pretraining for structural data which is…

Machine Learning · Computer Science 2023-02-23 Yufei Huang , Lirong Wu , Haitao Lin , Jiangbin Zheng , Ge Wang , Stan Z. Li

Deep learning is catalyzing a scientific revolution fueled by big data, accessible toolkits, and powerful computational resources, impacting many fields including protein structural modeling. Protein structural modeling, such as predicting…

Biomolecules · Quantitative Biology 2020-07-17 Wenhao Gao , Sai Pooja Mahajan , Jeremias Sulam , Jeffrey J. Gray

Proteins play a vital role in biological processes and are indispensable for living organisms. Accurate representation of proteins is crucial, especially in drug development. Recently, there has been a notable increase in interest in…

Biomolecules · Quantitative Biology 2026-05-28 Dan Kalifa , Uriel Singer , Kira Radinsky
‹ Prev 1 2 3 10 Next ›