English
Related papers

Related papers: Exploring the limits of pre-trained embeddings in …

200 papers

Understanding the spatial architecture of the tumor microenvironment (TME) is critical to advance precision oncology. We present ProteinPNet, a novel framework based on prototypical part networks that discovers TME motifs from spatial…

Machine Learning · Computer Science 2025-12-03 Louis McConnell , Jieran Sun , Theo Maffei , Raphael Gottardo , Marianna Rapsomaniki

Protein design aims to compose amino-acid sequences that fold into stable three-dimensional structures while satisfying targeted functional properties. The field is increasingly shifting toward vibe protein design, where a single model is…

Constructing atomic models from cryo-electron microscopy (cryo-EM) maps is a crucial yet intricate task in structural biology. While advancements in deep learning, such as convolutional neural networks (CNNs) and graph neural networks…

Quantitative Methods · Quantitative Biology 2024-11-01 Xin , Ma , Dong Si

Protein design, a grand challenge of the day, involves optimization on a fitness landscape, and leading methods adopt a model-based approach where a model is trained on a training set (protein sequences and fitness) and proposes candidates…

Machine Learning · Computer Science 2024-07-01 Saba Ghaffari , Ehsan Saleh , Alexander G. Schwing , Yu-Xiong Wang , Martin D. Burke , Saurabh Sinha

Accurately modeling the protein fitness landscapes holds great importance for protein engineering. Recently, due to their capacity and representation ability, pre-trained protein language models have achieved state-of-the-art performance in…

Biomolecules · Quantitative Biology 2024-02-06 Ziyi Zhou , Liang Zhang , Yuanxi Yu , Mingchen Li , Liang Hong , Pan Tan

Proteins exist as a dynamic ensemble of multiple conformations, and these motions are often crucial for their functions. However, current structure prediction methods predominantly yield a single conformation, overlooking the conformational…

Biomolecules · Quantitative Biology 2025-06-18 Advaith Maddipatla , Nadav Bojan Sellam , Meital Bojan , Sanketh Vedula , Paul Schanda , Ailie Marx , Alex M. Bronstein

We introduce ProteinWorkshop, a comprehensive benchmark suite for representation learning on protein structures with Geometric Graph Neural Networks. We consider large-scale pre-training and downstream tasks on both experimental and…

Sequence modelling approaches for epigenetic profile prediction have recently expanded in terms of sequence length, model size, and profile diversity. However, current models cannot infer on many experimentally feasible tissue and assay…

Genomics · Quantitative Biology 2023-08-24 Jacob Deasy , Ron Schwessinger , Ferran Gonzalez , Stephen Young , Kim Branson

High throughput sequencing techniques have highly impactedon modern biology, widening the gap between sequenced andannotated data. Automatic annotation tools are thereforeof the foremost importance to guide biologists' experiments. However,…

Machine Learning · Statistics 2016-10-02 Luca Masera

Protein design has become a critical method in advancing significant potential for various applications such as drug development and enzyme engineering. However, protein design methods utilizing large language models with solely pretraining…

Artificial Intelligence · Computer Science 2024-12-06 Xiao-Yu Guo , Yi-Fan Li , Yuan Liu , Xiaoyong Pan , Hong-Bin Shen

Proteins are dynamic molecular machines whose biological functions, spanning enzymatic catalysis, signal transduction, and structural adaptation, are intrinsically linked to their motions. Designing proteins with targeted dynamic…

Biomolecules · Quantitative Biology 2025-02-17 Bo Ni , Markus J. Buehler

We present an automated approach for identifying and annotating motifs and domains in protein sequences, using pretrained Protein Language Models (PLMs) and Concept Activation Vectors (CAVs), adapted from interpretability research in…

Quantitative Methods · Quantitative Biology 2025-11-27 Ahmad Shamail , Claire D. McWhite

This study proposes a novel approach that combines theory and data-driven choice models using Artificial Neural Networks (ANNs). In particular, we use continuous vector representations, called embeddings, for encoding categorical or…

Machine Learning · Statistics 2021-10-01 Ioanna Arkoudi , Carlos Lima Azevedo , Francisco C. Pereira

Protein Language Models (PLMs) have emerged as performant and scalable tools for predicting the functional impact and clinical significance of protein-coding variants, but they still lag experimental accuracy. Here, we present a novel…

Proteins govern most biological functions essential for life, but achieving controllable protein discovery and optimization remains challenging. Recently, machine learning-assisted protein editing (MLPE) has shown promise in accelerating…

Artificial Intelligence · Computer Science 2024-11-19 Mingze Yin , Hanjing Zhou , Yiheng Zhu , Miao Lin , Yixuan Wu , Jialu Wu , Hongxia Xu , Chang-Yu Hsieh , Tingjun Hou , Jintai Chen , Jian Wu

Recent advances in de novo protein binder design have enabled increasing experimental validation, yet reported in silico metrics remain difficult to interpret or compare across studies due to non-standardized evaluation protocols. We…

Quantitative Methods · Quantitative Biology 2026-05-25 Cong Liu , Milong Ren , Jiaqi Guan , Chengyue Gong , Jinyuan Sun , Xinshi Chen , Wenzhi Xiao

Generative modeling for protein engineering is key to solving fundamental problems in synthetic biology, medicine, and material science. We pose protein engineering as an unsupervised sequence generation problem in order to leverage the…

Learnable embedding vector is one of the most important applications in machine learning, and is widely used in various database-related domains. However, the high dimensionality of sparse data in recommendation tasks and the huge volume of…

Machine Learning · Computer Science 2024-02-14 Hailin Zhang , Penghao Zhao , Xupeng Miao , Yingxia Shao , Zirui Liu , Tong Yang , Bin Cui

How we choose to represent our data has a fundamental impact on our ability to subsequently extract information from them. Machine learning promises to automatically determine efficient representations from large unstructured datasets, such…

Biomolecules · Quantitative Biology 2022-05-31 Nicki Skafte Detlefsen , Søren Hauberg , Wouter Boomsma

Protein-ligand complex structures have been utilised to design benchmark machine learning methods that perform important tasks related to drug design such as receptor binding site detection, small molecule docking and binding affinity…

Biomolecules · Quantitative Biology 2021-08-26 Rishal Aggarwal , Akash Gupta , U Deva Priyakumar