English
Related papers

Related papers: Exploring the limits of pre-trained embeddings in …

200 papers

Protein language models often take into consideration the alignment between a protein sequence and its textual description. However, they do not take structural information into consideration. Traditional methods treat sequence and…

Machine Learning · Computer Science 2026-03-10 Aditya Ranganath , Hasin Us Sami , Kowshik Thopalli , Bhavya Kailkhura , Wesam Sakla

Understanding protein sequences is vital and urgent for biology, healthcare, and medicine. Labeling approaches are expensive yet time-consuming, while the amount of unlabeled data is increasing quite faster than that of the labeled data due…

Computation and Language · Computer Science 2021-11-01 Liang He , Shizhuo Zhang , Lijun Wu , Huanhuan Xia , Fusong Ju , He Zhang , Siyuan Liu , Yingce Xia , Jianwei Zhu , Pan Deng , Bin Shao , Tao Qin , Tie-Yan Liu

Recent years have witnessed a surge in the development of protein structural tokenization methods, which chunk protein 3D structures into discrete or continuous representations. Structure tokenization enables the direct application of…

Quantitative Methods · Quantitative Biology 2025-06-26 Xinyu Yuan , Zichen Wang , Marcus Collins , Huzefa Rangwala

As protein therapeutics play an important role in almost all medical fields, numerous studies have been conducted on proteins using artificial intelligence. Artificial intelligence has enabled data driven predictions without the need for…

Quantitative Methods · Quantitative Biology 2023-03-30 Myeonghun Lee , Kyoungmin Min

Predicting protein properties is paramount for biological and medical advancements. Current protein engineering mutates on a typical protein, called the wild-type, to construct a family of homologous proteins and study their properties.…

Machine Learning · Computer Science 2024-06-26 Zhiqiang Zhong , Davide Mottin

Machine learning approaches have become popular for molecular modeling tasks, including molecular force fields and properties prediction. Traditional supervised learning methods suffer from scarcity of labeled data for particular tasks,…

Chemical Physics · Physics 2022-11-29 Xiang Gao , Weihao Gao , Wenzhi Xiao , Zhirui Wang , Chong Wang , Liang Xiang

Generative artificial intelligence models learn probability distributions from data and produce novel samples that capture the salient properties of their training sets. Proteins are particularly attractive for such approaches given their…

Biomolecules · Quantitative Biology 2026-02-27 Filippo Stocco , Michele Garibbo , Noelia Ferruz

Classifying protein topology is essential for deciphering biological function, but progress is held back by the lack of large-scale benchmarks that avoid duplicates and by models that do not scale well. We introduce TEDBench, a large-scale,…

Machine Learning · Computer Science 2026-05-19 Dexiong Chen , Andrei Manolache , Mathias Niepert , Karsten Borgwardt

Protein language models (pLMs) produce per-residue representations that capture evolutionary and structural information, yet their mean-pooled sequence embeddings are not explicitly trained to reflect functional, evolutionary or structural…

Machine Learning · Computer Science 2026-05-11 Dan Ofer , Oriel Perets , Michal Linial , Nadav Rappoport

Mining tasks over sequential data, such as clickstreams and gene sequences, require a careful design of embeddings usable by learning algorithms. Recent research in feature learning has been extended to sequential data, where each instance…

Machine Learning · Computer Science 2020-07-28 Zhongfang Zhuang , Xiangnan Kong , Elke Rundensteiner , Jihane Zouaoui , Aditya Arora

Breast cancer's complexity and variability pose significant challenges in understanding its progression and guiding effective treatment. This study aims to integrate protein sequence data with expression levels to improve the molecular…

Biomolecules · Quantitative Biology 2025-10-31 Hossein Sholehrasa , Majid Jaberi-Douraki

Accurate protein structure prediction from amino-acid sequences is critical to better understanding the protein function. Recent advances in this area largely benefit from more precise inter-residue distance and orientation predictions,…

Machine Learning · Computer Science 2021-06-01 Jiaxiang Wu , Shitong Luo , Tao Shen , Haidong Lan , Sheng Wang , Junzhou Huang

Proteins perform much of the work in living organisms, and consequently the development of efficient computational methods for protein representation is essential for advancing large-scale biological research. Most current approaches…

Quantitative Methods · Quantitative Biology 2023-06-09 Francesco Ceccarelli , Lorenzo Giusti , Sean B. Holden , Pietro Liò

Proteins are macromolecules that perform essential functions in all living organisms. Designing novel proteins with specific structures and desired functions has been a long-standing challenge in the field of bioengineering. Existing…

Biomolecules · Quantitative Biology 2023-03-03 Chence Shi , Chuanrui Wang , Jiarui Lu , Bozitao Zhong , Jian Tang

Protein language models (PLMs) have revolutionised computational biology through their ability to generate powerful sequence representations for diverse prediction tasks. However, their black-box nature limits biological interpretation and…

Biomolecules · Quantitative Biology 2025-04-11 Jan van Eck , Dea Gogishvili , Wilson Silva , Sanne Abeln

Directed evolution is a versatile technique in protein engineering that mimics the process of natural selection by iteratively alternating between mutagenesis and screening in order to search for sequences that optimize a given property of…

Biomolecules · Quantitative Biology 2024-05-02 Lixue Cheng , Ziyi Yang , Changyu Hsieh , Benben Liao , Shengyu Zhang

Accurate localization of proteins from fluorescence microscopy images is challenging due to the inter-class similarities and intra-class disparities introducing grave concerns in addressing multi-class classification problems. Conventional…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Muhammad Tahir , Saeed Anwar , Ajmal Mian , Abdul Wahab Muzaffar

Composed of amino acid chains that influence how they fold and thus dictating their function and features, proteins are a class of macromolecules that play a central role in major biological processes and are required for the structure,…

Quantitative Methods · Quantitative Biology 2022-07-15 Aaron Wang

We explore a framework for protein sequence representation learning that decomposes the task between manifold learning and distributional modelling. Specifically we present a Latent Space Diffusion architecture which combines a protein…

Machine Learning · Computer Science 2025-03-25 Eoin Quinn , Ghassene Jebali , Maxime Seince , Oliver Bent

Proteins are the major building blocks of life, and actuators of almost all chemical and biophysical events in living organisms. Their native structures in turn enable their biological functions which have a fundamental role in drug design.…