English
Related papers

Related papers: Leveraging Multi-modal Representations to Predict …

200 papers

Machine learning has revolutionized polymer science by enabling rapid property prediction and generative design. Large language models (LLMs) offer further opportunities in polymer informatics by simplifying workflows that traditionally…

Computational Engineering, Finance, and Science · Computer Science 2026-02-20 Sonakshi Gupta , Akhlak Mahmood , Shivank Shukla , Rampi Ramprasad

Protein language models (pLMs) produce per-residue representations that capture evolutionary and structural information, yet their mean-pooled sequence embeddings are not explicitly trained to reflect functional, evolutionary or structural…

Machine Learning · Computer Science 2026-05-11 Dan Ofer , Oriel Perets , Michal Linial , Nadav Rappoport

We introduce TemPL, a novel deep learning approach for zero-shot prediction of protein stability and activity, harnessing temperature-guided language modeling. By assembling an extensive dataset of 96 million sequence-host bacterial strain…

Quantitative Methods · Quantitative Biology 2024-05-14 Pan Tan , Mingchen Li , Liang Zhang , Zhiqiang Hu , Liang Hong

Molecular dynamics (MD) is a central computational tool in physics, chemistry, and biology, enabling quantitative prediction of experimental observables as expectations over high-dimensional molecular distributions such as Boltzmann…

Machine Learning · Computer Science 2026-02-13 Panagiotis Antoniadis , Beatrice Pavesi , Simon Olsson , Ole Winther

Proteins, essential to biological systems, perform functions intricately linked to their three-dimensional structures. Understanding the relationship between protein structures and their amino acid sequences remains a core challenge in…

Quantitative Methods · Quantitative Biology 2024-11-04 Liang He , Peiran Jin , Yaosen Min , Shufang Xie , Lijun Wu , Tao Qin , Xiaozhuan Liang , Kaiyuan Gao , Yuliang Jiang , Tie-Yan Liu

Multimodal protein features play a crucial role in protein function prediction. However, these features encompass a wide range of information, ranging from structural data and sequence features to protein attributes and interaction…

Machine Learning · Computer Science 2025-11-07 Xiaoling Luo , Peng Chen , Chengliang Liu , Xiaopeng Jin , Jie Wen , Yumeng Liu , Junsong Wang

While protein language models (PLMs) are one of the most promising avenues of research for future de novo protein design, the way in which they transform sequences to hidden representations, as well as the information encoded in such…

Machine Learning · Computer Science 2026-05-29 Kosio Beshkov , Anders Malthe-Sørenssen

Understanding biological processes, drug development, and biotechnological advancements requires a detailed analysis of protein structures and functions, a task that is inherently complex and time-consuming in traditional protein research.…

Artificial Intelligence · Computer Science 2025-04-21 Yijia Xiao , Edward Sun , Yiqiao Jin , Qifan Wang , Wei Wang

Protein language models (PLMs) have emerged as powerful tools to detect complex patterns of protein sequences. However, the capability of PLMs to fully capture information on protein sequences might be limited by focusing on single…

Machine Learning · Computer Science 2025-05-27 Hazem Alsamkary , Mohamed Elshaffei , Mohamed Elkerdawy , Ahmed Elnaggar

Language Models (LMs) excel in understanding textual descriptions of proteins, as evident in biomedical question-answering tasks. However, their capability falters with raw protein data, such as amino acid sequences, due to a deficit in…

Quantitative Methods · Quantitative Biology 2024-05-22 Zhiyuan Liu , An Zhang , Hao Fei , Enzhi Zhang , Xiang Wang , Kenji Kawaguchi , Tat-Seng Chua

Accurate prediction of enzymatic activity from amino acid sequences could drastically accelerate enzyme engineering for applications such as bioremediation and therapeutics development. In recent years, Protein Language Model (PLM)…

Quantitative Methods · Quantitative Biology 2025-05-07 Duncan F. Muir , Parker Grosjean , Margaux M. Pinney , Michael J. Keiser

In this study, we expand upon the FLIP benchmark-designed for evaluating protein fitness prediction models in small, specialized prediction tasks-by assessing the performance of state-of-the-art large protein language models, including…

Machine Learning · Computer Science 2025-01-31 Manuel F. Mollon , Joaquin Gonzalez-Rodriguez , Alicia Lozano-Diez , Daniel Ramos , Doroteo T. Toledano

AlphaFold 3 (AF3), the latest version of protein structure prediction software, goes beyond its predecessors by predicting protein-protein complexes. It could revolutionize drug discovery and protein engineering, marking a major step…

Biomolecules · Quantitative Biology 2024-06-07 JunJie Wee , Guo-Wei Wei

Proteins are essential to life's processes, underpinning evolution and diversity. Advances in sequencing technology have revealed millions of proteins, underscoring the need for sophisticated pre-trained protein models for biological…

Biomolecules · Quantitative Biology 2024-04-25 Shujian Jiao , Bingxuan Li , Lei Wang , Xiaojin Zhang , Wei Chen , Jiajie Peng , Zhongyu Wei

Protein language models have demonstrated significant potential in the field of protein engineering. However, current protein language models primarily operate at the residue scale, which limits their ability to provide information at the…

Biomolecules · Quantitative Biology 2024-06-14 Kangjie Zheng , Siyu Long , Tianyu Lu , Junwei Yang , Xinyu Dai , Ming Zhang , Zaiqing Nie , Wei-Ying Ma , Hao Zhou

Multi-sample aggregation strategies, such as majority voting and best-of-N sampling, are widely used in contemporary large language models (LLMs) to enhance predictive accuracy across various tasks. A key challenge in this process is…

Machine Learning · Computer Science 2025-06-17 Weihua Du , Yiming Yang , Sean Welleck

Protein language models (PLMs) have shown promise in improving the understanding of protein sequences, contributing to advances in areas such as function prediction and protein engineering. However, training these models from scratch…

Machine Learning · Computer Science 2024-12-19 Shivasankaran Vanaja Pandi , Bharath Ramsundar

Motivation: Site directed mutagenesis is widely used to understand the structure and function of biomolecules. Computational prediction of protein mutation impacts offers a fast, economical and potentially accurate alternative to laboratory…

Quantitative Methods · Quantitative Biology 2017-04-03 Zixuan Cang , Guo-Wei Wei

Enzyme engineering enables the modification of wild-type proteins to meet industrial and research demands by enhancing catalytic activity, stability, binding affinities, and other properties. The emergence of deep learning methods for…

Computation and Language · Computer Science 2024-10-29 Yang Tan , Ruilin Wang , Banghao Wu , Liang Hong , Bingxin Zhou

Understanding protein solubility is essential for their functional applications. Computational methods for predicting protein solubility are crucial for reducing experimental costs and enhancing the efficiency and success rates of protein…

Quantitative Methods · Quantitative Biology 2024-07-01 Yang Tan , Jia Zheng , Liang Hong , Bingxin Zhou