English
Related papers

Related papers: STELLA: A Multimodal LLM for Protein Functional An…

200 papers

Predicting protein function from sequence is a central challenge in computational biology. While existing methods rely heavily on structured ontologies or similarity-based techniques, they often lack the flexibility to express…

Computational Engineering, Finance, and Science · Computer Science 2025-10-27 Xiao Fei , Michail Chatzianastasis , Sarah Almeida Carneiro , Hadi Abdine , Lawrence P. Petalidis , Michalis Vazirgiannis

Large language models have made remarkable progress in the field of molecular science, particularly in understanding and generating functional small molecules. This success is largely attributed to the effectiveness of molecular…

Biomolecules · Quantitative Biology 2025-03-14 Zicheng Ma , Chuanliu Fan , Zhicong Wang , Zhenyu Chen , Xiaohan Lin , Yanheng Li , Shihao Feng , Jun Zhang , Ziqiang Cao , Yi Qin Gao

Proteins adopt multiple structural conformations to perform their diverse biological functions, and understanding these conformations is crucial for advancing drug discovery. Traditional physics-based simulation methods often struggle with…

Biomolecules · Quantitative Biology 2025-03-14 Jiarui Lu , Xiaoyin Chen , Stephen Zhewen Lu , Chence Shi , Hongyu Guo , Yoshua Bengio , Jian Tang

We propose ProtLLM, a versatile cross-modal large language model (LLM) for both protein-centric and protein-language tasks. ProtLLM features a unique dynamic protein mounting mechanism, enabling it to handle complex inputs where the natural…

Biomolecules · Quantitative Biology 2024-03-14 Le Zhuo , Zewen Chi , Minghao Xu , Heyan Huang , Heqi Zheng , Conghui He , Xian-Ling Mao , Wentao Zhang

Language Models (LMs) excel in understanding textual descriptions of proteins, as evident in biomedical question-answering tasks. However, their capability falters with raw protein data, such as amino acid sequences, due to a deficit in…

Quantitative Methods · Quantitative Biology 2024-05-22 Zhiyuan Liu , An Zhang , Hao Fei , Enzhi Zhang , Xiang Wang , Kenji Kawaguchi , Tat-Seng Chua

Protein Language Models (PLMs), pre-trained on extensive evolutionary data from natural proteins, have emerged as indispensable tools for protein design. While powerful, PLMs often struggle to produce proteins with precisely specified…

Biomolecules · Quantitative Biology 2025-09-15 Long-Kai Huang , Rongyi Zhu , Bing He , Jianhua Yao

Proteins are fundamental components of biological systems and can be represented through various modalities, including sequences, structures, and textual descriptions. Despite the advances in deep learning and scientific large language…

Machine Learning · Computer Science 2024-07-15 Zhiyuan Chen , Tianhao Chen , Chenggang Xie , Yang Xue , Xiaonan Zhang , Jingbo Zhou , Xiaomin Fang

Amino acid sequence portrays most intrinsic form of a protein and expresses primary structure of protein. The order of amino acids in a sequence enables a protein to acquire a particular stable conformation that is responsible for the…

Machine Learning · Computer Science 2022-08-29 Ashish Ranjan , Md Shah Fahad , David Fernandez-Baca , Akshay Deepak , Sudhakar Tripathi

Protein language models (PLMs) have revolutionised computational biology through their ability to generate powerful sequence representations for diverse prediction tasks. However, their black-box nature limits biological interpretation and…

Biomolecules · Quantitative Biology 2025-04-11 Jan van Eck , Dea Gogishvili , Wilson Silva , Sanne Abeln

Large Language Models (LLMs) have shown to be capable of various tasks, yet their capability in interpreting and reasoning over tabular data remains an underexplored area. In this context, this study investigates from three core…

Computation and Language · Computer Science 2023-12-29 Tianyang Liu , Fei Wang , Muhao Chen

In contrast to their remarkable performance on general knowledge QA, the true abilities of Large Language Models (LLMs) in tasks demanding deep, specialized reasoning, such as in protein biology, have yet to be thoroughly investigated.…

Quantitative Methods · Quantitative Biology 2025-12-30 Dingyi Rong , Zijian Chen , Qi Jia , Kaiwei Zhang , Haotian Lu , Guangtao Zhai , Ning Liu

Large language models (LLMs) have shown remarkable capabilities in general domains, but their application to multi-omics biology remains underexplored. To address this gap, we introduce Biology-Instructions, the first large-scale…

Deciphering the function of unseen protein sequences is a fundamental challenge with broad scientific impact, yet most existing methods depend on task-specific adapters or large-scale supervised fine-tuning. We introduce the…

Machine Learning · Computer Science 2025-10-14 Xinhui Chen , Zuchao Li , Mengqi Gao , Yufeng Zhang , Chak Tou Leong , Haoyang Li , Jiaqi Chen

Proteins, as essential biomolecules, play a central role in biological processes, including metabolic reactions and DNA replication. Accurate prediction of their properties and functions is crucial in biological applications. Recent…

Computation and Language · Computer Science 2025-05-30 Wei Wu , Chao Wang , Liyi Chen , Mingze Yin , Yiheng Zhu , Kun Fu , Jieping Ye , Hui Xiong , Zheng Wang

The prediction of protein structures from sequences is an important task for function prediction, drug design, and related biological processes understanding. Recent advances have proved the power of language models (LMs) in processing the…

Quantitative Methods · Quantitative Biology 2022-12-01 Bozhen Hu , Jun Xia , Jiangbin Zheng , Cheng Tan , Yufei Huang , Yongjie Xu , Stan Z. Li

Proteins are essential biological macromolecules that execute life functions. Local structural motifs, such as active sites, are the most critical components for linking structure to function and are key to understanding protein evolution…

Quantitative Methods · Quantitative Biology 2026-04-10 Zhiyu Wang , Bingxin Zhou , Jing Wang , Yang Tan , Weishu Zhao , Pietro Liò , Liang Hong

Deep learning has become a crucial tool in studying proteins. While the significance of modeling protein structure has been discussed extensively in the literature, amino acid types are typically included in the input as a default operation…

Quantitative Methods · Quantitative Biology 2024-07-01 Yang Tan , Lirong Zheng , Bozitao Zhong , Liang Hong , Bingxin Zhou

Multimodal protein language models (PLMs) integrate sequence and token-based structural information, serving as a powerful foundation for protein modeling, generation, and design. However, the reliance on tokenizing 3D structures into…

Machine Learning · Computer Science 2025-06-13 Cheng-Yen Hsieh , Xinyou Wang , Daiheng Zhang , Dongyu Xue , Fei Ye , Shujian Huang , Zaixiang Zheng , Quanquan Gu

Motivation: Proteins are of great significance in living organisms. However, understanding their functions encounters numerous challenges, such as insufficient integration of multimodal information, a large number of training parameters,…

Machine Learning · Computer Science 2025-05-23 Zhicong Wang , Zicheng Ma , Ziqiang Cao , Changlong Zhou , Jun Zhang , Yiqin Gao

Protein language models (PLMs) have demonstrated remarkable success in protein modeling and design, yet their internal mechanisms for predicting structure and function remain poorly understood. Here we present a systematic approach to…

Biomolecules · Quantitative Biology 2024-12-18 Elana Simon , James Zou