English
Related papers

Related papers: Large-Scale Multi-omic Biosequence Transformers fo…

200 papers

Proteins typically exist in complexes, interacting with other proteins or biomolecules to perform their specific biological roles. Research on single-chain protein modeling has been extensively and deeply explored, with advancements seen in…

Machine Learning · Computer Science 2025-09-09 Ruizhe Chen , Dongyu Xue , Xiangxin Zhou , Zaixiang Zheng , Xiangxiang Zeng , Quanquan Gu

Despite an explosion in the number of experimentally determined, atomically detailed structures of biomolecules, many critical tasks in structural biology remain data-limited. Whether performance in such tasks can be improved by using large…

Biomolecules · Quantitative Biology 2019-12-30 Raphael J. L. Townshend , Rishi Bedi , Patricia A. Suriana , Ron O. Dror

Pre-trained protein models (PTPMs) represent a protein with one fixed embedding and thus are not capable for diverse tasks. For example, protein structures can shift, namely protein folding, between several conformations in various…

Artificial Intelligence · Computer Science 2022-02-08 Qiang Zhang , Zeyuan Wang , Yuqiang Han , Haoran Yu , Xurui Jin , Huajun Chen

Empirical scoring functions based on either molecular force fields or cheminformatics descriptors are widely used, in conjunction with molecular docking, during the early stages of drug discovery to predict potency and binding affinity of a…

Machine Learning · Computer Science 2017-03-31 Joseph Gomes , Bharath Ramsundar , Evan N. Feinberg , Vijay S. Pande

As protein informatics advances rapidly, the demand for enhanced predictive accuracy, structural analysis, and functional understanding has intensified. Transformer models, as powerful deep learning architectures, have demonstrated…

Machine Learning · Computer Science 2025-05-28 Xiaowen Ling , Zhiqiang Li , Yanbin Wang , Zhuhong You

Protein language models have shown remarkable success in learning biological information from protein sequences. However, most existing models are limited by either autoencoding or autoregressive pre-training objectives, which makes them…

Quantitative Methods · Quantitative Biology 2024-12-10 Bo Chen , Xingyi Cheng , Pan Li , Yangli-ao Geng , Jing Gong , Shen Li , Zhilei Bei , Xu Tan , Boyan Wang , Xin Zeng , Chiming Liu , Aohan Zeng , Yuxiao Dong , Jie Tang , Le Song

Post-translational modifications (PTMs) serve as a dynamic chemical language regulating protein function, yet current proteomic methods remain blind to a vast portion of the modified proteome. Standard database search algorithms suffer from…

Quantitative Methods · Quantitative Biology 2025-12-16 Yuhan Chen , Shang Qu , Zhiqiang Gao , Yuejin Yang , Xiang Zhang , Sheng Xu , Xinjie Mao , Liujia Qian , Jiaqi Wei , Zijie Qiu , Chenyu You , Lei Bai , Ning Ding , Tiannan Guo , Bowen Zhou , Siqi Sun

Transformer-based architectures have become competitive across a variety of visual domains, most notably images and videos. While prior work studies these modalities in isolation, having a common architecture suggests that one can train a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Rohit Girdhar , Alaaeldin El-Nouby , Mannat Singh , Kalyan Vasudev Alwala , Armand Joulin , Ishan Misra

Predicting the binding free energy between antibodies and antigens is a key challenge in structure-aware biomolecular modeling, with direct implications for antibody design. Most existing methods either rely solely on sequence embeddings or…

Biomolecules · Quantitative Biology 2025-08-28 Ciyuan Yu , Hongzong Li , Jiahao Ma , Shiqin Tang , Ye-Fan Hu , Jian-Dong Huang

Large Language Models (LLMs) demonstrate remarkable generalizability across diverse tasks, yet genomic foundation models (GFMs) still require separate finetuning for each downstream application, creating significant overhead as model sizes…

Genomics · Quantitative Biology 2025-02-07 Zehui Li , Vallijah Subasri , Yifei Shen , Dongsheng Li , Yiren Zhao , Guy-Bart Stan , Caihua Shan

Understanding and modeling enzyme-substrate interactions is crucial for catalytic mechanism research, enzyme engineering, and metabolic engineering. Although a large number of predictive methods have emerged, they do not incorporate prior…

Biomolecules · Quantitative Biology 2025-06-24 Zhiwei Nie , Hongyu Zhang , Hao Jiang , Yutian Liu , Xiansong Huang , Fan Xu , Jie Fu , Zhixiang Ren , Yonghong Tian , Wen-Bin Zhang , Jie Chen

Large language models (LLMs) have shown remarkable capabilities in general domains, but their application to multi-omics biology remains underexplored. To address this gap, we introduce Biology-Instructions, the first large-scale…

Despite the wealth of single-cell multi-omics data, it remains challenging to predict the consequences of novel genetic and chemical perturbations in the human body. It requires knowledge of molecular interactions at all biological levels,…

Artificial Intelligence · Computer Science 2025-01-22 You Wu , Lei Xie

Self-supervised pre-training methods on proteins have recently gained attention, with most approaches focusing on either protein sequences or structures, neglecting the exploration of their joint distribution, which is crucial for a…

Machine Learning · Computer Science 2023-07-11 Zuobai Zhang , Minghao Xu , Aurélie Lozano , Vijil Chenthamarakshan , Payel Das , Jian Tang

Nucleic acid-based drugs like aptamers have recently demonstrated great therapeutic potential. However, experimental platforms for aptamer screening are costly, and the scarcity of labeled data presents a challenge for supervised methods to…

Biomolecules · Quantitative Biology 2024-11-05 Tinglin Huang , Zhenqiao Song , Rex Ying , Wengong Jin

Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathology whole-slide images, gene expression, and pathology reports, yet most existing approaches require fully paired and complete…

Machine Learning · Computer Science 2026-04-08 Kai Yu , Shuang Zhou , Yiran Song , Zaifu Zhan , Jie Peng , Kaixiong Zhou , Tianlong Chen , Feng Xie , Meng Wang , Huazhu Fu , Mingquan Lin , Rui Zhang

Multiple sequence alignments (MSAs) of proteins encode rich biological information and have been workhorses in bioinformatic methods for tasks like protein design and protein structure prediction for decades. Recent breakthroughs like…

Inferring the structural properties of a protein from its amino acid sequence is a challenging yet important problem in biology. Structures are not known for the vast majority of protein sequences, but structure is critical for…

Machine Learning · Computer Science 2019-10-17 Tristan Bepler , Bonnie Berger

Proteins are macromolecules that perform essential functions in all living organisms. Designing novel proteins with specific structures and desired functions has been a long-standing challenge in the field of bioengineering. Existing…

Biomolecules · Quantitative Biology 2023-03-03 Chence Shi , Chuanrui Wang , Jiarui Lu , Bozitao Zhong , Jian Tang

In the genome biology research, regulatory genome modeling is an important topic for many regulatory downstream tasks, such as promoter classification, transaction factor binding sites prediction. The core problem is to model how regulatory…

Genomics · Quantitative Biology 2021-11-04 Shentong Mo , Xi Fu , Chenyang Hong , Yizhen Chen , Yuxuan Zheng , Xiangru Tang , Zhiqiang Shen , Eric P Xing , Yanyan Lan