English
Related papers

Related papers: CoPRA: Bridging Cross-domain Pretrained Sequence M…

200 papers

Learning effective protein representations is critical in a variety of tasks in biology such as predicting protein function or structure. Existing approaches usually pretrain protein language models on a large number of unlabeled amino acid…

Machine Learning · Computer Science 2023-01-31 Zuobai Zhang , Minghao Xu , Arian Jamasb , Vijil Chenthamarakshan , Aurelie Lozano , Payel Das , Jian Tang

As protein informatics advances rapidly, the demand for enhanced predictive accuracy, structural analysis, and functional understanding has intensified. Transformer models, as powerful deep learning architectures, have demonstrated…

Machine Learning · Computer Science 2025-05-28 Xiaowen Ling , Zhiqiang Li , Yanbin Wang , Zhuhong You

Deep protein structure predictors such as AlphaFold provide confidence estimates (e.g., pLDDT) that are often miscalibrated and degrade under distribution shifts across experimental modalities, temporal changes, and intrinsically disordered…

Machine Learning · Computer Science 2026-01-13 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

After AlphaFold won the Nobel Prize, protein prediction with deep learning once again became a hot topic. We comprehensively explore advanced deep learning methods applied to protein structure prediction and design. It begins by examining…

With the great success of pre-trained models, the pretrain-then-finetune paradigm has been widely adopted on downstream tasks for source code understanding. However, compared to costly training a large-scale model from scratch, how to…

Software Engineering · Computer Science 2022-03-16 Deze Wang , Zhouyang Jia , Shanshan Li , Yue Yu , Yun Xiong , Wei Dong , Xiangke Liao

The field of protein folding research has been greatly advanced by deep learning methods, with AlphaFold2 (AF2) demonstrating exceptional performance and atomic-level precision. As co-evolution is integral to protein structure prediction,…

Quantitative Methods · Quantitative Biology 2023-06-06 Le Zhang , Jiayang Chen , Tao Shen , Yu Li , Siqi Sun

Proteins adopt multiple structural conformations to perform their diverse biological functions, and understanding these conformations is crucial for advancing drug discovery. Traditional physics-based simulation methods often struggle with…

Biomolecules · Quantitative Biology 2025-03-14 Jiarui Lu , Xiaoyin Chen , Stephen Zhewen Lu , Chence Shi , Hongyu Guo , Yoshua Bengio , Jian Tang

Medical diagnosis requires the effective synthesis of visual manifestations and clinical metadata. However, existing methods often treat metadata as isolated tags, failing to exploit the rich semantic knowledge embedded in clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Yiqing Wang , Chunming He , Ming-Chen Lu , Mercy Pawar , Leslie Niziol , Maria Woodward , Sina Farsiu

With the development of next generation sequencing techniques, it is fast and cheap to determine protein sequences but relatively slow and expensive to extract useful information from protein sequences because of limitations of traditional…

Quantitative Methods · Quantitative Biology 2017-10-20 Renzhi Cao , Colton Freitas , Leong Chan , Miao Sun , Haiqing Jiang , Zhangxin Chen

miRNA and gene expression profiles have been proved useful for classifying cancer samples. Efficient classifiers have been recently sought and developed. A number of attempts to classify cancer samples using miRNA/gene expression profiles…

Computational Engineering, Finance, and Science · Computer Science 2014-01-21 Rania Ibrahim , Noha A. Yousri , Mohamed A. Ismail , Nagwa M. El-Makky

Multi-modality pre-training paradigm that aligns protein sequences and biological descriptions has learned general protein representations and achieved promising performance in various downstream applications. However, these works were…

Machine Learning · Computer Science 2024-12-31 Hanjing Zhou , Mingze Yin , Wei Wu , Mingyang Li , Kun Fu , Jintai Chen , Jian Wu , Zheng Wang

We introduce a pioneering methodology for boosting large language models in the domain of protein representation learning. Our primary contribution lies in the refinement process for correlating the over-reliance on co-evolution knowledge,…

Artificial Intelligence · Computer Science 2024-12-05 Yaoyao Xu , Xinjian Zhao , Xiaozhuang Song , Benyou Wang , Tianshu Yu

While many good textbooks are available on Protein Structure, Molecular Simulations, Thermodynamics and Bioinformatics methods in general, there is no good introductory level book for the field of Structural Bioinformatics. This book aims…

Self-supervised training of language models (LMs) has seen great success for protein sequences in learning meaningful representations and for generative drug design. Most protein LMs are based on the Transformer architecture trained on…

Biomolecules · Quantitative Biology 2025-04-03 Yingheng Wang , Zichen Wang , Gil Sadeh , Luca Zancato , Alessandro Achille , George Karypis , Huzefa Rangwala

Pre-trained protein models (PTPMs) represent a protein with one fixed embedding and thus are not capable for diverse tasks. For example, protein structures can shift, namely protein folding, between several conformations in various…

Artificial Intelligence · Computer Science 2022-02-08 Qiang Zhang , Zeyuan Wang , Yuqiang Han , Haoran Yu , Xurui Jin , Huajun Chen

We present TerraBind, a foundation model for protein-ligand structure and binding affinity prediction that achieves 26-fold faster inference than state-of-the-art methods while improving affinity prediction accuracy by $\sim$20\%. Current…

Non-coding RNA structure and function are essential to understanding various biological processes, such as cell signaling, gene expression, and post-transcriptional regulations. These are all among the core problems in the RNA field. With…

Quantitative Methods · Quantitative Biology 2022-08-09 Jiayang Chen , Zhihang Hu , Siqi Sun , Qingxiong Tan , Yixuan Wang , Qinze Yu , Licheng Zong , Liang Hong , Jin Xiao , Tao Shen , Irwin King , Yu Li

Many proteins remain functionally unannotated. Sequence alignment (SA) uncovers missing annotations by transferring functional knowledge between species' sequence-conserved regions. Because SA is imperfect, network alignment (NA)…

Molecular Networks · Quantitative Biology 2020-06-16 Shawn Gu , Tijana Milenkovic

Graph based molecular representation learning is essential for accurately predicting molecular properties in drug discovery and materials science; however, it faces significant challenges due to the intricate relationships among molecules…

Computational Engineering, Finance, and Science · Computer Science 2025-05-28 Zhengyang Zhou , Yunrui Li , Pengyu Hong , Hao Xu

Despite the high accuracy of 'black box' deep learning models, drug discovery still relies on protein-ligand interaction principles and heuristics. To improve interpretability of protein-small molecule binding predictions, we developed the…

Machine Learning · Computer Science 2026-04-21 Jingke Chen , Jingrui Zhong , Tazneen Hossain Tani , Zidong Su , Xiaochun Zhang , Boxue Tian