English
Related papers

Related papers: Bi-TEAM: A Unified Cross-Scale Representation Lear…

200 papers

Generative modeling has become a central paradigm in protein research, extending machine learning beyond structure prediction toward sequence design, backbone generation, inverse folding, and biomolecular interaction modeling. However, the…

Machine Learning · Computer Science 2026-03-30 Senura Hansaja Wanasekara , Minh-Duong Nguyen , Xiaochen Liu , Nguyen H. Tran , Ken-Tye Yong

Experimental validation of chemical processes is slow and costly, limiting exploration in materials discovery. Machine learning can prioritize promising candidates, but existing data in patents and literature is heterogeneous and difficult…

Chemical Physics · Physics 2025-12-09 Mikhail Tsitsvero , Atsuyuki Nakao , Hisaki Ikebata

Recent advances in general-purpose foundation models have stimulated the development of large biological sequence models. While natural language shows symbolic granularity (characters, words, sentences), biological sequences exhibit…

Machine Learning · Computer Science 2026-03-24 Hanlin Xiao , Rainer Breitling , Eriko Takano , Mauricio A. Álvarez

Protein language models have demonstrated significant potential in the field of protein engineering. However, current protein language models primarily operate at the residue scale, which limits their ability to provide information at the…

Biomolecules · Quantitative Biology 2024-06-14 Kangjie Zheng , Siyu Long , Tianyu Lu , Junwei Yang , Xinyu Dai , Ming Zhang , Zaiqing Nie , Wei-Ying Ma , Hao Zhou

Large language models (LLMs) are widely applied in various natural language processing tasks such as question answering and machine translation. However, due to the lack of labeled data and the difficulty of manual annotation for…

Artificial Intelligence · Computer Science 2026-05-27 Xuan Lin , Long Chen , Yile Wang , Yangyang Chen , Xiangxiang Zeng

Protein language models (PLMs) have revolutionised computational biology through their ability to generate powerful sequence representations for diverse prediction tasks. However, their black-box nature limits biological interpretation and…

Biomolecules · Quantitative Biology 2025-04-11 Jan van Eck , Dea Gogishvili , Wilson Silva , Sanne Abeln

Self-supervised training of language models (LMs) has seen great success for protein sequences in learning meaningful representations and for generative drug design. Most protein LMs are based on the Transformer architecture trained on…

Biomolecules · Quantitative Biology 2025-04-03 Yingheng Wang , Zichen Wang , Gil Sadeh , Luca Zancato , Alessandro Achille , George Karypis , Huzefa Rangwala

State-of-the-art models represent proteins and molecules in separate embedding manifolds, limiting the modeling of systemic biological processes. We introduce ReactEmbed, a lightweight, plug-and-play module that bridges this gap. ReactEmbed…

Machine Learning · Computer Science 2026-05-26 Amitay Sicherman , Kira Radinsky

Applications of machine learning in chemistry are often limited by the scarcity and expense of labeled data, restricting traditional supervised methods. In this work, we introduce a framework for molecular reasoning using general-purpose…

Retrosynthesis analysis is pivotal yet challenging in drug discovery and organic chemistry. Despite the proliferation of computational tools over the past decade, AI-based systems often fall short in generalizing across diverse reaction…

Machine Learning · Computer Science 2024-08-21 Yifei Yang , Runhan Shi , Zuchao Li , Shu Jiang , Bao-Liang Lu , Yang Yang , Hai Zhao

Inferring the structural properties of a protein from its amino acid sequence is a challenging yet important problem in biology. Structures are not known for the vast majority of protein sequences, but structure is critical for…

Machine Learning · Computer Science 2019-10-17 Tristan Bepler , Bonnie Berger

Proteins are the essential drivers of biological processes. At the molecular level, they are chains of amino acids that can be viewed through a linguistic lens where the twenty standard residues serve as an alphabet combining to form a…

Computation and Language · Computer Science 2025-12-15 Burak Suyunu , Özdeniz Dolu , Ibukunoluwa Abigail Olaosebikan , Hacer Karatas Bristow , Arzucan Özgür

The use of machine learning is becoming increasingly common in computational materials science. To build effective models of the chemistry of materials, useful machine-based representations of atoms and their compounds are required. We…

Materials Science · Physics 2021-08-02 Luis M. Antunes , Ricardo Grau-Crespo , Keith T. Butler

In recent years, protein-text models have gained significant attention for their potential in protein generation and understanding. Current approaches focus on integrating protein-related knowledge into large language models through…

Computation and Language · Computer Science 2025-11-11 Juntong Wu , Zijing Liu , He Cao , Hao Li , Bin Feng , Zishan Shu , Ke Yu , Li Yuan , Yu Li

Crystal graph neural networks are widely applicable in modeling experimentally synthesized compounds and hypothetical materials with unknown synthesizability. In contrast, structure-agnostic predictive algorithms allow exploring previously…

Materials Science · Physics 2025-11-06 Ivan Rubtsov , Ivan Dudakov , Yuri Kuratov , Vadim Korolev

We introduce a protein language model for determining the complete sequence of a peptide based on measurement of a limited set of amino acids. To date, protein sequencing relies on mass spectrometry, with some novel edman degregation based…

Proteins typically exist in complexes, interacting with other proteins or biomolecules to perform their specific biological roles. Research on single-chain protein modeling has been extensively and deeply explored, with advancements seen in…

Machine Learning · Computer Science 2025-09-09 Ruizhe Chen , Dongyu Xue , Xiangxin Zhou , Zaixiang Zheng , Xiangxiang Zeng , Quanquan Gu

Deep learning models have become fundamental tools in drug design. In particular, large language models trained on biochemical sequences learn feature vectors that guide drug discovery through virtual screening. However, such models do not…

Biomolecules · Quantitative Biology 2025-03-28 Joseph D. Clark , Tanner J. Dean , Diwakar Shukla

Existing Protein Language Models (PLMs) often suffer from limited adaptability to multiple tasks and exhibit poor generalization across diverse biological contexts. In contrast, general-purpose Large Language Models (LLMs) lack the…

Machine Learning · Computer Science 2026-02-23 Yujia Wang , Jihong Guan , Wengen Li , Shuigeng Zhou , Xuhong Wang

This study introduces Bidirectional Topic Matching (BTM), a novel method for cross-corpus topic modeling that quantifies thematic overlap and divergence between corpora. BTM is a flexible framework that can incorporate various topic…

Computation and Language · Computer Science 2024-12-25 Raven Adam , Marie Lisa Kogler