English
Related papers

Related papers: Exploiting Pretrained Biochemical Language Models …

200 papers

The goal of structure-based drug discovery is to find small molecules that bind to a given target protein. Deep learning has been used to generate drug-like molecules with certain cheminformatic properties, but has not yet been applied to…

Quantitative Methods · Quantitative Biology 2022-01-27 Matthew Ragoza , Tomohide Masuda , David Ryan Koes

Recent advancements in specialized large-scale architectures for training image and language have profoundly impacted the field of computer vision and natural language processing (NLP). Language models, such as the recent ChatGPT and GPT4…

Biomolecules · Quantitative Biology 2023-05-04 Sergio Romero-Romero , Sebastian Lindner , Noelia Ferruz

We introduce a pioneering methodology for boosting large language models in the domain of protein representation learning. Our primary contribution lies in the refinement process for correlating the over-reliance on co-evolution knowledge,…

Artificial Intelligence · Computer Science 2024-12-05 Yaoyao Xu , Xinjian Zhao , Xiaozhuang Song , Benyou Wang , Tianshu Yu

Drug discovery projects entail cycles of design, synthesis, and testing that yield a series of chemically related small molecules whose properties, such as binding affinity to a given target protein, are progressively tailored to a…

Machine Learning · Computer Science 2020-02-10 Paul Maragakis , Hunter Nisonoff , Brian Cole , David E. Shaw

Deep learning approaches have produced substantial breakthroughs in fields such as image classification and natural language processing and are making rapid inroads in the area of protein design. Many generative models of proteins have been…

Machine Learning · Computer Science 2021-09-29 Alexey Strokach , Philip M. Kim

To design a drug given a biological molecule by using deep learning methods, there are many successful models published recently. People commonly used generative models to design new molecules given certain protein. LiGAN was regarded as…

Machine Learning · Computer Science 2022-11-15 Haotian Zhang , Linxiaoyi Wan

There are already many DNA large language models, but most of them still follow traditional uses, such as extracting sequence features for classification tasks. More innovative applications of large language models, such as prompt…

Genomics · Quantitative Biology 2024-10-29 Wang Liang

The de novo design of molecular structures using deep learning generative models introduces an encouraging solution to drug discovery in the face of the continuously increased cost of new drug development. From the generation of original…

Biomolecules · Quantitative Biology 2021-02-08 Yuemin Bian , Xiang-Qun Xie

Proteins are the fundamental macromolecules that play diverse and crucial roles in all living matter and have tremendous implications in healthcare, manufacturing, and biotechnology. Their functions are largely determined by the sequences…

Biomolecules · Quantitative Biology 2024-09-17 Boqiao Lai

Molecular language modeling is an effective approach to generating novel chemical structures. However, these models do not \emph{a priori} encode certain preferences a chemist may desire. We investigate the use of fine-tuning using Direct…

Machine Learning · Statistics 2023-10-20 Ryan Park , Ryan Theisen , Navriti Sahni , Marcel Patek , Anna Cichońska , Rayees Rahman

We study a fundamental problem in structure-based drug design -- generating molecules that bind to specific protein binding sites. While we have witnessed the great success of deep generative models in drug design, the existing methods are…

Biomolecules · Quantitative Biology 2022-11-15 Shitong Luo , Jiaqi Guan , Jianzhu Ma , Jian Peng

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

Computation and Language · Computer Science 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

Large language models (LLMs) are introducing a paradigm shift in molecular discovery by enabling text-guided interaction with chemical spaces through natural language, symbolic notations, with emerging extensions to incorporate multi-modal…

Machine Learning · Computer Science 2025-05-23 Ziqing Wang , Kexin Zhang , Zihan Zhao , Yibo Wen , Abhishek Pandey , Han Liu , Kaize Ding

Antibody therapeutics are among the most successful modern medicines, yet computationally designing antibodies with desirable binding and developability properties remains challenging. While protein language models (pLMs) have emerged as…

Machine Learning · Computer Science 2026-05-11 Justin Sanders , Luca Giancardo , Lan Guo , Yue Zhao , Kemal Sonmez , Nina Cheng , Melih Yilmaz

Self-supervised neural language models have recently found wide applications in generative design of organic molecules and protein sequences as well as representation learning for downstream structure classification and functional…

Materials Science · Physics 2022-09-21 Lai Wei , Nihang Fu , Yuqi Song , Qian Wang , Jianjun Hu

Deep learning has significantly accelerated drug discovery, with 'chemical language' processing (CLP) emerging as a prominent approach. CLP learns from molecular string representations (e.g., Simplified Molecular Input Line Entry Systems…

Biomolecules · Quantitative Biology 2025-01-13 Rıza Özçelik , Francesca Grisoni

Generating novel active molecules for a given protein is an extremely challenging task for generative models that requires an understanding of the complex physical interactions between the molecule and its environment. In this paper, we…

Neural models that do not rely on pre-training have excelled in the keyphrase generation task with large annotated datasets. Meanwhile, new approaches have incorporated pre-trained language models (PLMs) for their data efficiency. However,…

Computation and Language · Computer Science 2024-02-26 Di Wu , Wasi Uddin Ahmad , Kai-Wei Chang

Target proteins that lack accessible binding pockets and conformational stability have posed increasing challenges for drug development. Induced proximity strategies, such as PROTACs and molecular glues, have thus gained attention as…

Deep generative models of molecules have grown immensely in popularity, trained on relevant datasets, these models are used to search through chemical space. The downstream utility of generative models for the inverse design of novel…

Machine Learning · Computer Science 2023-05-11 Daniel Flam-Shepherd , Kevin Zhu , Alán Aspuru-Guzik