English
Related papers

Related papers: SMILES-Mamba: Chemical Mamba Foundation Models for…

200 papers

Activity and property prediction models are the central workhorses in drug discovery and materials sciences, but currently they have to be trained or fine-tuned for new tasks. Without training or fine-tuning, scientific language models…

Biomolecules · Quantitative Biology 2023-06-19 Philipp Seidl , Andreu Vall , Sepp Hochreiter , Günter Klambauer

Large-scale pre-training methodologies for chemical language models represent a breakthrough in cheminformatics. These methods excel in tasks such as property prediction and molecule generation by learning contextualized representations of…

Machine Learning · Computer Science 2025-07-18 Eduardo Soares , Victor Shirasuna , Emilio Vital Brazil , Renato Cerqueira , Dmitry Zubarev , Kristin Schmidt

Large language models applied to vast biological datasets have the potential to transform biology by uncovering disease mechanisms and accelerating drug development. However, current models are often siloed, trained separately on…

Understanding and predicting polymer solubility in various solvents is critical for applications ranging from recycling to pharmaceutical formulation. This work presents a deep learning framework that predicts polymer solubility, expressed…

Machine Learning · Computer Science 2025-12-11 Andrew Reinhard

Motivation: Prediction of the interaction affinity between proteins and compounds is a major challenge in the drug discovery process. WideDTA is a deep-learning based prediction model that employs chemical and biological textual sequence…

Quantitative Methods · Quantitative Biology 2019-02-13 Hakime Öztürk , Elif Ozkirimli , Arzucan Özgür

A comprehensive understanding of molecular structures is important for the prediction of molecular ground-state conformation involving property information. Meanwhile, state space model (e.g., Mamba) has recently emerged as a promising…

Chemical Physics · Physics 2025-11-14 Yuxin Gou , Aming Wu , Richang Hong , Meng Wang

Characterizing anomalous diffusion is crucial in order to understand the evolution of complex stochastic systems, from molecular interactions to cellular dynamics. In this work, we characterize the performances regarding such a task of…

Soft Condensed Matter · Physics 2024-12-11 Maxime Lavaud , Yosef Shokeeb , Juliette Lacherez , Yacine Amarouchene , Thomas Salez

Traditional molecular string representations, such as SMILES, often pose challenges for AI-driven molecular design due to their non-sequential depiction of molecular substructures. To address this issue, we introduce Sequential…

Machine Learning · Computer Science 2023-12-13 Emmanuel Noutahi , Cristian Gabellini , Michael Craig , Jonathan S. C Lim , Prudencio Tossou

Chemical reaction prediction, involving forward synthesis and retrosynthesis prediction, is a fundamental problem in organic synthesis. A popular computational paradigm formulates synthesis prediction as a sequence-to-sequence translation…

Machine Learning · Computer Science 2022-08-15 Zipeng Zhong , Jie Song , Zunlei Feng , Tiantao Liu , Lingxiang Jia , Shaolun Yao , Min Wu , Tingjun Hou , Mingli Song

In line with recent advances in neural drug design and sensitivity prediction, we propose a novel architecture for interpretable prediction of anticancer compound sensitivity using a multimodal attention-based convolutional encoder. Our…

Generative chemical language models (CLMs) have demonstrated strong capabilities in molecular design, yet their impact in drug discovery remains limited by the absence of reliable reward signals and the lack of interpretability in their…

Machine Learning · Computer Science 2025-07-15 Lu Zhu , Emmanuel Noutahi

Only parts of unlabeled data are selected to train models for most semi-supervised learning methods, whose confidence scores are usually higher than the pre-defined threshold (i.e., the confidence margin). We argue that the recognition…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Hangyu Li , Nannan Wang , Xi Yang , Xiaoyu Wang , Xinbo Gao

We present a modular framework powered by large language models (LLMs) that automates and streamlines key tasks across the early-stage computational drug discovery pipeline. By combining LLM reasoning with domain-specific tools, the…

Machine learning models have found numerous successful applications in computational drug discovery. A large body of these models represents molecules as sequences since molecular sequences are easily available, simple, and informative. The…

Accurate medical image segmentation demands the integration of multi-scale information, spanning from local features to global dependencies. However, it is challenging for existing methods to model long-range global information, where…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Jiarun Liu , Hao Yang , Hong-Yu Zhou , Yan Xi , Lequan Yu , Yizhou Yu , Yong Liang , Guangming Shi , Shaoting Zhang , Hairong Zheng , Shanshan Wang

We demonstrate the ability of large language models (LLMs) to perform material and molecular property regression tasks, a significant deviation from the conventional LLM use case. We benchmark the Large Language Model Meta AI (LLaMA) 3 on…

Materials Science · Physics 2026-04-22 Ryan Jacobs , Maciej P. Polak , Lane E. Schultz , Hamed Mahdavi , Vasant Honavar , Dane Morgan

Diffusion Models have become very popular for Semantic Image Synthesis (SIS) of human faces. Nevertheless, their training and inference is computationally expensive and their computational requirements are high due to the quadratic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Filippo Botti , Alex Ergasti , Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

Molecular property prediction is essential for drug discovery. In recent years, deep learning methods have been introduced to this area and achieved state-of-the-art performances. However, most of existing methods ignore the intrinsic…

Biomolecules · Quantitative Biology 2022-11-04 Yuancheng Sun , Yimeng Chen , Weizhi Ma , Wenhao Huang , Kang Liu , Zhiming Ma , Wei-Ying Ma , Yanyan Lan

Machine learning (ML) offers considerable promise for the design of new molecules and materials. In real-world applications, the design problem is often domain-specific, and suffers from insufficient data, particularly labeled data, for ML…

Chemical Physics · Physics 2025-02-04 Ming Han , Ge Sun , Juan J. de Pablo

Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within the chemistry domain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Khiem Le , Zhichun Guo , Kaiwen Dong , Xiaobao Huang , Bozhao Nan , Roshni Iyer , Xiangliang Zhang , Olaf Wiest , Wei Wang , Ting Hua , Nitesh V. Chawla