中文
相关论文

相关论文: Pre-training Transformers for Molecular Property P…

200 篇论文

Machine Learning tools are nowadays widely applied extensively to the prediction of the properties of molecular materials, using datasets extracted from high-throughput computational models. In several cases of scientific and technological…

材料科学 · 物理学 2021-02-10 Fabio Le Piane , Matteo Baldoni , Francesco Mercuri

Many important problems involving molecular property prediction from 3D structures have limited data, posing a generalization challenge for neural networks. In this paper, we describe a pre-training technique based on denoising that…

Molecular property prediction is a fundamental task in computational chemistry with critical applications in drug discovery and materials science. While recent works have explored Large Language Models (LLMs) for this task, they primarily…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Deepan Adak , Yogesh Singh Rawat , Shruti Vyas

Molecular representation learning is pivotal for various molecular property prediction tasks related to drug discovery. Robust and accurate benchmarks are essential for refining and validating current methods. Existing molecular property…

化学物理 · 物理学 2024-06-27 Shikun Feng , Jiaxin Zheng , Yinjun Jia , Yanwen Huang , Fengfeng Zhou , Wei-Ying Ma , Yanyan Lan

In drug discovery, predicting the absorption, distribution, metabolism, excretion, and toxicity (ADMET) properties of small-molecule drugs is critical for ensuring safety and efficacy. However, the process of accurately predicting these…

机器学习 · 计算机科学 2026-03-27 Bohao Xu , Yingzhou Lu , Chenhao Li , Ling Yue , Xiao Wang , Tianfan Fu , Minjie Shen , Lulu Chen

Chemical representations derived from deep learning are emerging as a powerful tool in areas such as drug discovery and materials innovation. Currently, this methodology has three major limitations - the cost of representation generation,…

化学物理 · 物理学 2018-09-18 Clyde Fare , Lukas Turcani , Edward O. Pyzer-Knapp

Simile interpretation is a crucial task in natural language processing. Nowadays, pre-trained language models (PLMs) have achieved state-of-the-art performance on many tasks. However, it remains under-explored whether PLMs can interpret…

计算与语言 · 计算机科学 2022-03-17 Qianyu He , Sijie Cheng , Zhixu Li , Rui Xie , Yanghua Xiao

Foundation models have been transformational in machine learning fields such as natural language processing and computer vision. Similar success in atomic property prediction has been limited due to the challenges of training effective…

Transformer-based deep neural networks have revolutionized the field of molecular-related prediction tasks by treating molecules as symbolic sequences. These models have been successfully applied in various organic chemical applications by…

化学物理 · 物理学 2023-11-14 Tatsuya Sagawa , Ryosuke Kojima

Protein mutations can have profound effects on biological function, making accurate prediction of property changes critical for drug discovery, protein engineering, and precision medicine. Current approaches rely on fine-tuning…

机器学习 · 计算机科学 2025-10-27 Srivathsan Badrinarayanan , Yue Su , Janghoon Ock , Alan Pham , Sanya Ahuja , Amir Barati Farimani

Enhancing accurate molecular property prediction relies on effective and proficient representation learning. It is crucial to incorporate diverse molecular relationships characterized by multi-similarity (self-similarity and relative…

机器学习 · 计算机科学 2024-02-05 Hao Xu , Zhengyang Zhou , Pengyu Hong

Deep generative models have recently been applied to molecule design. If the molecules are encoded in linear SMILES strings, modeling becomes convenient. However, models relying on string representations tend to generate invalid samples and…

机器学习 · 计算机科学 2020-10-20 Bo Pang , Tian Han , Ying Nian Wu

Molecular representation is a critical element in our understanding of the physical world and the foundation for modern molecular machine learning. Previous molecular machine learning models have employed strings, fingerprints, global…

The limited extrapolative power of structure-based machine learning (ML) models is a critical bottleneck in chemical discovery, particularly for industrial R&D, where navigating uncharted chemical space to find next-generation materials or…

Accurate molecular property prediction requires integrating complementary information from molecular structure and chemical semantics. In this work, we propose LGM-CL, a local-global multimodal contrastive learning framework that jointly…

机器学习 · 计算机科学 2026-02-02 Xiayu Liu , Zhengyi Lu , Yunhong Liao , Chan Fan , Hou-biao Li

In this work we propose simple, effective and computationally efficient transfer learning approaches for structure-property relation predictions in the context of materials, with highly informative input from different modalities. As…

材料科学 · 物理学 2024-12-11 Dario Massa , Grzegorz Kaszuba , Stefanos Papanikolaou , Piotr Sankowski

Predicting molecular properties (e.g., atomization energy) is an essential issue in quantum chemistry, which could speed up much research progress, such as drug designing and substance discovery. Traditional studies based on density…

计算物理 · 物理学 2019-08-20 Chengqiang Lu , Qi Liu , Chao Wang , Zhenya Huang , Peize Lin , Lixin He

Transfer learning is a machine learning technique that uses previously acquired knowledge from a source domain to enhance learning in a target domain by reusing learned weights. This technique is ubiquitous because of its great advantages…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Nermeen Abou Baker , Nico Zengeler , Uwe Handmann

The discovery of effective molecular modulators is essential for advancing perovskite solar cells (PSCs), but the research process is hindered by the vastness of chemical space and the time-consuming and expensive trial-and-error…

Chemical Language Models (CLMs) pre-trained on large scale molecular data are widely used for molecular property prediction. However, the common belief that increasing training resources such as model size, dataset size, and training…

机器学习 · 计算机科学 2026-05-14 Tatsuya Sagawa , Ryosuke Kojima