English
Related papers

Related papers: Thinking like a CHEMIST: Combined Heterogeneous Em…

200 papers

Molecular representation learning plays an essential role in cheminformatics. Recently, language model-based approaches have gained popularity as an alternative to traditional expert-designed features to encode molecules. However, these…

Machine Learning · Computer Science 2022-04-19 Zhihui Guo , Pramod Sharma , Andy Martinez , Liang Du , Robin Abraham

Functional groups and moieties are chemical descriptors of biomolecules that can be used to interpret their properties and functions, leading to the understanding of chemical or biological mechanisms. These chemical building blocks, or…

Biomolecules · Quantitative Biology 2021-11-08 Yasemin Yesiltepe , Ryan S. Renslow , Thomas O. Metz

Graph neural networks (GNNs) demonstrate great performance in compound property and activity prediction due to their capability to efficiently learn complex molecular graph structures. However, two main limitations persist including…

Biomolecules · Quantitative Biology 2023-10-10 Apakorn Kengkanna , Masahito Ohue

SMILES, a crucial textual representation of molecular structures, has garnered significant attention as a foundation for pre-trained language models (LMs). However, most existing pre-trained SMILES LMs focus solely on the single-token level…

Machine Learning · Computer Science 2025-06-10 Kangjie Zheng , Siyue Liang , Junwei Yang , Bin Feng , Zequn Liu , Wei Ju , Zhiping Xiao , Ming Zhang

The problem of accelerating drug discovery relies heavily on automatic tools to optimize precursor molecules to afford them with better biochemical properties. Our work in this paper substantially extends prior state-of-the-art on…

Chemical Physics · Physics 2019-10-22 Wengong Jin , Regina Barzilay , Tommi Jaakkola

Heterogeneous graph neural networks (HGNNs) excel at capturing structural and semantic information in heterogeneous graphs (HGs), while struggling to generalize across domains and tasks. With the rapid advancement of large language models…

Social and Information Networks · Computer Science 2025-07-31 Jinyu Yang , Cheng Yang , Shanyuan Cui , Zeyuan Guo , Liangwei Yang , Muhan Zhang , Zhiqiang Zhang , Chuan Shi

The use of subword-level information (e.g., characters, character n-grams, morphemes) has become ubiquitous in modern word representation learning. Its importance is attested especially for morphologically rich languages which generate a…

Computation and Language · Computer Science 2019-05-07 Yi Zhu , Ivan Vulić , Anna Korhonen

Generative deep learning has become pivotal in molecular design for drug discovery, materials science, and chemical engineering. A widely used paradigm is to pretrain neural networks on string representations of molecules and fine-tune them…

Machine Learning · Computer Science 2025-03-21 Jonathan Pirnay , Jan G. Rittig , Alexander B. Wolf , Martin Grohe , Jakob Burger , Alexander Mitsos , Dominik G. Grimm

Graph Transformers have recently attracted attention for molecular property prediction by combining the inductive biases of graph neural networks (GNNs) with the global receptive field of Transformers. However, many existing hybrid…

Machine Learning · Computer Science 2026-04-09 Yi Yang , Ovidiu Daescu

Since the advent of machine learning, interpretability has remained a persistent challenge, becoming increasingly urgent as generative models support high-stakes applications in drug and material discovery. Recent advances in large language…

Machine Learning · Computer Science 2025-12-10 Jaron Cohen , Alexander G. Hasson , Sara Tanovic

Molecules are commonly represented as SMILES strings, which can be readily converted to fixed-size molecular fingerprints. These fingerprints serve as feature vectors to train ML/DL models for molecular property prediction tasks in the…

Machine Learning · Computer Science 2026-03-10 Rajan , Ishaan Gupta

Molecular representation learning (MRL) is a key step to build the connection between machine learning and chemical science. In particular, it encodes molecules as numerical vectors preserving the molecular structures and features, on top…

Quantitative Methods · Quantitative Biology 2023-11-30 Zhichun Guo , Kehan Guo , Bozhao Nan , Yijun Tian , Roshni G. Iyer , Yihong Ma , Olaf Wiest , Xiangliang Zhang , Wei Wang , Chuxu Zhang , Nitesh V. Chawla

Neural Architecture Representation Learning aims to transform network models into feature representations for predicting network attributes, playing a crucial role in deploying and designing networks for real-world applications. Recently,…

Machine Learning · Computer Science 2025-06-10 Haizhao Jing , Haokui Zhang , Zhenhao Shang , Rong Xiao , Peng Wang , Yanning Zhang

Accurately predicting drug-target binding affinity (DTA) in silico is a key task in drug discovery. Most of the conventional DTA prediction methods are simulation-based, which rely heavily on domain knowledge or the assumption of having the…

Machine Learning · Computer Science 2020-04-06 Xuan Lin

Text-attributed graphs require models to effectively integrate both structural topology and semantic content. Recent approaches apply large language models to graphs by linearizing structures into token sequences through random walks. These…

Graphics · Computer Science 2025-12-23 Heng Zheng , Haochen You , Zijun Liu , Zijian Zhang , Lubin Gan , Hao Zhang , Wenjun Huang , Jin Huang

While Language Models (LMs) are the workhorses of NLP, their interplay with structured knowledge graphs (KGs) is still actively researched. Current methods for encoding such graphs typically either (i) linearize them for embedding with LMs…

Computation and Language · Computer Science 2024-06-04 Moritz Plenz , Anette Frank

Molecular representation learning is a crucial task in predicting molecular properties. Molecules are often modeled as graphs where atoms and chemical bonds are represented as nodes and edges, respectively, and Graph Neural Networks (GNNs)…

Machine Learning · Computer Science 2023-05-23 Jiahao Chen , Yurou Liu , Jiangmeng Li , Bing Su , Jirong Wen

Deep generative models have recently been applied to molecule design. If the molecules are encoded in linear SMILES strings, modeling becomes convenient. However, models relying on string representations tend to generate invalid samples and…

Machine Learning · Computer Science 2020-10-20 Bo Pang , Tian Han , Ying Nian Wu

Molecular property prediction is a crucial foundation for drug discovery. In recent years, pre-trained deep learning models have been widely applied to this task. Some approaches that incorporate prior biological domain knowledge into the…

Machine Learning · Computer Science 2024-08-20 Tianyu Zhang , Yuxiang Ren , Chengbin Hou , Hairong Lv , Xuegong Zhang

In this paper we study the practicality and usefulness of incorporating distributed representations of graphs into models within the context of drug pair scoring. We argue that the real world growth and update cycles of drug pair scoring…

Machine Learning · Computer Science 2022-11-28 Paul Scherer , Pietro Liò , Mateja Jamnik