English
Related papers

Related papers: Foundation Molecular Grammar: Multi-Modal Foundati…

200 papers

Procuring expressive molecular representations underpins AI-driven molecule design and scientific discovery. The research mainly focuses on atom-level homogeneous molecular graphs, ignoring the rich information in subgraphs or motifs.…

Quantitative Methods · Quantitative Biology 2023-01-10 Fang Wu , Dragomir Radev , Stan Z. Li

The quest for accurate prediction of drug molecule properties poses a fundamental challenge in the realm of Artificial Intelligence Drug Discovery (AIDD). An effective representation of drug molecules emerges as a pivotal component in this…

Machine Learning · Computer Science 2024-04-22 Zhuoyuan Wang , Jiacong Mi , Shan Lu , Jieyue He

Accurate prediction of molecular properties is essential in drug discovery and related fields. However, existing graph neural networks (GNNs) often struggle to simultaneously capture both local and global molecular structures. In this work,…

Machine Learning · Computer Science 2025-08-26 XiaYu Liu , Chao Fan , Yang Liu , Hou-biao Li

Transformer-based models trained on large and general purpose datasets consisting of molecular strings have recently emerged as a powerful tool for successfully modeling various structure-property relations. Inspired by this success, we…

Biomolecules · Quantitative Biology 2025-04-02 Jerret Ross , Brian Belgodere , Samuel C. Hoffman , Vijil Chenthamarakshan , Jiri Navratil , Youssef Mroueh , Payel Das

Despite their ability to understand chemical knowledge, large language models (LLMs) remain limited in their capacity to propose novel molecules with desired functions (e.g., drug-like properties). In addition, the molecules that LLMs…

Answering questions that require reading texts in an image is challenging for current models. One key difficulty of this task is that rare, polysemous, and ambiguous words frequently appear in images, e.g., names of places, products, and…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Difei Gao , Ke Li , Ruiping Wang , Shiguang Shan , Xilin Chen

Graph Foundation Models (GFMs) are emerging as a significant research topic in the graph domain, aiming to develop graph models trained on extensive and diverse data to enhance their applicability across various tasks and domains.…

Machine Learning · Computer Science 2024-06-03 Haitao Mao , Zhikai Chen , Wenzhuo Tang , Jianan Zhao , Yao Ma , Tong Zhao , Neil Shah , Mikhail Galkin , Jiliang Tang

Large language models have made significant strides in natural language processing, enabling innovative applications in molecular science by processing textual representations of molecules. However, most existing language models cannot…

Machine Learning · Computer Science 2024-02-07 Pengfei Liu , Yiming Ren , Jun Tao , Zhixiang Ren

Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, the inherent…

Machine Learning · Computer Science 2024-09-16 Xiaohua Lu , Liangxu Xie , Lei Xu , Rongzhi Mao , Shan Chang , Xiaojun Xu

Designing molecules with specific properties is a long-lasting research problem and is central to advancing crucial domains such as drug discovery and material science. Recent advances in deep graph generative models treat molecule design…

Machine Learning · Computer Science 2022-03-02 Yuanqi Du , Xiaojie Guo , Amarda Shehu , Liang Zhao

Deep generative models of molecules have grown immensely in popularity, trained on relevant datasets, these models are used to search through chemical space. The downstream utility of generative models for the inverse design of novel…

Machine Learning · Computer Science 2023-05-11 Daniel Flam-Shepherd , Kevin Zhu , Alán Aspuru-Guzik

Knowledge Graph Foundation Models (KGFMs) have shown promise in enabling zero-shot reasoning over unseen graphs by learning transferable patterns. However, most existing KGFMs rely solely on graph structure, overlooking the rich semantic…

Computation and Language · Computer Science 2025-09-22 Arvindh Arun , Sumit Kumar , Mojtaba Nayyeri , Bo Xiong , Ponnurangam Kumaraguru , Antonio Vergari , Steffen Staab

Multi-modal knowledge graph reasoning (MMKGR) aims to predict the missing links by exploiting both graph structure information and multi-modal entity contents. Most existing works are designed for a transductive setting, which learns…

Computation and Language · Computer Science 2026-02-19 Yichi Zhang , Zhuo Chen , Lingbing Guo , Wen Zhang , Huajun Chen

Large Language Models (LLMs) have demonstrated remarkable generalization and instruction-following capabilities with instruction tuning. The advancements in LLMs and instruction tuning have led to the development of Large Vision-Language…

Machine Learning · Computer Science 2024-11-05 Jinyoung Park , Minseong Bae , Dohwan Ko , Hyunwoo J. Kim

Molecular representation learning plays a crucial role in various downstream tasks, such as molecular property prediction and drug design. To accurately represent molecules, Graph Neural Networks (GNNs) and Graph Transformers (GTs) have…

Machine Learning · Computer Science 2025-02-07 Jingjing Hu , Dan Guo , Zhan Si , Deguang Liu , Yunfeng Diao , Jing Zhang , Jinxing Zhou , Meng Wang

Traditional molecule generation methods often rely on sequence- or graph-based representations, which can limit their expressive power or require complex permutation-equivariant architectures. This paper introduces a novel paradigm for…

Machine Learning · Computer Science 2025-02-18 Van Khoa Nguyen , Maciej Falkiewicz , Giangiacomo Mercatali , Alexandros Kalousis

Generating molecular graphs with desired chemical properties driven by deep graph generative models provides a very promising way to accelerate drug discovery process. Such graph generative models usually consist of two steps: learning…

Machine Learning · Statistics 2020-06-19 Chengxi Zang , Fei Wang

Molecular graph neural networks (GNNs) often focus exclusively on XYZ-based geometric representations and thus overlook valuable chemical context available in public databases like PubChem. This work introduces a multimodal framework that…

Machine Learning · Computer Science 2025-05-20 Can Polat , Hasan Kurban , Erchin Serpedin , Mustafa Kurban

Generating molecular structures with desired properties is a critical task with broad applications in drug discovery and materials design. We propose 3M-Diffusion, a novel multi-modal molecular graph generation method, to generate diverse,…

Machine Learning · Computer Science 2024-10-04 Huaisheng Zhu , Teng Xiao , Vasant G Honavar

Machine learning (ML) offers considerable promise for the design of new molecules and materials. In real-world applications, the design problem is often domain-specific, and suffers from insufficient data, particularly labeled data, for ML…

Chemical Physics · Physics 2025-02-04 Ming Han , Ge Sun , Juan J. de Pablo