English
Related papers

Related papers: Chem3DLLM: 3D Multimodal Large Language Models for…

200 papers

The rapid evolution of artificial intelligence in drug discovery encounters challenges with generalization and extensive training, yet Large Language Models (LLMs) offer promise in reshaping interactions with complex molecular data. Our…

Biomolecules · Quantitative Biology 2024-12-20 He Cao , Zijing Liu , Xingyu Lu , Yuan Yao , Yu Li

Molecular dynamics (MD) is a powerful approach for modelling molecular systems, but it remains computationally intensive on spatial and time scales of many macromolecular systems of biological interest. To explore the opportunities offered…

Biomolecules · Quantitative Biology 2025-08-07 Mhd Hussein Murtada , Z. Faidon Brotzakis , Michele Vendruscolo

Existing chemical understanding tasks primarily rely on static molecular representations, limiting their ability to model inherently dynamic phenomena such as bond breaking or conformational changes, which are essential for a chemist to…

Machine Learning · Computer Science 2026-03-13 Xinyu Li , Zhen Zhang , Qi Chen , Anton van den Hengel , Lina Yao , Javen Qinfeng Shi

Large Language Models (LLMs) stand at the forefront of a number of Natural Language Processing (NLP) tasks. Despite the widespread adoption of LLMs in NLP, much of their potential in broader fields remains largely unexplored, and…

Machine Learning · Computer Science 2024-03-11 Zhiqiang Zhong , Kuangyu Zhou , Davide Mottin

Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within the chemistry domain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Khiem Le , Zhichun Guo , Kaiwen Dong , Xiaobao Huang , Bozhao Nan , Roshni Iyer , Xiangliang Zhang , Olaf Wiest , Wei Wang , Ting Hua , Nitesh V. Chawla

Large language models (LLMs) have made impressive progress in chemistry applications. However, the community lacks an LLM specifically designed for chemistry. The main challenges are two-fold: firstly, most chemical data and scientific…

Shape-based virtual screening is widely employed in ligand-based drug design to search chemical libraries for molecules with similar 3D shapes yet novel 2D chemical structures compared to known ligands. 3D deep generative models have the…

Chemical Physics · Physics 2022-10-12 Keir Adams , Connor W. Coley

Latent representation alignment has become a foundational technique for constructing multimodal large language models (MLLM) by mapping embeddings from different modalities into a shared space, often aligned with the embedding space of…

Machine Learning · Computer Science 2025-03-06 Dong Shu , Bingbing Duan , Kai Guo , Kaixiong Zhou , Jiliang Tang , Mengnan Du

While large language models (LLMs) have integrated images, adapting them to graphs remains challenging, limiting their applications in materials and drug design. This difficulty stems from the need for coherent autoregressive generation…

Machine Learning · Computer Science 2024-10-08 Gang Liu , Michael Sun , Wojciech Matusik , Meng Jiang , Jie Chen

In the molecular domain, numerous studies have explored the use of multimodal large language models (LLMs) to construct a general-purpose, multi-task molecular model. However, these efforts are still far from achieving a truly universal…

Machine Learning · Computer Science 2025-10-31 Chengxin Hu , Hao Li , Yihe Yuan , Zezheng Song , Chenyang Zhao , Haixin Wang

Multi-modal Large Language Models (MLLMs) exhibit impressive capabilities in 2D tasks, yet encounter challenges in discerning the spatial positions, interrelations, and causal logic in scenes when transitioning from 2D to 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Haomiao Xiong , Yunzhi Zhuge , Jiawen Zhu , Lu Zhang , Huchuan Lu

Chemical reasoning inherently integrates visual, textual, and symbolic modalities, yet existing benchmarks rarely capture this complexity, often relying on simple image-text pairs with limited chemical semantics. As a result, the actual…

Artificial Intelligence · Computer Science 2025-11-25 Zhiyuan Huang , Baichuan Yang , Zikun He , Yanhong Wu , Fang Hongyu , Zhenhe Liu , Lin Dongsheng , Bing Su

Reasoning segmentation aims to segment target objects in complex scenes based on human intent and spatial reasoning. While recent multimodal large language models (MLLMs) have demonstrated impressive 2D image reasoning segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jiaxin Huang , Runnan Chen , Ziwen Li , Zhengqing Gao , Xiao He , Yandong Guo , Mingming Gong , Tongliang Liu

The application of language models (LMs) to molecular structure generation using line notations such as SMILES and SELFIES has been well-established in the field of cheminformatics. However, extending these models to generate 3D molecular…

Machine Learning · Computer Science 2024-12-03 Kaiyuan Gao , Yusong Wang , Haoxiang Guan , Zun Wang , Qizhi Pei , John E. Hopcroft , Kun He , Lijun Wu

Generating novel active molecules for a given protein is an extremely challenging task for generative models that requires an understanding of the complex physical interactions between the molecule and its environment. In this paper, we…

Large language models (LLMs) have demonstrated their instruction-following capabilities and achieved powerful performance on various tasks. Inspired by their success, recent works in the molecular domain have led to the development of large…

Artificial Intelligence · Computer Science 2026-01-21 Jinyoung Park , Minseong Bae , Jeehye Na , Hyunwoo J. Kim

Pharmaceutical three-dimensional (3D) printing is an advanced fabrication technology with the potential to enable truly personalised dosage forms. Recent studies have integrated artificial intelligence (AI) to accelerate formulation and…

Artificial Intelligence · Computer Science 2026-05-19 Adeshola Okubena , Yusuf Ali Mohammed , Moe Elbadawi

Contemporary large language models (LLMs), such as GPT-4 and Llama, have harnessed extensive computational power and diverse text corpora to achieve remarkable proficiency in interpreting and generating domain-specific content, including…

Machine Learning · Computer Science 2025-10-07 Tianren Zhang , Dai-Bei Yang

Accurate molecular property prediction is a critical challenge with wide-ranging applications in chemistry, materials science, and drug discovery. Molecular representation methods, including fingerprints and graph neural networks (GNNs),…

Machine Learning · Computer Science 2025-08-13 Jiaxin Ju , Yizhen Zheng , Huan Yee Koh , Can Wang , Shirui Pan

Generating molecular structures with desired properties is a critical task with broad applications in drug discovery and materials design. We propose 3M-Diffusion, a novel multi-modal molecular graph generation method, to generate diverse,…

Machine Learning · Computer Science 2024-10-04 Huaisheng Zhu , Teng Xiao , Vasant G Honavar