English
Related papers

Related papers: Chem3DLLM: 3D Multimodal Large Language Models for…

200 papers

Large Language Models (LLMs) drive current AI breakthroughs despite very little being known about their internal representations. In this work, we propose to shed the light on LLMs inner mechanisms through the lens of geometry. In…

Artificial Intelligence · Computer Science 2024-07-12 Randall Balestriero , Romain Cosentino , Sarath Shekkizhar

The remarkable success of Large Language Models (LLMs) across diverse tasks has driven the research community to extend their capabilities to molecular applications. However, most molecular LLMs employ adapter-based architectures that do…

Computation and Language · Computer Science 2025-06-24 Shuhan Guo , Yatao Bian , Ruibing Wang , Nan Yin , Zhen Wang , Quanming Yao

Molecule generation requires satisfying multiple chemical and biological constraints while searching a large and structured chemical space. This makes it a non-binary problem, where effective models must identify non-obvious solutions under…

Computation and Language · Computer Science 2026-04-21 Wen Tao , Yiwei Wang , Peng Zhou , Bryan Hooi , Wanlong Fang , Tianle Zhang , Xiao Luo , Yuansheng Liu , Alvin Chan

Current Large Language Models (LLMs) for understanding proteins primarily treats amino acid sequences as a text modality. Meanwhile, Protein Language Models (PLMs), such as ESM-2, have learned massive sequential evolutionary knowledge from…

Machine Learning · Computer Science 2024-12-17 Nuowei Liu , Changzhi Sun , Tao Ji , Junfeng Tian , Jianxin Tang , Yuanbin Wu , Man Lan

Large language models applied to vast biological datasets have the potential to transform biology by uncovering disease mechanisms and accelerating drug development. However, current models are often siloed, trained separately on…

Molecule design is a multifaceted approach that leverages computational methods and experiments to optimize molecular properties, fast-tracking new drug discoveries, innovative material development, and more efficient chemical processes.…

Computation and Language · Computer Science 2024-08-23 Sakhinana Sagar Srinivas , Venkataramana Runkana

AI for drug discovery has been a research hotspot in recent years, and SMILES-based language models has been increasingly applied in drug molecular design. However, no work has explored whether and how language models understand the…

Machine Learning · Computer Science 2024-01-17 Xiuyuan Hu , Guoqing Liu , Yang Zhao , Hao Zhang

Predicting molecular properties is a critical component of drug discovery. Recent advances in deep learning, particularly Graph Neural Networks (GNNs), have enabled end-to-end learning from molecular structures, reducing reliance on manual…

Computation and Language · Computer Science 2025-09-26 Peng Zhou , Lai Hou Tim , Zhixiang Cheng , Kun Xie , Chaoyi Li , Wei Liu , Xiangxiang Zeng

Automated Machine Learning (AutoML) offers a promising approach to streamline the training of machine learning models. However, existing AutoML frameworks are often limited to unimodal scenarios and require extensive manual configuration.…

Machine Learning · Computer Science 2024-08-02 Daqin Luo , Chengjian Feng , Yuxuan Nong , Yiqing Shen

Recently, Large Language Models (LLMs) have achieved significant success, prompting increased interest in expanding their generative capabilities beyond general text into domain-specific areas. This study investigates the generation of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Jiahao Li , Weijian Ma , Xueyang Li , Yunzhong Lou , Guichun Zhou , Xiangdong Zhou

Understanding biological processes, drug development, and biotechnological advancements requires a detailed analysis of protein structures and functions, a task that is inherently complex and time-consuming in traditional protein research.…

Artificial Intelligence · Computer Science 2025-04-21 Yijia Xiao , Edward Sun , Yiqiao Jin , Qifan Wang , Wei Wang

Protein-ligand scoring is a central component of structure-based drug design, underpinning molecular docking, virtual screening, and pose optimization. Conventional physics-based energy functions are often computationally expensive,…

Biomolecules · Quantitative Biology 2026-02-24 Zhangfan Yang , Baoyun Chen , Dong Xu , Jia Wang , Ruibin Bai , Junkai Ji , Zexuan Zhu

Large Language Models (LLMs) have demonstrated exceptional proficiency in text understanding and embedding tasks. However, their potential in multimodal representation, particularly for item-to-item (I2I) recommendations, remains…

Information Retrieval · Computer Science 2025-01-22 Chao Zhang , Haoxin Zhang , Shiwei Wu , Di Wu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

Three-dimensional molecular structure generation is typically performed at the level of individual atoms, yet molecular graph generation techniques often consider fragments as their structural units. Building on the advances in frame-based…

Machine Learning · Computer Science 2026-01-26 Roman Poletukhin , Marcel Kollovieh , Eike Eberhard , Stephan Günnemann

Discovering materials with desirable properties in an efficient way remains a significant problem in materials science. Many studies have tackled this problem by using different sets of information available about the materials. Among them,…

Materials Science · Physics 2025-03-04 Onur Boyar , Indra Priyadarsini , Seiji Takeda , Lisa Hamada

Recent 3D Large-Language Models (3D-LLMs) claim to understand 3D worlds, especially spatial relationships among objects. Yet, we find that simply fine-tuning a language model on text-only question-answer pairs can perform comparably or even…

Computation and Language · Computer Science 2026-03-26 Xianzheng Ma , Tao Sun , Shuai Chen , Yash Bhalgat , Jindong Gu , Angel X Chang , Iro Armeni , Iro Laina , Songyou Peng , Victor Adrian Prisacariu

The molecular simulations solve the equation of motion of molecular systems, making 3D shapes of molecules four-dimensional by adding the time coordinate. These methods have a great potential in drug discovery because they can realistically…

Biomolecules · Quantitative Biology 2023-01-19 Dalibor Trapl , Vojtěch Spiwok

Designing molecules with desirable physiochemical properties and functionalities is a long-standing challenge in chemistry, material science, and drug discovery. Recently, machine learning-based generative models have emerged as promising…

Biomolecules · Quantitative Biology 2023-04-26 Zaixi Zhang , Qi Liu , Chee-Kong Lee , Chang-Yu Hsieh , Enhong Chen

Deep Learning (DL) algorithms hold great promise for applications in the field of computational biophysics. In fact, the vast amount of available molecular structures, as well as their notable complexity, constitutes an ideal context in…

Soft Condensed Matter · Physics 2019-01-07 Marco Giulini , Raffaello Potestio