English
Related papers

Related papers: MolFM: A Multimodal Molecular Foundation Model

200 papers

Knowledge retrieval with multi-modal queries plays a crucial role in supporting knowledge-intensive multi-modal applications. However, existing methods face challenges in terms of their effectiveness and training efficiency, especially when…

Information Retrieval · Computer Science 2024-01-17 Xinwei Long , Jiali Zeng , Fandong Meng , Zhiyuan Ma , Kaiyan Zhang , Bowen Zhou , Jie Zhou

Molecular representation learning has attracted much attention recently. A molecule can be viewed as a 2D graph with nodes/atoms connected by edges/bonds, and can also be represented by a 3D conformation with 3-dimensional coordinates of…

Machine Learning · Computer Science 2022-07-20 Jinhua Zhu , Yingce Xia , Lijun Wu , Shufang Xie , Tao Qin , Wengang Zhou , Houqiang Li , Tie-Yan Liu

Global machine learning force fields (MLFFs), that have the capacity to capture collective many-atom interactions in molecular systems, currently only scale up to a few dozen atoms due a considerable growth of the model complexity with…

Molecular property prediction, crucial for early drug candidate screening and optimization, has seen advancements with deep learning-based methods. While deep learning-based methods have advanced considerably, they often fall short in fully…

Biomolecules · Quantitative Biology 2024-07-01 Taojie Kuang , Yiming Ren , Zhixiang Ren

Recent advances in natural language processing (NLP) owe their success to pre-training language models on large amounts of unstructured data. Still, there is an increasing effort to combine the unstructured nature of LMs with structured…

Computation and Language · Computer Science 2023-12-22 Juraj Vladika , Alexander Fichtl , Florian Matthes

We present BioLangFusion, a simple approach for integrating pre-trained DNA, mRNA, and protein language models into unified molecular representations. Motivated by the central dogma of molecular biology (information flow from gene to…

Machine Learning · Computer Science 2025-06-11 Amina Mollaysa , Artem Moskale , Pushpak Pati , Tommaso Mansi , Mangal Prakash , Rui Liao

This paper presents a groundbreaking multimodal, multi-task, multi-teacher joint-grained knowledge distillation model for visually-rich form document understanding. The model is designed to leverage insights from both fine-grained and…

Computation and Language · Computer Science 2024-07-29 Yihao Ding , Lorenzo Vaiani , Caren Han , Jean Lee , Paolo Garza , Josiah Poon , Luca Cagliero

Biomedical knowledge graphs are increasingly large, dynamic, and multimodal, driven by rapid advances in biotechnology such as high-throughput sequencing. Machine learning models can infer previously unobserved biomedical relationships and…

Machine Learning · Computer Science 2026-05-12 Yousef A. Radwan , Yao Li , Qing Qing , Ziqi Xu , Qixin Zhang , Yongcheng Jing , Renqiang Luo , Xikun Zhang

We introduce MolMiner, a fragment-based, geometry-aware, and order-agnostic autoregressive model for molecular design. MolMiner supports conditional generation of molecules over twelve properties, enabling flexible control across…

Machine Learning · Computer Science 2025-05-27 Raul Ortega-Ochoa , Tejs Vegge , Jes Frellsen

There are many ways to represent a molecule as input to a machine learning model and each is associated with loss and retention of certain kinds of information. In the interest of preserving three-dimensional spatial information, including…

Machine Learning · Computer Science 2019-12-11 Jocelyn Sunseri , David Ryan Koes

Humans possess the capability to comprehend diverse modalities and seamlessly transfer information between them. In this work, we introduce ModaVerse, a Multi-modal Large Language Model (MLLM) capable of comprehending and transforming…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Xinyu Wang , Bohan Zhuang , Qi Wu

Generating molecular graphs with desired chemical properties driven by deep graph generative models provides a very promising way to accelerate drug discovery process. Such graph generative models usually consist of two steps: learning…

Machine Learning · Statistics 2020-06-19 Chengxi Zang , Fei Wang

Natural products, as metabolites from microorganisms, animals, or plants, exhibit diverse biological activities, making them crucial for drug discovery. Nowadays, existing deep learning methods for natural products research primarily rely…

Quantitative Methods · Quantitative Biology 2026-05-11 Yuheng Ding , Bo Qiang , Shaoning Li , Yiran Zhou , Jie Yu , Qi Li , Cheng Shi , Liangren Zhang , Yusong Wang , Nanning Zheng , Zhenming Liu

Molecular representation learning (MRL) is a fundamental task for drug discovery. However, previous deep-learning (DL) methods focus excessively on learning robust inner-molecular representations by mask-dominated pretraining framework,…

Biomolecules · Quantitative Biology 2023-06-16 Yu Wang , JingJie Zhang , Junru Jin , Leyi Wei

Molecular dynamics (MD) is a powerful approach for modelling molecular systems, but it remains computationally intensive on spatial and time scales of many macromolecular systems of biological interest. To explore the opportunities offered…

Biomolecules · Quantitative Biology 2025-08-07 Mhd Hussein Murtada , Z. Faidon Brotzakis , Michele Vendruscolo

Molecule discovery is a pivotal research field, impacting everything from medicine to materials. Recently, Large Language Models (LLMs) have been widely adopted in molecular understanding and generation, serving as a bridge between the…

Computation and Language · Computer Science 2026-04-29 Jiatong Li , Yunqing Liu , Wei Liu , Jingdi Le , Di Zhang , Wenqi Fan , Dongzhan Zhou , Yuqiang Li , Qing Li

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Large Language Models (LLMs) have shown impressive performance across various domains, but their ability to perform molecular reasoning remains underexplored. Existing methods mostly rely on general-purpose prompting, which lacks…