English
Related papers

Related papers: Advancing Molecular Graph-Text Pre-training via Fi…

200 papers

Recent advances in large language models (LLMs) have led to models that tackle diverse molecular tasks, such as chemical reaction prediction and molecular property prediction. Large-scale molecular instruction-tuning datasets have enabled…

Machine Learning · Computer Science 2025-05-27 Chanhui Lee , Hanbum Ko , Yuheon Song , YongJun Jeong , Rodrigo Hormazabal , Sehui Han , Kyunghoon Bae , Sungbin Lim , Sungwoong Kim

Graph generation techniques are increasingly being adopted for drug discovery. Previous graph generation approaches have utilized relatively small molecular building blocks such as atoms or simple cycles, limiting their effectiveness to…

Machine Learning · Computer Science 2020-04-21 Wengong Jin , Regina Barzilay , Tommi Jaakkola

Molecular Machine Learning (ML) bears promise for efficient molecule property prediction and drug discovery. However, labeled molecule data can be expensive and time-consuming to acquire. Due to the limited labeled data, it is a great…

Machine Learning · Computer Science 2022-04-01 Yuyang Wang , Jianren Wang , Zhonglin Cao , Amir Barati Farimani

Despite the success of foundation models in language and vision, molecular graph generation still lacks a unified framework for heterogeneous design tasks with reliable controllability. While reinforcement learning (RL) offers a natural…

Machine Learning · Computer Science 2026-05-18 Yihan Zhu , Yuhan Liu , Weijiang Li , Tengfei Luo , Meng Jiang

Contrastively trained vision-language models have achieved remarkable progress in vision and language representation learning, leading to state-of-the-art models for various downstream multimodal tasks. However, recent research has…

Computation and Language · Computer Science 2023-10-26 Harman Singh , Pengchuan Zhang , Qifan Wang , Mengjiao Wang , Wenhan Xiong , Jingfei Du , Yu Chen

Most machine learning models for molecular property prediction rely on a single molecular representation (either a sequence, a graph, or a 3D structure) and treat molecular geometry as static. We present MolFM-Lite, a multi-modal model that…

Pretrained Graph Neural Networks have been widely adopted for various molecular property prediction tasks. Despite their ability to encode structural and relational features of molecules, traditional fine-tuning of such pretrained GNNs on…

Machine Learning · Computer Science 2024-01-30 Vishal Dey , Xia Ning

Any entity in the visual world can be hierarchically grouped based on shared characteristics and mapped to fine-grained sub-categories. While Multi-modal Large Language Models (MLLMs) achieve strong performance on coarse-grained visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Hulingxiao He , Zijun Geng , Yuxin Peng

The prediction of molecular properties is a crucial task in the field of material and drug discovery. The potential benefits of using deep learning techniques are reflected in the wealth of recent literature. Still, these techniques are…

Machine Learning · Computer Science 2023-09-06 Minghao Guo , Veronika Thost , Samuel W Song , Adithya Balachandran , Payel Das , Jie Chen , Wojciech Matusik

Image-text retrieval, as a fundamental and important branch of information retrieval, has attracted extensive research attentions. The main challenge of this task is cross-modal semantic understanding and matching. Some recent works focus…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Weijing Chen , Linli Yao , Qin Jin

Enhancing accurate molecular property prediction relies on effective and proficient representation learning. It is crucial to incorporate diverse molecular relationships characterized by multi-similarity (self-similarity and relative…

Machine Learning · Computer Science 2024-02-05 Hao Xu , Zhengyang Zhou , Pengyu Hong

Scene text instances found in natural images carry explicit semantic information that can provide important cues to solve a wide array of computer vision problems. In this paper, we focus on leveraging multi-modal content in the form of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Andres Mafla , Sounak Dey , Ali Furkan Biten , Lluis Gomez , Dimosthenis Karatzas

The limited availability of annotations in small molecule datasets presents a challenge to machine learning models. To address this, one common strategy is to collaborate with additional auxiliary datasets. However, having more data does…

Biomolecules · Quantitative Biology 2023-11-10 Tinglin Huang , Ziniu Hu , Rex Ying

Molecular representation learning plays a crucial role in advancing applications such as drug discovery and material design. Existing work leverages 2D and 3D modalities of molecular information for pre-training, aiming to capture…

Machine Learning · Computer Science 2025-10-09 Tengwei Song , Min Wu , Yuan Fang

Automated knowledge discovery from trending chemical literature is essential for more efficient biomedical research. How to extract detailed knowledge about chemical reactions from the core chemistry literature is a new emerging challenge…

Computation and Language · Computer Science 2021-08-31 Chenkai Sun , Weijiang Li , Jinfeng Xiao , Nikolaus Nova Parulian , ChengXiang Zhai , Heng Ji

In the majority of molecular optimization tasks, predictive machine learning (ML) models are limited due to the unavailability and cost of generating big experimental datasets on the specific task. To circumvent this limitation, ML models…

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

Recently, semantic segmentation models trained with image-level text supervision have shown promising results in challenging open-world scenarios. However, these models still face difficulties in learning fine-grained semantic alignment at…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Kaixin Cai , Pengzhen Ren , Yi Zhu , Hang Xu , Jianzhuang Liu , Changlin Li , Guangrun Wang , Xiaodan Liang

Masked graph modeling excels in the self-supervised representation learning of molecular graphs. Scrutinizing previous studies, we can reveal a common scheme consisting of three key components: (1) graph tokenizer, which breaks a molecular…

Machine Learning · Computer Science 2024-01-17 Zhiyuan Liu , Yaorui Shi , An Zhang , Enzhi Zhang , Kenji Kawaguchi , Xiang Wang , Tat-Seng Chua

Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, the inherent…

Machine Learning · Computer Science 2024-09-16 Xiaohua Lu , Liangxu Xie , Lei Xu , Rongzhi Mao , Shan Chang , Xiaojun Xu