English
Related papers

Related papers: MolCAP: Molecular Chemical reActivity pretraining …

200 papers

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Zhe Li , Laurence T. Yang , Bocheng Ren , Xin Nie , Zhangyang Gao , Cheng Tan , Stan Z. Li

Molecular machine learning (ML) has proven important for tackling various molecular problems, such as predicting molecular properties based on molecular descriptors or fingerprints. Since relatively recently, graph neural network (GNN)…

Machine Learning · Computer Science 2023-09-06 Alexander Kensert , Gert Desmet , Deirdre Cabooter

We present a collaborative learning method called Mutual Contrastive Learning (MCL) for general visual representation learning. The core idea of MCL is to perform mutual interaction and transfer of contrastive distributions among a cohort…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Chuanguang Yang , Zhulin An , Linhang Cai , Yongjun Xu

Large Language Models (LLMs) encounter challenges with the unique syntax of specific domains, such as biomolecules. Existing fine-tuning or modality alignment techniques struggle to bridge the domain knowledge gap and understand complex…

Biomolecules · Quantitative Biology 2024-06-28 Jinzhe Liu , Xiangsheng Huang , Zhuo Chen , Yin Fang

Deep learning has achieved remarkable success in learning representations for molecules, which is crucial for various biochemical applications, ranging from property prediction to drug design. However, training Deep Neural Networks (DNNs)…

Machine Learning · Computer Science 2023-04-28 Jun Xia , Yanqiao Zhu , Yuanqi Du , Stan Z. Li

The versatility of multimodal deep learning holds tremendous promise for advancing scientific research and practical applications. As this field continues to evolve, the collective power of cross-modal analysis promises to drive…

Machine Learning · Computer Science 2025-05-15 Yifei Wang , Yunrui Li , Lin Liu , Pengyu Hong , Hao Xu

Deep learning is changing many areas in molecular physics, and it has shown great potential to deliver new solutions to challenging molecular modeling problems. Along with this trend arises the increasing demand of expressive and versatile…

Machine Learning · Computer Science 2023-12-27 Jun Zhang , Yao-Kun Lei , Yaqiang Zhou , Yi Isaac Yang , Yi Qin Gao

Molecular representation learning plays a crucial role in AI-assisted drug discovery research. Encoding 3D molecular structures through Euclidean neural networks has become the prevailing method in the geometric deep learning community.…

Machine Learning · Computer Science 2023-03-29 Yiqun Wang , Yuning Shen , Shi Chen , Lihao Wang , Fei Ye , Hao Zhou

This work considers the task of representation learning on the attributed relational graph (ARG). Both the nodes and edges in an ARG are associated with attributes/features allowing ARGs to encode rich structural information widely observed…

Machine Learning · Computer Science 2022-08-10 Yifei Wang , Shiyang Chen , Guobin Chen , Ethan Shurberg , Hang Liu , Pengyu Hong

Graph Neural Networks (GNNs) have been widely employed for feature representation learning in molecular graphs. Therefore, it is crucial to enhance the expressiveness of feature representation to ensure the effectiveness of GNNs. However, a…

Machine Learning · Computer Science 2024-09-16 Chengyu Yao , Hong Huang , Hang Gao , Fengge Wu , Haiming Chen , Junsuo Zhao

Protein representation learning is critical in various tasks in biology, such as drug design and protein structure or function prediction, which has primarily benefited from protein language models and graph neural networks. These models…

Biomolecules · Quantitative Biology 2024-02-16 Bozhen Hu , Zelin Zang , Cheng Tan , Stan Z. Li

Predicting drug side-effects before they occur is a key task in keeping the number of drug-related hospitalizations low and to improve drug discovery processes. Automatic predictors of side-effects generally are not able to process the…

Machine Learning · Statistics 2022-12-01 Pietro Bongini , Elisa Messori , Niccolò Pancino , Monica Bianchini

Machine learning has the potential to automate molecular design and drastically accelerate the discovery of new functional compounds. Towards this goal, generative models and reinforcement learning (RL) using string and graph…

Machine Learning · Computer Science 2022-02-02 Daniel Flam-Shepherd , Alexander Zhigalin , Alán Aspuru-Guzik

Models based on machine learning can enable accurate and fast molecular property predictions, which is of interest in drug discovery and material design. Various supervised machine learning models have demonstrated promising performance,…

Machine Learning · Computer Science 2022-12-15 Jerret Ross , Brian Belgodere , Vijil Chenthamarakshan , Inkit Padhi , Youssef Mroueh , Payel Das

Optimizing techniques for discovering molecular structures with desired properties is crucial in artificial intelligence(AI)-based drug discovery. Combining deep generative models with reinforcement learning has emerged as an effective…

Machine Learning · Computer Science 2024-04-01 Jinyeong Park , Jaegyoon Ahn , Jonghwan Choi , Jibum Kim

Molecular activity prediction is critical in drug design. Machine learning techniques such as kernel methods and random forests have been successful for this task. These models require fixed-size feature vectors as input while the molecules…

Machine Learning · Computer Science 2018-01-30 Trang Pham , Truyen Tran , Svetha Venkatesh

Large Language Models (LLMs), with their remarkable task-handling capabilities and innovative outputs, have catalyzed significant advancements across a spectrum of fields. However, their proficiency within specialized domains such as…

Quantitative Methods · Quantitative Biology 2024-03-05 Yin Fang , Xiaozhuan Liang , Ningyu Zhang , Kangwei Liu , Rui Huang , Zhuo Chen , Xiaohui Fan , Huajun Chen

The prediction of physicochemical properties from molecular structures is a crucial task for artificial intelligence aided molecular design. A growing number of Graph Neural Networks (GNNs) have been proposed to address this challenge.…

Machine Learning · Computer Science 2020-11-17 Shuo Zhang , Yang Liu , Lei Xie

Lead optimization in drug discovery requires improving therapeutic properties while ensuring that molecular modifications correspond to feasible synthetic routes. Existing approaches either prioritize property scores without enforcing…

Machine Learning · Computer Science 2026-05-04 Tao Li , Kaiyuan Hou , Tuan Vinh , Monika Raj , Zhichun Guo , Carl Yang

CLIP (Contrastive Language-Image Pre-training) uses contrastive learning from noise image-text pairs to excel at recognizing a wide array of candidates, yet its focus on broad associations hinders the precision in distinguishing subtle…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Ziyu Liu , Zeyi Sun , Yuhang Zang , Wei Li , Pan Zhang , Xiaoyi Dong , Yuanjun Xiong , Dahua Lin , Jiaqi Wang