English
Related papers

Related papers: Molecule Joint Auto-Encoding: Trajectory Pretraini…

200 papers

The three-dimensional shape and conformation of small-molecule ligands are critical for biomolecular recognition, yet encoding 3D geometry has not improved ligand-based virtual screening approaches. We describe an end-to-end deep learning…

Machine Learning · Computer Science 2020-12-01 Kangway V. Chuang , Michael J. Keiser

Multimodal molecular representation learning, which jointly models molecular graphs and their textual descriptions, enhances predictive accuracy and interpretability by enabling more robust and reliable predictions of drug toxicity,…

Machine Learning · Computer Science 2025-10-21 Yingxu Wang , Kunyu Zhang , Jiaxin Huang , Nan Yin , Siwei Liu , Eran Segal

Pre-training by numerous image data has become de-facto for robust 2D representations. In contrast, due to the expensive data acquisition and annotation, a paucity of large-scale 3D datasets severely hinders the learning for high-quality 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Renrui Zhang , Liuhui Wang , Yu Qiao , Peng Gao , Hongsheng Li

Masked Graph Auto-Encoder, a powerful graph self-supervised training paradigm, has recently shown superior performance in graph representation learning. Existing works typically rely on node contextual information to recover the masked…

Machine Learning · Computer Science 2025-08-15 Ziyu Zheng , Yaming Yang , Ziyu Guan , Wei Zhao , Weigang Lu

Traditional drug discovery programs are being transformed by the advent of machine learning methods. Among these, Generative AI methods (GM) have gained attention due to their ability to design new molecules and enhance specific properties…

Based on the traditional VAE, a novel neural network model is presented, with the latest molecular representation, SELFIES, to improve the effect of generating new molecules. In this model, multi-layer convolutional network and Fisher…

Biomolecules · Quantitative Biology 2023-05-03 Li Kai , Li Ning , Zhang Wei , Gao Ming

Self-supervised pre-training for images without labels has recently achieved promising performance in image classification. The success of transformer-based methods, ViT and MAE, draws the community's attention to the design of backbone…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Jiantao Wu , Shentong Mo

Generating molecules with high binding affinities to target proteins (a.k.a. structure-based drug design) is a fundamental and challenging task in drug discovery. Recently, deep generative models have achieved remarkable success in…

Biomolecules · Quantitative Biology 2023-05-24 Zaixi Zhang , Qi Liu

De novo molecule generation allows the search for more drug-like hits across a vast chemical space. However, lead optimization is still required, and the process of optimizing molecular structures faces the challenge of balancing structural…

Machine Learning · Computer Science 2026-05-12 Jiebin Fang , Churu Mao , Yuchen Zhu , Xiaoming Chen , Chang-Yu Hsieh , Zhongjun Ma

Regularized autoencoders learn the latent codes, a structure with the regularization under the distribution, which enables them the capability to infer the latent codes given observations and generate new samples given the codes. However,…

Machine Learning · Computer Science 2019-02-18 Wenju Xu , Shawn Keshmiri , Guanghui Wang

Accurate molecular property predictions require 3D geometries, which are typically obtained using expensive methods such as density functional theory (DFT). Here, we attempt to obtain molecular geometries by relying solely on machine…

Inspired by recent advances in diffusion models, which are reminiscent of denoising autoencoders, we investigate whether they can acquire discriminative representations for classification via generative pre-training. This paper shows that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Weilai Xiang , Hongyu Yang , Di Huang , Yunhong Wang

Modeling the relationship between chemical structure and molecular activity is a key goal in drug development. Many benchmark tasks have been proposed for molecular property prediction, but these tasks are generally aimed at specific,…

Quantitative Methods · Quantitative Biology 2020-10-05 Samuel G. Finlayson , Matthew B. A. McDermott , Alex V. Pickering , Scott L. Lipnick , Isaac S. Kohane

Mask-based pretraining has become a cornerstone of modern large-scale models across language, vision, and recently biology. Despite its empirical success, its role and limits in learning data representations have been unclear. In this work,…

Machine Learning · Computer Science 2025-09-29 Mingze Dong , Leda Wang , Yuval Kluger

Predicting the interaction between a compound and a target is crucial for rapid drug repurposing. Deep learning has been successfully applied in drug-target affinity (DTA) problem. However, previous deep learning-based methods ignore…

Machine Learning · Computer Science 2020-09-29 Tri Minh Nguyen , Thin Nguyen , Thao Minh Le , Truyen Tran

Recently, self-supervised pre-training has advanced Vision Transformers on various tasks w.r.t. different data modalities, e.g., image and 3D point cloud data. In this paper, we explore this learning paradigm for 3D mesh data analysis based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yaqian Liang , Shanshan Zhao , Baosheng Yu , Jing Zhang , Fazhi He

Molecular representation learning plays a crucial role in AI-assisted drug discovery research. Encoding 3D molecular structures through Euclidean neural networks has become the prevailing method in the geometric deep learning community.…

Machine Learning · Computer Science 2023-03-29 Yiqun Wang , Yuning Shen , Shi Chen , Lihao Wang , Fei Ye , Hao Zhou

Masked Autoencoder (MAE) has demonstrated superior performance on various vision tasks via randomly masking image patches and reconstruction. However, effective data augmentation strategies for MAE still remain open questions, different…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Kai Chen , Zhili Liu , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung

We present two deep generative models based on Variational Autoencoders to improve the accuracy of drug response prediction. Our models, Perturbation Variational Autoencoder and its semi-supervised extension, Drug Response Variational…

Machine Learning · Statistics 2017-07-07 Ladislav Rampasek , Daniel Hidru , Petr Smirnov , Benjamin Haibe-Kains , Anna Goldenberg

Drug combination therapy is a well-established strategy for disease treatment with better effectiveness and less safety degradation. However, identifying novel drug combinations through wet-lab experiments is resource intensive due to the…

Machine Learning · Computer Science 2023-01-18 Zhihang Hu , Qinze Yu , Yucheng Guo , Taifeng Wang , Irwin King , Xin Gao , Le Song , Yu Li