English
Related papers

Related papers: Rep3Net: An Approach Exploiting Multimodal Represe…

200 papers

The core of molecular dynamics simulation fundamentally lies in the interatomic potential. Traditional empirical potentials lack accuracy, while first-principles methods are computationally prohibitive. Machine learning interatomic…

Machine Learning · Computer Science 2026-03-25 Shuyu Bi , Zhede Zhao , Qiangchao Sun , Tao Hu , Xionggang Lu , Hongwei Cheng

Recent advancements in computational chemistry have leveraged the power of trans-former-based language models, such as MoLFormer, pre-trained using a vast amount of simplified molecular-input line-entry system (SMILES) sequences, to…

Biomolecules · Quantitative Biology 2024-11-05 Tianhao Peng , Yuchen Li , Xuhong Li , Jiang Bian , Zeke Xie , Ning Sui , Shahid Mumtaz , Yanwu Xu , Linghe Kong , Haoyi Xiong

Accurate prediction of molecular properties is essential in drug discovery and related fields. However, existing graph neural networks (GNNs) often struggle to simultaneously capture both local and global molecular structures. In this work,…

Machine Learning · Computer Science 2025-08-26 XiaYu Liu , Chao Fan , Yang Liu , Hou-biao Li

The prediction of physicochemical properties from molecular structures is a crucial task for artificial intelligence aided molecular design. A growing number of Graph Neural Networks (GNNs) have been proposed to address this challenge.…

Machine Learning · Computer Science 2020-11-17 Shuo Zhang , Yang Liu , Lei Xie

Molecular representation learning is fundamental for many drug related applications. Most existing molecular pre-training models are limited in using single molecular modality, either SMILES or graph representation. To effectively leverage…

Machine Learning · Computer Science 2024-11-05 Shikun Feng , Lixin Yang , Yanwen Huang , Yuyan Ni , Weiying Ma , Yanyan Lan

Geometric graph neural networks (GNNs) have emerged as powerful tools for modeling molecular geometry. However, they encounter limitations in effectively capturing long-range interactions in large molecular systems. To address this…

Machine Learning · Computer Science 2024-09-27 Yusong Wang , Chaoran Cheng , Shaoning Li , Yuxuan Ren , Bin Shao , Ge Liu , Pheng-Ann Heng , Nanning Zheng

Modern recommender systems face critical challenges in handling information overload while addressing the inherent limitations of multimodal representation learning. Existing methods suffer from three fundamental limitations: (1) restricted…

Information Retrieval · Computer Science 2025-08-15 Zheyu Chen , Jinfeng Xu , Hewei Wang , Shuo Yang , Zitong Wan , Haibo Hu

Multimodal entity linking (MEL) aims to link ambiguous mentions within multimodal contexts to corresponding entities in a multimodal knowledge base. Most existing approaches to MEL are based on representation learning or vision-and-language…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhiwei Hu , Víctor Gutiérrez-Basulto , Ru Li , Jeff Z. Pan

We apply a Transformer architecture, specifically BERT, to learn flexible and high quality molecular representations for drug discovery problems. We study the impact of using different combinations of self-supervised tasks for pre-training,…

Machine Learning · Computer Science 2020-11-30 Benedek Fabian , Thomas Edlich , Héléna Gaspar , Marwin Segler , Joshua Meyers , Marco Fiscato , Mohamed Ahmed

Tasks that rely on multi-modal information typically include a fusion module that combines information from different modalities. In this work, we develop a Refiner Fusion Network (ReFNet) that enables fusion modules to combine strong…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Sethuraman Sankaran , David Yang , Ser-Nam Lim

The study of molecule-target interaction is quite important for drug discovery in terms of target identification, hit identification, pathway study, drug-drug interaction, etc. Most existing methodologies utilize either biomedical network…

Machine Learning · Computer Science 2023-02-07 Jinjiang Guo , Jie Li

Peptides are essential in biological processes and therapeutics. In this study, we introduce Multi-Peptide, an innovative approach that combines transformer-based language models with Graph Neural Networks (GNNs) to predict peptide…

Quantitative Methods · Quantitative Biology 2024-07-08 Srivathsan Badrinarayanan , Chakradhar Guntuboina , Parisa Mollaei , Amir Barati Farimani

Molecular property prediction is crucial for drug discovery and materials science, yet existing approaches suffer from limited interpretability, poor cross-task generalization, and lack of chemical reasoning capabilities. Traditional…

Machine Learning · Computer Science 2025-10-20 Jiaxi Zhuang , Yaorui Shi , Jue Hou , Yunong He , Mingwei Ye , Mingjun Xu , Yuming Su , Linfeng Zhang , Ying Qian , Linfeng Zhang , Guolin Ke , Hengxing Cai

The quest for accurate prediction of drug molecule properties poses a fundamental challenge in the realm of Artificial Intelligence Drug Discovery (AIDD). An effective representation of drug molecules emerges as a pivotal component in this…

Machine Learning · Computer Science 2024-04-22 Zhuoyuan Wang , Jiacong Mi , Shan Lu , Jieyue He

The early detection of a pulmonary embolism (PE) is critical for enhancing patient survival rates. Both image-based and non-image-based features are of utmost importance in medical classification tasks. In a clinical setting, physicians…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Zhaoxin Guo , Zhipeng Wang , Ruiquan Ge , Jianxun Yu , Feiwei Qin , Yuan Tian , Yuqing Peng , Yonghong Li , Changmiao Wang

Representing molecular structures effectively in chemistry remains a challenging task. Language models and graph-based models are extensively utilized within this domain, consistently achieving state-of-the-art results across an array of…

Machine Learning · Computer Science 2025-05-27 Nikolai Rekut , Alexey Orlov , Klea Ziu , Elizaveta Starykh , Martin Takac , Aleksandr Beznosikov

Recent research on predicting the binding affinity between drug molecules and proteins use representations learned, through unsupervised learning techniques, from large databases of molecule SMILES and protein sequences. While these…

Drug recommendation is an essential task in machine learning-based clinical decision support systems. However, the risk of drug-drug interactions (DDI) between co-prescribed medications remains a significant challenge. Previous studies have…

Machine Learning · Computer Science 2025-10-10 Chongmyung Kwon , Yujin Kim , Seoeun Park , Yunji Lee , Charmgil Hong

Copolymers are highly versatile materials with a vast range of possible chemical compositions. By using computational methods for property prediction, the design of copolymers can be accelerated, allowing for the prioritization of…

Materials Science · Physics 2025-09-16 Elaheh Kazemi-Khasragh , Rocío Mercado , Carlos Gonzalez , Maciej Haranczyk

Automated retinal image medical description generation is crucial for streamlining medical diagnosis and treatment planning. Existing challenges include the reliance on learned retinal image representations, difficulties in handling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Nagur Shareef Shaik , Teja Krishna Cherukuri , Dong Hye Ye