中文
相关论文

相关论文: Multimodal Fusion with Relational Learning for Mol…

200 篇论文

Multimodal representation learning harmonizes distinct modalities by aligning them into a unified latent space. Recent research generalizes traditional cross-modal alignment to produce enhanced multimodal synergy but requires all modalities…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Xiaohao Liu , Xiaobo Xia , Jiaheng Wei , Shuo Yang , Xiu Su , See-Kiong Ng , Tat-Seng Chua

We present a multimodal deep learning (MDL) framework for predicting physical properties of a 10-dimensional acrylic polymer composite material by merging physical attributes and chemical data. Our MDL model comprises four modules,…

软凝聚态物质 · 物理学 2023-11-28 Shun Muroga , Yasuaki Miki , Kenji Hata

Molecular property prediction is essential in a variety of contemporary scientific fields, such as drug development and designing energy storage materials. Although there are many machine learning models available for this purpose, those…

机器学习 · 计算机科学 2025-06-03 Gihan Panapitiya , Peiyuan Gao , C Mark Maupin , Emily G Saldanha

Single-model systems often suffer from deficiencies in tasks such as speaker verification (SV) and image classification, relying heavily on partial prior knowledge during decision-making, resulting in suboptimal performance. Although…

机器学习 · 计算机科学 2024-04-25 Zuheng Kang , Yayun He , Jianzong Wang , Junqing Peng , Jing Xiao

Multimodal deep learning (MDL) has emerged as a transformative approach in computational pathology. By integrating complementary information from multiple data sources, MDL models have demonstrated superior predictive performance across…

定量方法 · 定量生物学 2025-11-17 Seth Alain Chang , Muhammad Mueez Amjad , Noorul Wahab , Ethar Alzaid , Nasir Rajpoot , Adam Shephard

Multimodal learning (MML) aims to jointly exploit the common priors of different modalities to compensate for their inherent limitations. However, existing MML methods often optimize a uniform objective for different modalities, leading to…

机器学习 · 计算机科学 2022-11-15 Yunfeng Fan , Wenchao Xu , Haozhao Wang , Junxiao Wang , Song Guo

Molecular graph neural networks (GNNs) often focus exclusively on XYZ-based geometric representations and thus overlook valuable chemical context available in public databases like PubChem. This work introduces a multimodal framework that…

机器学习 · 计算机科学 2025-05-20 Can Polat , Hasan Kurban , Erchin Serpedin , Mustafa Kurban

Molecular representation learning plays a crucial role in advancing applications such as drug discovery and material design. Existing work leverages 2D and 3D modalities of molecular information for pre-training, aiming to capture…

机器学习 · 计算机科学 2025-10-09 Tengwei Song , Min Wu , Yuan Fang

The rapid evolution of artificial intelligence in drug discovery encounters challenges with generalization and extensive training, yet Large Language Models (LLMs) offer promise in reshaping interactions with complex molecular data. Our…

生物大分子 · 定量生物学 2024-12-20 He Cao , Zijing Liu , Xingyu Lu , Yuan Yao , Yu Li

Morphological attributes from histopathological images and molecular profiles from genomic data are important information to drive diagnosis, prognosis, and therapy of cancers. By integrating these heterogeneous but complementary data, many…

机器学习 · 计算机科学 2022-02-28 Kaiwen Tan , Weixian Huang , Xiaofeng Liu , Jinlong Hu , Shoubin Dong

Multi-View Reinforcement Learning (MVRL) seeks to provide agents with multi-view observations, enabling them to perceive environment with greater effectiveness and precision. Recent advancements in MVRL focus on extracting latent…

机器学习 · 计算机科学 2025-09-23 Zeyu Wang , Yao-Hui Li , Xin Li , Hongyu Zang , Romain Laroche , Riashat Islam

Multimodal learning robust to missing modality has attracted increasing attention due to its practicality. Existing methods tend to address it by learning a common subspace representation for different modality combinations. However, we…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Shicai Wei , Yang Luo , Yuji Wang , Chunbo Luo

Accurate prediction of the physicochemical properties of molecular mixtures using graph neural networks remains a significant challenge, as it requires simultaneous embedding of intramolecular interactions while accounting for mixture…

化学物理 · 物理学 2026-03-04 Jinming Fan , Chao Qian , Wilhelm T. S. Huck , William E. Robinson , Shaodong Zhou

Multimodal Fusion Learning (MFL), leveraging disparate data from various imaging modalities (e.g., MRI, CT, SPECT), has shown great potential for addressing medical problems such as skin cancer and brain tumor prediction. However, existing…

计算机视觉与模式识别 · 计算机科学 2026-02-18 Joy Dhar , Nayyar Zaidi , Maryam Haghighat

Molecular property prediction is essential for drug discovery. In recent years, deep learning methods have been introduced to this area and achieved state-of-the-art performances. However, most of existing methods ignore the intrinsic…

生物大分子 · 定量生物学 2022-11-04 Yuancheng Sun , Yimeng Chen , Weizhi Ma , Wenhao Huang , Kang Liu , Zhiming Ma , Wei-Ying Ma , Yanyan Lan

Molecular representation is a critical element in our understanding of the physical world and the foundation for modern molecular machine learning. Previous molecular machine learning models have employed strings, fingerprints, global…

Capturing molecular knowledge with representation learning approaches holds significant potential in vast scientific fields such as chemistry and life science. An effective and generalizable molecular representation is expected to capture…

机器学习 · 计算机科学 2024-06-17 Yizhen Luo , Kai Yang , Massimo Hong , Xing Yi Liu , Zikun Nie , Hao Zhou , Zaiqing Nie

Molecular Relational Learning (MRL) aims to understand interactions between molecular pairs, playing a critical role in advancing biochemical research. With the recent development of large language models (LLMs), a growing number of studies…

机器学习 · 计算机科学 2025-06-03 Zhuo Chen , Yizhen Zheng , Huan Yee Koh , Hongxin Xiang , Linjiang Chen , Wenjie Du , Yang Wang

Molecular Representation Learning (MRL) has emerged as a powerful tool for drug and materials discovery in a variety of tasks such as virtual screening and inverse design. While there has been a surge of interest in advancing model-centric…

化学物理 · 物理学 2023-09-29 Dingshuo Chen , Yanqiao Zhu , Jieyu Zhang , Yuanqi Du , Zhixun Li , Qiang Liu , Shu Wu , Liang Wang

Contrastive learning have been widely used as pretext tasks for self-supervised pre-trained molecular representation learning models in AI-aided drug design and discovery. However, exiting methods that generate molecular views by…

生物大分子 · 定量生物学 2023-03-14 Ziqiao Zhang , Ailin Xie , Jihong Guan , Shuigeng Zhou