English
Related papers

Related papers: Multi-Modal Molecular Representation Learning via …

200 papers

Computational food analysis (CFA) naturally requires multi-modal evidence of a particular food, e.g., images, recipe text, etc. A key to making CFA possible is multi-modal shared representation learning, which aims to create a joint…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Ricardo Guerrero , Hai Xuan Pham , Vladimir Pavlovic

Histopathology and transcriptomics are fundamental modalities in oncology, encapsulating the morphological and molecular aspects of the disease. Multi-modal self-supervised learning has demonstrated remarkable potential in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tianyi Wang , Jianan Fan , Dingxin Zhang , Dongnan Liu , Yong Xia , Heng Huang , Weidong Cai

The rise of Multi-modal Pre-training highlights the necessity for a unified Multi-Modal Knowledge Graph (MMKG) representation learning framework. Such a framework is essential for embedding structured knowledge into multi-modal Large…

Computation and Language · Computer Science 2025-01-16 Zhuo Chen , Yin Fang , Yichi Zhang , Lingbing Guo , Jiaoyan Chen , Jeff Z. Pan , Huajun Chen , Wen Zhang

Deep learning methods for material property prediction have been widely explored to advance materials discovery. However, the prevailing pre-train then fine-tune paradigm often fails to address the inherent diversity and disparity of…

Learning medical visual representations directly from paired radiology reports has become an emerging topic in representation learning. However, existing medical image-text joint learning methods are limited by instance or local supervision…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Fuying Wang , Yuyin Zhou , Shujun Wang , Varut Vardhanabhuti , Lequan Yu

Establishing the relationship between 3D structures and the energy states of molecular systems has proven to be a promising approach for learning 3D molecular representations. However, existing methods are limited to modeling the molecular…

Machine Learning · Computer Science 2025-02-27 Liang Wang , Shaozhen Liu , Yu Rong , Deli Zhao , Qiang Liu , Shu Wu , Liang Wang

Unsupervised pre-training has shown great success in skeleton-based action understanding recently. Existing works typically train separate modality-specific models, then integrate the multi-modal information for action understanding by a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Shengkai Sun , Daizong Liu , Jianfeng Dong , Xiaoye Qu , Junyu Gao , Xun Yang , Xun Wang , Meng Wang

Multimodal sentiment analysis (MSA) identifies individuals' sentiment states in videos by integrating visual, audio, and text modalities. Despite progress in existing methods, the inherent modality heterogeneity limits the effective capture…

Machine Learning · Computer Science 2025-12-19 Shanmin Wang , Chengguang Liu , Qingshan Liu

Virtual screening can accelerate drug discovery by identifying promising candidates for experimental evaluation. Machine learning is a powerful method for screening, as it can learn complex structure-property relationships from experimental…

Machine Learning · Computer Science 2021-02-22 Simon Axelrod , Rafael Gomez-Bombarelli

While deep generative models show promise for learning inverse protein folding directly from data, the lack of publicly available structure-sequence pairings limits their generalization. Previous improvements and data augmentation efforts…

Artificial Intelligence · Computer Science 2024-07-23 Jiangbin Zheng , Stan Z. Li

Multi-modal learning aims to enhance performance by unifying models from various modalities but often faces the "modality imbalance" problem in real data, leading to a bias towards dominant modalities and neglecting others, thereby limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yang Yang , Hongpeng Pan , Qing-Yuan Jiang , Yi Xu , Jinghui Tang

Accurate prediction of molecular properties in complex chemical systems is crucial for accelerating material discovery and chemical innovation. However, current computational methods often struggle to capture the intricate compositional…

Chemical Physics · Physics 2025-09-24 Jinming Fan , Chao Qian , Shaodong Zhou

Multimodal Sentiment Analysis is an active area of research that leverages multimodal signals for affective understanding of user-generated videos. The predominant approach, addressing this task, has been to develop sophisticated fusion…

Computation and Language · Computer Science 2020-10-20 Devamanyu Hazarika , Roger Zimmermann , Soujanya Poria

Reliable molecular property prediction is essential for various scientific endeavors and industrial applications, such as drug discovery. However, the data scarcity, combined with the highly non-linear causal relationships between…

Machine Learning · Computer Science 2025-01-14 Yue Wan , Jialu Wu , Tingjun Hou , Chang-Yu Hsieh , Xiaowei Jia

Spectroscopic techniques are essential tools for determining the structure of molecules. Different spectroscopic techniques, such as Nuclear magnetic resonance (NMR), Infrared spectroscopy, and Mass Spectrometry, provide insight into the…

Chemical Physics · Physics 2024-10-30 Marvin Alberts , Oliver Schilter , Federico Zipoli , Nina Hartrampf , Teodoro Laino

Molecular representation learning has attracted much attention recently. A molecule can be viewed as a 2D graph with nodes/atoms connected by edges/bonds, and can also be represented by a 3D conformation with 3-dimensional coordinates of…

Machine Learning · Computer Science 2022-07-20 Jinhua Zhu , Yingce Xia , Lijun Wu , Shufang Xie , Tao Qin , Wengang Zhou , Houqiang Li , Tie-Yan Liu

Representation Learning is a significant and challenging task in multimodal learning. Effective modality representations should contain two parts of characteristics: the consistency and the difference. Due to the unified multimodal…

Computation and Language · Computer Science 2021-02-10 Wenmeng Yu , Hua Xu , Ziqi Yuan , Jiele Wu

Representation learning for images has been advanced by recent progress in more complex neural models such as the Vision Transformers and new learning theories such as the structural causal models. However, these models mainly rely on the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Zitan Chen , Zhuang Qi , Xiao Cao , Xiangxian Li , Xiangxu Meng , Lei Meng

Multi-modal semantic segmentation (MMSS) faces significant challenges in real-world applications due to incomplete, degraded, or missing sensor data. While current MMSS methods typically use self-distillation with modality dropout to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jiaqi Tan , Xu Zheng , Yang Liu

Graph neural networks (GNNs) demonstrate great performance in compound property and activity prediction due to their capability to efficiently learn complex molecular graph structures. However, two main limitations persist including…

Biomolecules · Quantitative Biology 2023-10-10 Apakorn Kengkanna , Masahito Ohue