English
Related papers

Related papers: DMMRL: Disentangled Multi-Modal Representation Lea…

200 papers

Multimodal molecular representation learning, which jointly models molecular graphs and their textual descriptions, enhances predictive accuracy and interpretability by enabling more robust and reliable predictions of drug toxicity,…

Machine Learning · Computer Science 2025-10-21 Yingxu Wang , Kunyu Zhang , Jiaxin Huang , Nan Yin , Siwei Liu , Eran Segal

Multiple clustering has gathered significant attention in recent years due to its potential to reveal multiple hidden structures of the data from different perspectives. Most of multiple clustering methods first derive feature…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Jiawei Yao , Juhua Hu

Disentangled representation learning (DRL) aims to break down observed data into core intrinsic factors for a profound understanding of the data. In real-world scenarios, manually defining and labeling these factors are non-trivial, making…

Machine Learning · Computer Science 2024-11-01 Youngjun Jun , Jiwoo Park , Kyobin Choo , Tae Eun Choi , Seong Jae Hwang

Molecular representation learning (MRL) is a key step to build the connection between machine learning and chemical science. In particular, it encodes molecules as numerical vectors preserving the molecular structures and features, on top…

Quantitative Methods · Quantitative Biology 2023-11-30 Zhichun Guo , Kehan Guo , Bozhao Nan , Yijun Tian , Roshni G. Iyer , Yihong Ma , Olaf Wiest , Xiangliang Zhang , Wei Wang , Chuxu Zhang , Nitesh V. Chawla

Multimodal representation learning seeks to relate and decompose information inherent in multiple modalities. By disentangling modality-specific information from information that is shared across modalities, we can improve interpretability…

Machine Learning · Computer Science 2025-03-18 Chenyu Wang , Sharut Gupta , Xinyi Zhang , Sana Tonekaboni , Stefanie Jegelka , Tommi Jaakkola , Caroline Uhler

This paper presents a deep relational metric learning (DRML) framework for image clustering and retrieval. Most existing deep metric learning methods learn an embedding space with a general objective of increasing interclass distances and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Wenzhao Zheng , Borui Zhang , Jiwen Lu , Jie Zhou

As vast databases of chemical identities become increasingly available, the challenge shifts to how we effectively explore and leverage these resources to study molecular properties. This paper presents an active learning approach for…

Machine Learning · Computer Science 2025-07-17 Ayana Ghosh , Maxim Ziatdinov , Sergei V. Kalinin

Molecular Representation Learning (MRL) has proven impactful in numerous biochemical applications such as drug discovery and enzyme design. While Graph Neural Networks (GNNs) are effective at learning molecular representations from a 2D…

Ophthalmologists typically require multimodal data sources to improve diagnostic accuracy in clinical decisions. However, due to medical device shortages, low-quality data and data privacy concerns, missing data modalities are common in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Chengzhi Liu , Zile Huang , Zhe Chen , Feilong Tang , Yu Tian , Zhongxing Xu , Zihong Luo , Yalin Zheng , Yanda Meng

Chemical representation learning has gained increasing interest due to the limited availability of supervised data in fields such as drug and materials design. This interest particularly extends to chemical language representation learning,…

Chemical Physics · Physics 2024-08-06 Jun-Hyung Park , Yeachan Kim , Mingyu Lee , Hyuntae Park , SangKeun Lee

Large-scale pre-trained Vision-Language Models (VLMs) have become essential for transfer learning across diverse tasks. However, adapting these models with limited few-shot data often leads to overfitting, diminishing their performance on…

Machine Learning · Computer Science 2025-03-27 Yuncheng Guo , Xiaodong Gu

The quest for accurate prediction of drug molecule properties poses a fundamental challenge in the realm of Artificial Intelligence Drug Discovery (AIDD). An effective representation of drug molecules emerges as a pivotal component in this…

Machine Learning · Computer Science 2024-04-22 Zhuoyuan Wang , Jiacong Mi , Shan Lu , Jieyue He

Multimodal representation learning seeks to create a unified representation space by integrating diverse data modalities to improve multimodal understanding. Traditional methods often depend on pairwise contrastive learning, which relies on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Xiaohao Liu , Xiaobo Xia , See-Kiong Ng , Tat-Seng Chua

Disentangled representations enable models to separate factors of variation that are shared across experimental conditions from those that are condition-specific. This separation is essential in domains such as biomedical data analysis,…

Machine Learning · Computer Science 2025-12-16 Yuli Slavutsky , Ozgur Beker , David Blei , Bianca Dumitrascu

Disentangled representations have recently been shown to improve fairness, data efficiency and generalisation in simple supervised and reinforcement learning tasks. To extend the benefits of disentangled representations to more complex…

Molecular representation learning is pivotal in predicting molecular properties and advancing drug design. Traditional methodologies, which predominantly rely on homogeneous graph encoding, are limited by their inability to integrate…

Machine Learning · Computer Science 2025-03-24 Mukun Chen , Jia Wu , Shirui Pan , Fu Lin , Bo Du , Xiuwen Gong , Wenbin Hu

Multimodal representation is crucial for E-commerce tasks such as identical product retrieval. Large representation models (e.g., VLM2Vec) demonstrate strong multimodal understanding capabilities, yet they struggle with fine-grained…

Computation and Language · Computer Science 2026-04-23 Biao Zhang , Lixin Chen , Bin Zhang , Zongwei Wang , Tong Liu , Bo Zheng

How to effectively represent molecules is a long-standing challenge for molecular property prediction and drug discovery. This paper studies this problem and proposes to incorporate chemical domain knowledge, specifically related to…

Machine Learning · Computer Science 2023-05-04 Liang Zeng , Lanqing Li , Jian Li

Deep Metric Learning (DML) approaches learn to represent inputs to a lower-dimensional latent space such that the distance between representations in this space corresponds with a predefined notion of similarity. This paper investigates how…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Niall O' Mahony , Sean Campbell , Anderson Carvalho , Lenka Krpalkova , Gustavo Velasco-Hernandez , Daniel Riordan , Joseph Walsh

While representation learning aims to derive interpretable features for describing visual data, representation disentanglement further results in such features so that particular image attributes can be identified and manipulated. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Yen-Cheng Liu , Yu-Ying Yeh , Tzu-Chien Fu , Sheng-De Wang , Wei-Chen Chiu , Yu-Chiang Frank Wang