English
Related papers

Related papers: Multimodal Representation Learning using Adaptive …

200 papers

Adapting machine learning models to medical time series across different domains remains a challenge due to complex temporal dependencies and dynamic distribution shifts. Current approaches often focus on isolated feature representations,…

Machine Learning · Computer Science 2025-09-23 YongKyung Oh , Alex Bui

Understanding brain disorders is crucial for accurate clinical diagnosis and treatment. Recent advances in Multimodal Large Language Models (MLLMs) offer a promising approach to interpreting medical images with the support of text…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jing Zhang , Xiaowei Yu , Yanjun Lyu , Lu Zhang , Tong Chen , Chao Cao , Yan Zhuang , Minheng Chen , Tianming Liu , Dajiang Zhu

Heterogeneous graph pre-training (HGP) has demonstrated remarkable performance across various domains. However, the issue of heterophily in real-world heterogeneous graphs (HGs) has been largely overlooked. To bridge this research gap, we…

Machine Learning · Computer Science 2025-01-16 Haosen Wang , Chenglong Shi , Can Xu , Surong Yan , Pan Tang

Normative modelling is an emerging method for understanding the underlying heterogeneity within brain disorders like Alzheimer Disease (AD) by quantifying how each patient deviates from the expected normative pattern that has been learned…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Sayantan Kumar , Philip Payne , Aristeidis Sotiras

The deep learning technique has been shown to be effectively addressed several image analysis tasks in the computer-aided diagnosis scheme for mammography. The training of an efficacious deep learning model requires large data with diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Zheren Li , Zhiming Cui , Lichi Zhang , Sheng Wang , Chenjin Lei , Xi Ouyang , Dongdong Chen , Xiangyu Zhao , Yajia Gu , Zaiyi Liu , Chunling Liu , Dinggang Shen , Jie-Zhi Cheng

The Contrastive Language-Image Pre-training (CLIP) framework has become a widely used approach for multimodal representation learning, particularly in image-text retrieval and clustering. However, its efficacy is constrained by three key…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Tiancheng Gu , Kaicheng Yang , Ziyong Feng , Xingjun Wang , Yanzhao Zhang , Dingkun Long , Yingda Chen , Weidong Cai , Jiankang Deng

In recent years, deep learning models have been applied to neuroimaging data for early diagnosis of Alzheimer's disease (AD). Structural magnetic resonance imaging (sMRI) and positron emission tomography (PET) images provide structural and…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Yanteng Zhanga , Xiaohai He , Yi Hao Chan , Qizhi Teng , Jagath C. Rajapakse

Medical image interpretation using deep learning has shown promise but often requires extensive expert-annotated datasets. To reduce this annotation burden, we develop an Image-Graph Contrastive Learning framework that pairs chest X-rays…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Sameer Khanna , Daniel Michael , Marinka Zitnik , Pranav Rajpurkar

Recent advancements in Graph Contrastive Learning (GCL) have demonstrated remarkable effectiveness in improving graph representations. However, relying on predefined augmentations (e.g., node dropping, edge perturbation, attribute masking)…

Machine Learning · Computer Science 2025-02-27 Khaled Mohammed Saifuddin , Shihao Ji , Esra Akbas

Inspired by the impressive success of contrastive learning (CL), a variety of graph augmentation strategies have been employed to learn node representations in a self-supervised manner. Existing methods construct the contrastive samples by…

Machine Learning · Computer Science 2022-12-14 Peiyao Zhao , Yuangang Pan , Xin Li , Xu Chen , Ivor W. Tsang , Lejian Liao

Computational pathology models that use digitized histopathology whole-slide images have the potential to become a cost-effective and scalable alternative to molecular assays for the prediction of genomic biomarkers, a key task in precision…

Quantitative Methods · Quantitative Biology 2026-03-03 Ekaterina Redekop , Eric Zimmermann , Ava P Amini , Alex X Lu , Neil Tenenholtz , James Brian Hall , Lorin Crawford , Kristen A Severson

Autism spectrum disorder (ASD) is a complex neurodevelopmental condition characterized by atypical functional brain connectivity and subtle structural alterations. rs-fMRI has been widely used to identify disruptions in large-scale brain…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Ansar Rahman , Hassan Shojaee-Mend , Sepideh Hatamikia

Benefiting from the effectiveness of graph neural networks (GNNs) and contrastive learning, GNN-based contrastive learning has become mainstream for knowledge-aware recommendation. However, most existing contrastive learning-based methods…

Information Retrieval · Computer Science 2025-05-14 Shengyin Sun , Chen Ma

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

Multi-label image classification presents a challenging task in many domains, including computer vision and medical imaging. Recent advancements have introduced graph-based and transformer-based methods to improve performance and capture…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Ahmad Sajedi , Samir Khaki , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

We study self-supervised learning on graphs using contrastive methods. A general scheme of prior methods is to optimize two-view representations of input graphs. In many studies, a single graph-level representation is computed as one of the…

Machine Learning · Computer Science 2021-07-22 Xinyi Xu , Cheng Deng , Yaochen Xie , Shuiwang Ji

Causal structure learning has been a challenging task in the past decades and several mainstream approaches such as constraint- and score-based methods have been studied with theoretical guarantees. Recently, a new approach has transformed…

Machine Learning · Computer Science 2019-11-19 Ignavier Ng , Shengyu Zhu , Zhitang Chen , Zhuangyan Fang

Graph representation learning (a.k.a. network embedding) is a significant topic of network analysis, due to its effectiveness to support various graph inference tasks. In this paper, we study the representation learning with multiple…

Social and Information Networks · Computer Science 2023-05-17 Meng Qin

Multimodal emotion recognition in conversation (MERC) seeks to identify the speakers' emotions expressed in each utterance, offering significant potential across diverse fields. The challenge of MERC lies in balancing speaker modeling and…

Multimedia · Computer Science 2025-07-25 Zijian Yi , Ziming Zhao , Zhishu Shen , Tiehua Zhang

Multimodal imaging and correlative analysis typically require image alignment. Contrastive learning can generate representations of multimodal images, reducing the challenging task of multimodal image registration to a monomodal one.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Elisabeth Wetzer , Joakim Lindblad , Nataša Sladoje