English
Related papers

Related papers: IDRL: An Individual-Aware Multimodal Depression-Re…

200 papers

Recently computer-aided diagnosis has demonstrated promising performance, effectively alleviating the workload of clinicians. However, the inherent sample imbalance among different diseases leads algorithms biased to the majority…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Li Pan , Yupei Zhang , Qiushi Yang , Tan Li , Zhen Chen

Despite recent advancements in federated learning (FL) for medical image diagnosis, addressing data heterogeneity among clients remains a significant challenge for practical implementation. A primary hurdle in FL arises from the non-IID…

Machine Learning · Computer Science 2024-07-09 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal

Multimodal deep learning has shown promise in depression detection by integrating text, audio, and video signals. Recent work leverages sentiment analysis to enhance emotional understanding, yet suffers from high computational cost, domain…

Machine Learning · Computer Science 2025-11-05 Ruibo Hou , Shiyu Teng , Jiaqing Liu , Shurong Chai , Yinhao Li , Lanfen Lin , Yen-Wei Chen

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

This study focuses on the feature extraction problem in multi-modal data regression. To address three core challenges in real-world scenarios: limited and non-IID data, effective extraction and fusion of multi-modal information, and…

Machine Learning · Computer Science 2025-12-03 Haozhe Wu

To improve the prediction of cancer survival using whole-slide images and transcriptomics data, it is crucial to capture both modality-shared and modality-specific information. However, multimodal frameworks often entangle these…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Sanne Abeln , Wilson Silva

Recommendation algorithms forecast user preferences by correlating user and item representations derived from historical interaction patterns. In pursuit of enhanced performance, many methods focus on learning robust and independent…

Information Retrieval · Computer Science 2024-08-01 Zhenyang Li , Fan Liu , Yinwei Wei , Zhiyong Cheng , Liqiang Nie , Mohan Kankanhalli

Multi-modal learning is a fast growing area in artificial intelligence. It tries to help machines understand complex things by combining information from different sources, like images, text, and audio. By using the strengths of each…

Machine Learning · Computer Science 2025-12-22 Qihang Jin , Enze Ge , Yuhang Xie , Hongying Luo , Junhao Song , Ziqian Bi , Chia Xin Liang , Jibin Guan , Joe Yeong , Xinyuan Song , Junfeng Hao

This study proposes an innovative multimodal fusion model based on a teacher-student architecture to enhance the accuracy of depression classification. Our designed model addresses the limitations of traditional methods in feature fusion…

Computation and Language · Computer Science 2025-02-03 Lindy Gan , Yifan Huang , Xiaoyang Gao , Jiaming Tan , Fujun Zhao , Tao Yang

Causal representation learning (CRL) seeks to uncover meaningful latent variables and their corresponding causal structure from high-dimensional observational data. Although its significance, CRL identifiability remains a crucial property,…

Machine Learning · Computer Science 2026-05-20 Manal Benhamza , Marianne Clausel , Myriam Tami

Multimodal representation learning seeks to create a unified representation space by integrating diverse data modalities to improve multimodal understanding. Traditional methods often depend on pairwise contrastive learning, which relies on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Xiaohao Liu , Xiaobo Xia , See-Kiong Ng , Tat-Seng Chua

Model interpretability has become important to engenders appropriate user trust by providing the insight into the model prediction. However, most of the existing machine learning methods provide no interpretability for depression…

Information Retrieval · Computer Science 2021-04-29 Hamad Zogan , Imran Razzak , Xianzhi Wang , Shoaib Jameel , Guandong Xu

As medical diagnoses increasingly leverage multimodal data, machine learning models are expected to effectively fuse heterogeneous information while remaining robust to missing modalities. In this work, we propose a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yi Gu , Kuniaki Saito , Jiaxin Ma

The increasing global prevalence of mental disorders, such as depression and PTSD, requires objective and scalable diagnostic tools. Traditional clinical assessments often face limitations in accessibility, objectivity, and consistency.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-03 Abdelrahaman A. Hassan , Abdelrahman A. Ali , Aya E. Fouda , Radwa J. Hanafy , Mohammed E. Fouda

Multimodal machine learning (MML) is rapidly reshaping the way mental-health disorders are detected, characterized, and longitudinally monitored. Whereas early studies relied on isolated data streams -- such as speech, text, or wearable…

Machine Learning · Computer Science 2025-06-25 Zahraa Al Sahili , Ioannis Patras , Matthew Purver

Depression poses significant challenges to patients and healthcare organizations, necessitating efficient assessment methods. Existing paradigms typically focus on a patient-doctor way that overlooks multi-role interactions, such as family…

Human-Computer Interaction · Computer Science 2026-03-10 Zhiyuan Zhou , Jilong Liu , Sanwang Wang , Shijie Hao , Yanrong Guo , Richang Hong

This paper proposes an introspective deep metric learning (IDML) framework for uncertainty-aware comparisons of images. Conventional deep metric learning methods produce confident semantic distances between images regardless of the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Wenzhao Zheng , Chengkun Wang , Jie Zhou , Jiwen Lu

Multimodal retrieval systems are becoming increasingly vital for cutting-edge AI technologies, such as embodied AI and AI-driven digital content industries. However, current multimodal retrieval tasks lack sufficient complexity and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Bangwei Liu , Yicheng Bao , Shaohui Lin , Xuhong Wang , Xin Tan , Yingchun Wang , Yuan Xie , Chaochao Lu

Wearable sensor technologies and deep learning are transforming healthcare management. Yet, most health sensing studies focus narrowly on physical chronic diseases. This overlooks the critical need for joint assessment of comorbid physical…

Machine Learning · Computer Science 2025-11-21 Yidong Chai , Haoxin Liu , Jiaheng Xie , Chaopeng Wang , Xiao Fang

An individualized treatment rule (ITR) tailors treatments to a patient's specific characteristics. However, randomized controlled trials (RCTs) are often underpowered to detect the treatment effect heterogeneity needed for reliable ITR…

Methodology · Statistics 2026-04-14 Yuan Bian , Donglin Zeng , Hyun-Joon Yang , Leanne M. Williams , Yuanjia Wang