中文
相关论文

相关论文: Multimodal Audio-based Disease Prediction with Tra…

200 篇论文

As machine learning and artificial intelligence are more frequently being leveraged to tackle problems in the health sector, there has been increased interest in utilizing them in clinical decision-support. This has historically been the…

机器学习 · 计算机科学 2022-04-12 Adrienne Kline , Hanyin Wang , Yikuan Li , Saya Dennis , Meghan Hutch , Zhenxing Xu , Fei Wang , Feixiong Cheng , Yuan Luo

Cardiac amyloidosis, a rare and highly morbid condition, presents significant challenges for detection through echocardiography. Recently, there has been a surge in proposing machine-learning algorithms to identify cardiac amyloidosis, with…

图像与视频处理 · 电气工程与系统科学 2024-06-10 Zishun Feng , Joseph A. Sivak , Ashok K. Krishnamurthy

Voice disorders negatively impact the quality of daily life in various ways. However, accurately recognizing the category of pathological features from raw audio remains a considerable challenge due to the limited dataset. A promising…

声音 · 计算机科学 2024-10-08 Lipeng Shen , Yifan Xiong , Dongyue Guo , Wei Mo , Lingyu Yu , Hui Yang , Yi Lin

This study proposes a novel perspective on multimodal deep learning for biomedical signal classification, systematically analyzing how complementary feature domains impact model performance. While fusing multiple domains often presumes…

机器学习 · 计算机科学 2025-08-05 Timothy Oladunni , Alex Wong

Technological advances in medical data collection, such as high-throughput genomic sequencing and digital high-resolution histopathology, have contributed to the rising requirement for multimodal biomedical modelling, specifically for…

机器学习 · 计算机科学 2024-10-29 Konstantin Hemker , Nikola Simidjievski , Mateja Jamnik

Suicide is one of the leading causes of death among adolescents. Previous suicide risk prediction studies have primarily focused on either textual or acoustic information in isolation, the integration of multimodal signals, such as speech…

声音 · 计算机科学 2025-09-03 Wenqiang Sun , Han Yin , Jisheng Bai , Jianfeng Chen

Multimodal clinical prediction is widely used to integrate heterogeneous data such as Electronic Health Records (EHR) and biosignals. However, existing methods tend to rely on static modality integration schemes and simple fusion…

机器学习 · 计算机科学 2026-01-16 Jongseok Kim , Seongae Kang , Jonghwan Shin , Yuhan Lee , Ohyun Jo

Machine learning holds promise for advancing clinical decision support, yet it remains unclear when multimodal learning truly helps in practice, particularly under modality missingness and fairness constraints. In this work, we conduct a…

机器学习 · 计算机科学 2026-03-02 Kejing Yin , Haizhou Xu , Wenfang Yao , Chen Liu , Zijie Chen , Yui Haang Cheung , William K. Cheung , Jing Qin

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

图像与视频处理 · 电气工程与系统科学 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

Alzheimer's disease (AD) is a progressive neurological disorder, meaning that the symptoms develop gradually throughout the years. It is also the main cause of dementia, which affects memory, thinking skills, and mental abilities. Nowadays,…

计算与语言 · 计算机科学 2022-11-09 Loukas Ilias , Dimitris Askounis , John Psarras

Previous research on the diagnosis of Bipolar disorder has mainly focused on resting-state functional magnetic resonance imaging. However, their accuracy can not meet the requirements of clinical diagnosis. Efficient multimodal fusion…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Guoxin Wang , Sheng Shi , Shan An , Fengmei Fan , Wenshu Ge , Qi Wang , Feng Yu , Zhiren Wang

Body-conduction microphone signals (BMS) bypass airborne sound, providing strong noise resistance. However, a complementary modality is required to compensate for the inherent loss of high-frequency information. In this study, we propose a…

声音 · 计算机科学 2025-08-29 Yunsik Kim , Yoonyoung Chung

Alzheimer's disease (AD) is a common neurodegenerative disease among the elderly. Early prediction and timely intervention of its prodromal stage, mild cognitive impairment (MCI), can decrease the risk of advancing to AD. Combining…

图像与视频处理 · 电气工程与系统科学 2025-01-22 Xiangyang Hu , Xiangyu Shen , Yifei Sun , Xuhao Shan , Wenwen Min , Liyilei Su , Xiaomao Fan , Ahmed Elazab , Ruiquan Ge , Changmiao Wang , Xiaopeng Fan

This study proposes an innovative multimodal fusion model based on a teacher-student architecture to enhance the accuracy of depression classification. Our designed model addresses the limitations of traditional methods in feature fusion…

计算与语言 · 计算机科学 2025-02-03 Lindy Gan , Yifan Huang , Xiaoyang Gao , Jiaming Tan , Fujun Zhao , Tao Yang

Early detection of cognitive disorders such as Alzheimer's disease is critical for enabling timely clinical intervention and improving patient outcomes. In this work, we introduce CogniAlign, a multimodal architecture for Alzheimer's…

Artificial intelligence (AI) models trained on audio data may have the potential to rapidly perform clinical tasks, enhancing medical decision-making and potentially improving outcomes through early detection. Existing technologies depend…

Deep neural networks are often applied to medical images to automate the problem of medical diagnosis. However, a more clinically relevant question that practitioners usually face is how to predict the future trajectory of a disease.…

图像与视频处理 · 电气工程与系统科学 2023-09-20 Huy Hoang Nguyen , Matthew B. Blaschko , Simo Saarakkala , Aleksei Tiulpin

Reliable detection of the prodromal stages of Alzheimer's disease (AD) remains difficult even today because, unlike other neurocognitive impairments, there is no definitive diagnosis of AD in vivo. In this context, existing research has…

机器学习 · 计算机科学 2021-08-03 Amish Mittal , Sourav Sahoo , Arnhav Datar , Juned Kadiwala , Hrithwik Shalu , Jimson Mathew

Medical patient data is always multimodal. Images, text, age, gender, histopathological data are only few examples for different modalities in this context. Processing and integrating this multimodal data with deep learning based methods is…

人工智能 · 计算机科学 2025-09-11 Christian Gapp , Elias Tappeiner , Martin Welk , Rainer Schubert

This study focuses on how different modalities of human communication can be used to distinguish between healthy controls and subjects with schizophrenia who exhibit strong positive symptoms. We developed a multi-modal schizophrenia…

信号处理 · 电气工程与系统科学 2024-04-22 Gowtham Premananth , Yashish M. Siriwardena , Philip Resnik , Carol Espy-Wilson