English
Related papers

Related papers: Multi-Dimension-Embedding-Aware Modality Fusion Tr…

200 papers

Schizophrenia is a debilitating, chronic mental disorder that significantly impacts an individual's cognitive abilities, behavior, and social interactions. It is characterized by subtle morphological changes in the brain, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Nagur Shareef Shaik , Teja Krishna Cherukuri , Vince Calhoun , Dong Hye Ye

Schizophrenia is a severe mental health condition that requires a long and complicated diagnostic process. However, early diagnosis is vital to control symptoms. Deep learning has recently become a popular way to analyse and interpret…

Machine Learning · Computer Science 2022-04-01 Daniel Organisciak , Hubert P. H. Shum , Ephraim Nwoye , Wai Lok Woo

Neuroimaging modalities such as functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) provide information about neurological functions in complementary spatiotemporal resolutions; therefore, fusion of these…

Applications · Statistics 2020-12-23 Evrim Acar , Yuri Levin-Schwartz , Vince D. Calhoun , Tülay Adalı

Accurate diagnosis of psychiatric disorders plays a critical role in improving the quality of life for patients and potentially supports the development of new treatments. Many studies have been conducted on machine learning techniques that…

Machine Learning · Statistics 2019-04-15 Takashi Matsubara , Tetsuo Tashiro , Kuniaki Uehara

This study focuses on how different modalities of human communication can be used to distinguish between healthy controls and subjects with schizophrenia who exhibit strong positive symptoms. We developed a multi-modal schizophrenia…

Signal Processing · Electrical Eng. & Systems 2024-04-22 Gowtham Premananth , Yashish M. Siriwardena , Philip Resnik , Carol Espy-Wilson

Neuroimaging techniques including functional magnetic resonance imaging (fMRI) and electroencephalogram (EEG) have shown promise in detecting functional abnormalities in various brain disorders. However, existing studies often focus on a…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Xinxu Wei , Kanhao Zhao , Yong Jiao , Nancy B. Carlisle , Hua Xie , Gregory A. Fonzo , Yu Zhang

This study proposes a novel perspective on multimodal deep learning for biomedical signal classification, systematically analyzing how complementary feature domains impact model performance. While fusing multiple domains often presumes…

Machine Learning · Computer Science 2025-08-05 Timothy Oladunni , Alex Wong

Major depressive disorder is a serious and heterogeneous psychiatric disorder that needs accurate diagnosis. Resting-state functional MRI (rsfMRI), which captures multiple perspectives on brain structure, function, and connectivity, is…

Machine Learning · Computer Science 2023-08-21 Yunsong Luo , Wenyu Chen , Ling Zhan , Jiang Qiu , Tao Jia

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

Autism spectrum disorder (ASD) is associated with behavioral and communication problems. Often, functional magnetic resonance imaging (fMRI) is used to detect and characterize brain changes related to the disorder. Recently, machine…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Marcel Bengs , Nils Gessert , Alexander Schlaefer

Medical segmentation has grown exponentially through the advent of a fully convolutional network (FCN), and we have now reached a turning point through the success of Transformer. However, the different characteristics of the modality have…

Image and Video Processing · Electrical Eng. & Systems 2023-11-03 Jihoon Cho , Jinah Park

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

As a mental disorder progresses, it may affect brain structure, but brain function expressed in brain dynamics is affected much earlier. Capturing the moment when brain dynamics express the disorder is crucial for early diagnosis. The…

Image and Video Processing · Electrical Eng. & Systems 2019-11-19 Usman Mahmood , Md Mahfuzur Rahman , Alex Fedorov , Zening Fu , Sergey Plis

Neuropathic pain, affecting up to 10% of adults, remains difficult to treat due to limited therapeutic efficacy and tolerability. Although resting-state functional MRI (rs-fMRI) is a promising non-invasive measurement of brain biomarkers to…

Machine Learning · Computer Science 2025-03-04 Wenrui Fan , L. M. Riza Rizky , Jiayang Zhang , Chen Chen , Haiping Lu , Kevin Teh , Dinesh Selvarajah , Shuo Zhou

Cross-modal fusion of different types of neuroimaging data has shown great promise for predicting the progression of Alzheimer's Disease(AD). However, most existing methods applied in neuroimaging can not efficiently fuse the functional and…

Image and Video Processing · Electrical Eng. & Systems 2022-07-15 Junren Pan , Shuqiang Wang

Alzheimer's disease and Frontotemporal dementia are common forms of neurodegenerative dementia. Behavioral alterations and cognitive impairments are found in the clinical courses of both diseases and their differential diagnosis is…

Image and Video Processing · Electrical Eng. & Systems 2023-09-12 Huy-Dung Nguyen , Michaël Clément , Vincent Planche , Boris Mansencal , Pierrick Coupé

The current methods for diagnosing Alzheimer Disease using Magnetic Resonance Imaging (MRI) have significant limitations. Many previous studies used 2D Transformers to analyze individual brain slices independently, potentially losing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Juan A. Castro-Silva , Maria N. Moreno Garcia , Diego H. Peluffo-Ordoñez

With the increasing amounts of high-dimensional heterogeneous data to be processed, multi-modality feature selection has become an important research direction in medical image analysis. Traditional methods usually depict the data structure…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Yuang Shi , Chen Zu , Mei Hong , Luping Zhou , Lei Wang , Xi Wu , Jiliu Zhou , Daoqiang Zhang , Yan Wang

Utilizing multi-modal data enhances scene understanding by providing complementary semantic and geometric information. Existing methods fuse features or distill knowledge from multiple modalities into a unified representation, improving…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Jialei Chen , Xu Zheng , Danda Pani Paudel , Luc Van Gool , Hiroshi Murase , Daisuke Deguchi

Chronic wounds such as diabetic foot ulcers and pressure injuries require accurate tissue-level assessment to guide treatment planning and monitor healing progression. While deep learning methods have advanced automated wound analysis, most…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Muhammad Ashad Kabir , Rabin Dulal