English
Related papers

Related papers: Multi-Dimension-Embedding-Aware Modality Fusion Tr…

200 papers

Nowadays, many people worldwide suffer from brain disorders, and their health is in danger. So far, numerous methods have been proposed for the diagnosis of Schizophrenia (SZ) and attention deficit hyperactivity disorder (ADHD), among which…

In spite of years of research, the mechanisms that underlie the development of schizophrenia, as well as its relapse, symptomatology, and treatment, continue to be a mystery. The absence of appropriate analytic tools to deal with the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Vigneshwaran Shankaran , Bhaskaran V

Depression is a serious mental health illness that significantly affects an individual's well-being and quality of life, making early detection crucial for adequate care and treatment. Detecting depression is often difficult, as it is based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Md Rezwanul Haque , Md. Milon Islam , S M Taslim Uddin Raju , Hamdi Altaheri , Lobna Nassar , Fakhri Karray

The increasing global prevalence of mental disorders, such as depression and PTSD, requires objective and scalable diagnostic tools. Traditional clinical assessments often face limitations in accessibility, objectivity, and consistency.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-03 Abdelrahaman A. Hassan , Abdelrahman A. Ali , Aya E. Fouda , Radwa J. Hanafy , Mohammed E. Fouda

The wide variety of brain imaging technologies allows us to exploit information inherent to different data modalities. The richness of multimodal datasets may increase predictive power and reveal latent variables that otherwise would have…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Alvaro Ulloa , Sergey Plis , Vince Calhoun

To benefit the complementary information between heterogeneous data, we introduce a new Multimodal Transformer (MMFormer) for Remote Sensing (RS) image classification using Hyperspectral Image (HSI) accompanied by another source of data…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Bo Zhang , Zuheng Ming , Wei Feng , Yaqian Liu , Liang He , Kaixing Zhao

Objective: Multimodal measurements of the same phenomena provide complementary information and highlight different perspectives, albeit each with their own limitations. A focus on a single modality may lead to incorrect inferences, which is…

Gaining insights into the structural and functional mechanisms of the brain has been a longstanding focus in neuroscience research, particularly in the context of understanding and treating neuropsychiatric disorders such as Schizophrenia…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Badhan Mazumder , Lei Wu , Vince D. Calhoun , Dong Hye Ye

Autism Spectrum Disorder (ASD) is a complex neurodevelopmental condition marked by disruptions in brain connectivity. Functional MRI (fMRI) offers a non-invasive window into large-scale neural dynamics by measuring…

Machine Learning · Computer Science 2025-08-20 Mohammad Izadi , Mehran Safayani

Research efforts for visual decoding from fMRI signals have attracted considerable attention in research community. Still multi-subject fMRI decoding with one model has been considered intractable due to the drastic variations in fMRI…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Inhwa Han , Jaayeon Lee , Jong Chul Ye

Leveraging information across diverse modalities is known to enhance performance on multimodal segmentation tasks. However, effectively fusing information from different modalities remains challenging due to the unique characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Md Kaykobad Reza , Ashley Prater-Bennette , M. Salman Asif

Deep learning methods are increasingly being used with neuroimaging data like structural and function magnetic resonance imaging (MRI) to predict the diagnosis of neuropsychiatric and neurological disorders. For psychiatric disorders in…

Neurons and Cognition · Quantitative Biology 2019-07-03 Ahmed El Gazzar , Leonardo Cerliani , Guido van Wingen , Rajat Mani Thomas

Diagnosing Major Depressive Disorder (MDD) from functional magnetic resonance imaging (fMRI) using functional connectivity (FC) analysis requires large amounts of labeled data that are scarce in clinical settings. Existing augmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Muhammad Asif Hasan , Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew

Mental disorders are among the foremost contributors to the global healthcare challenge. Research indicates that timely diagnosis and intervention are vital in treating various mental disorders. However, the early somatization symptoms of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Yichun Li , Shuanglin Li , Syed Mohsen Naqvi

Introspection of deep supervised predictive models trained on functional and structural brain imaging may uncover novel markers of Alzheimer's disease (AD). However, supervised training is prone to learning from spurious features (shortcut…

Machine Learning · Computer Science 2022-05-24 Alex Fedorov , Lei Wu , Tristan Sylvain , Margaux Luck , Thomas P. DeRamus , Dmitry Bleklov , Sergey M. Plis , Vince D. Calhoun

Diagnosing dementia, particularly for Alzheimer's Disease (AD) and frontotemporal dementia (FTD), is complex due to overlapping symptoms. While magnetic resonance imaging (MRI) and positron emission tomography (PET) data are critical for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Yitong Li , Morteza Ghahremani , Youssef Wally , Christian Wachinger

Accurate brain tumor segmentation from Magnetic Resonance Imaging (MRI) is desirable to joint learning of multimodal images. However, in clinical practice, it is not always possible to acquire a complete set of MRIs, and the problem of…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yao Zhang , Nanjun He , Jiawei Yang , Yuexiang Li , Dong Wei , Yawen Huang , Yang Zhang , Zhiqiang He , Yefeng Zheng

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Psychiatric disorders have historically been classified using symptom information alone. With the advent of new technologies that allowed researchers to investigate brain mechanisms more directly, interest in the mechanistic rationale…

Neurons and Cognition · Quantitative Biology 2020-07-02 Lucas Miranda , Riya Paul , Benno Pütz , Bertram Müller-Myhsok

Alzheimer's disease (AD) is a progressive neurodegenerative disorder in which pathological changes begin many years before the onset of clinical symptoms, making early detection essential for timely intervention. T1-weighted (T1w) Magnetic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jason Qiu