English
Related papers

Related papers: A Multimodal Approach for Automatic Mania Assessme…

200 papers

Preliminary detection of mild depression could immensely help in effective treatment of the common mental health disorder. Due to the lack of proper awareness and the ample mix of stigmas and misconceptions present within the society,…

Depression is a common psychiatric disorder, which causes significant patient distress. Bipolar disorder is characterized by mood fluctuations between depression and mania. Unipolar and bipolar depression can be easily confused because of…

Image and Video Processing · Electrical Eng. & Systems 2019-09-02 Marie Zelenina , Diana Prata

During psychiatric assessment, clinicians observe not only what patients report, but important nonverbal signs such as tone, speech rate, fluency, responsiveness, and body language. Weighing and integrating these different information…

Machine Learning · Computer Science 2025-12-19 Agnes Norbury , George Fairs , Alexandra L. Georgescu , Matthew M. Nour , Emilia Molimpakis , Stefano Goria

Depression is a common mental disorder that affects millions of people worldwide. Although promising, current multimodal methods hinge on aligned or aggregated multimodal fusion, suffering two significant limitations: (i) inefficient…

Computers and Society · Computer Science 2024-09-25 Jiaxin Ye , Junping Zhang , Hongming Shan

In the current age, human lifestyle has become more knowledge oriented leading to generation of sedentary employment. This has given rise to a number of health and mental disorders. Mental wellness is one of the most neglected but crucial…

Machine Learning · Computer Science 2023-06-19 Rahee Walambe , Pranav Nayak , Ashmit Bhardwaj , Ketan Kotecha

Speech patterns have been identified as potential diagnostic markers for neuropsychiatric conditions. However, most studies only compare a single clinical group to healthy controls, whereas clinical practice often requires differentiating…

In psychiatric diagnosis, a contemporary data-driven, manual-based method for mental disorders classification is the most popular technique; however, it has several inevitable flaws. Using the three-way decision as a framework, we propose a…

Artificial Intelligence · Computer Science 2023-04-11 Huidong Wang , Md Sakib Ullah Sourav , Mengdi Yang , Jiaping Zhang

Bipolar disorder (BD) and borderline personality disorder (BPD) are two chronic mental health conditions that clinicians find challenging to distinguish based on clinical interviews, due to their overlapping symptoms. In this work, we…

Machine Learning · Computer Science 2022-01-02 Bo Wang , Yue Wu , Nemanja Vaci , Maria Liakata , Terry Lyons , Kate E A Saunders

Retinal diseases spanning a broad spectrum can be effectively identified and diagnosed using complementary signals from multimodal data. However, multimodal diagnosis in ophthalmic practice is typically challenged in terms of data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Lu Zhang , Huizhen Yu , Zuowei Wang , Fu Gui , Yatu Guo , Wei Zhang , Mengyu Jia

Several studies have shown that speech and language features, automatically extracted from clinical interviews or spontaneous discourse, have diagnostic value for mental disorders such as schizophrenia and bipolar disorder. They typically…

Computation and Language · Computer Science 2019-07-30 Rohit Voleti , Stephanie Woolridge , Julie M. Liss , Melissa Milanovic , Christopher R. Bowie , Visar Berisha

Neuropsychiatric disorders, such as Alzheimer's disease (AD), depression, and autism spectrum disorder (ASD), are characterized by linguistic and acoustic abnormalities, offering potential biomarkers for early detection. Despite the promise…

Computation and Language · Computer Science 2025-12-25 Zhongren Dong , Haotian Guo , Weixiang Xu , Huan Zhao , Zixing Zhang

The current practice for assessing neonatal postoperative pain relies on bedside caregivers. This practice is subjective, inconsistent, slow, and discontinuous. To develop a reliable medical interpretation, several automated approaches have…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Md Sirajus Salekin , Ghada Zamzmi , Dmitry Goldgof , Rangachar Kasturi , Thao Ho , Yu Sun

Depression is increasingly impacting individuals both physically and psychologically worldwide. It has become a global major public health problem and attracts attention from various research fields. Traditionally, the diagnosis of…

Human-Computer Interaction · Computer Science 2022-02-28 Kaining Mao , Wei Zhang , Deborah Baofeng Wang , Ang Li , Rongqi Jiao , Yanhui Zhu , Bin Wu , Tiansheng Zheng , Lei Qian , Wei Lyu , Minjie Ye , Jie Chen

This paper presents our submission to the PROCESS Challenge 2025, focusing on spontaneous speech analysis for early dementia detection. For the three-class classification task (Healthy Control, Mild Cognitive Impairment, and Dementia), we…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Yin-Long Liu , Yuanchao Li , Rui Feng , Liu He , Jia-Xin Chen , Yi-Ming Wang , Yu-Ang Chen , Yan-Han Peng , Jia-Hong Yuan , Zhen-Hua Ling

Multimodal depression classification has gained immense popularity over the recent years. We develop a multimodal depression classification system using articulatory coordination features extracted from vocal tract variables and text…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-15 Nadee Seneviratne , Carol Espy-Wilson

Due to its ability to accurately predict emotional state using multimodal features, audiovisual emotion recognition has recently gained more interest from researchers. This paper proposes two methods to predict emotional attributes from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Bagus Tris Atmaja , Masato Akagi

The increasing use of electronic forms of communication presents new opportunities in the study of mental health, including the ability to investigate the manifestations of psychiatric diseases unobtrusively and in the setting of patients'…

Human-Computer Interaction · Computer Science 2018-03-28 Bokai Cao , Lei Zheng , Chenwei Zhang , Philip S. Yu , Andrea Piscitello , John Zulueta , Olu Ajilore , Kelly Ryan , Alex D. Leow

Alzheimer's disease is a progressive neurological disorder characterized by cognitive impairment and memory loss. With the increasing aging population, the incidence of AD is continuously rising, making early diagnosis and intervention an…

Image and Video Processing · Electrical Eng. & Systems 2023-11-23 Guian Fang , Mengsha Liu , Yi Zhong , Zhuolin Zhang , Jiehui Huang , Zhenchao Tang , Calvin Yu-Chian Chen

This study investigates the potential of multimodal data integration, which combines electroencephalogram (EEG) data with sociodemographic characteristics like age, sex, education, and intelligence quotient (IQ), to diagnose mental diseases…

Machine Learning · Computer Science 2025-02-07 Himanshi Singh , Sadhana Tiwari , Sonali Agarwal , Ritesh Chandra , Sanjay Kumar Sonbhadra , Vrijendra Singh

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li