English
Related papers

Related papers: MMFformer: Multimodal Fusion Transformer Network f…

200 papers

Chest X-ray imaging is a critical diagnostic tool for identifying pulmonary diseases. However, manual interpretation of these images is time-consuming and error-prone. Automated systems utilizing convolutional neural networks (CNNs) have…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Saurabh Agarwal , K. V. Arya , Yogesh Kumar Meena

Depression represents a global mental health challenge requiring efficient and reliable automated detection methods. Current Transformer- or Graph Neural Networks (GNNs)-based multimodal depression detection methods face significant…

Machine Learning · Computer Science 2025-11-18 Changzeng Fu , Shiwen Zhao , Yunze Zhang , Zhongquan Jian , Shiqi Zhao , Chaoran Liu

Depression remains a pressing global mental health issue, driving considerable research into AI-driven detection approaches. While pre-trained models, particularly speech self-supervised models (SSL Models), have been applied to depression…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-11 Xiangyu Zhang , Beena Ahmed , Julien Epps

Vision Transformer and its variants have demonstrated great potential in various computer vision tasks. But conventional vision transformers often focus on global dependency at a coarse level, which suffer from a learning challenge on…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Yunhao Wang , Huixin Sun , Xiaodi Wang , Bin Zhang , Chao Li , Ying Xin , Baochang Zhang , Errui Ding , Shumin Han

Depression has been a leading cause of mental-health illnesses across the world. While the loss of lives due to unmanaged depression is a subject of attention, so is the lack of diagnostic tests and subjectivity involved. Using behavioural…

Artificial Intelligence · Computer Science 2020-10-07 Shivani Shimpi , Shyam Thombre , Snehal Reddy , Ritik Sharma , Srijan Singh

Clinical depression or Major Depressive Disorder (MDD) is a common and serious medical illness. In this paper, a deep recurrent neural network-based framework is presented to detect depression and to predict its severity level from speech.…

Human-Computer Interaction · Computer Science 2020-03-13 Emna Rejaibi , Ali Komaty , Fabrice Meriaudeau , Said Agrebi , Alice Othmani

Users of social platforms often perceive these sites as supportive spaces to post about their mental health issues. Those conversations contain important traces about individuals' health risks. Recently, researchers have exploited this…

Computation and Language · Computer Science 2024-08-21 Eliseo Bao , Anxo Pérez , Javier Parapar

Depression remains widely underdiagnosed and undertreated because stigma and subjective symptom ratings hinder reliable screening. To address this challenge, we propose a coarse-to-fine, multi-stage framework that leverages large language…

Artificial Intelligence · Computer Science 2026-04-14 Shiyu Teng , Jiaqing Liu , Hao Sun , Yu Li , Shurong Chai , Ruibo Hou , Tomoko Tateyama , Lanfen Lin , Yen-Wei Chen

Suicide is one of the leading causes of death among adolescents. Previous suicide risk prediction studies have primarily focused on either textual or acoustic information in isolation, the integration of multimodal signals, such as speech…

Sound · Computer Science 2025-09-03 Wenqiang Sun , Han Yin , Jisheng Bai , Jianfeng Chen

The increasing prevalence of mental health disorders, such as depression, anxiety, and bipolar disorder, calls for immediate need in developing tools for early detection and intervention. Social media platforms, like Reddit, represent a…

Machine Learning · Computer Science 2025-03-12 Qasim Bin Saeed , Ijaz Ahmed

Social network plays an important role in propagating people's viewpoints, emotions, thoughts, and fears. Notably, following lockdown periods during the COVID-19 pandemic, the issue of depression has garnered increasing attention, with a…

Computation and Language · Computer Science 2023-06-28 Yan Shi , Yao Tian , Chengwei Tong , Chunyan Zhu , Qianqian Li , Mengzhu Zhang , Wei Zhao , Yong Liao , Pengyuan Zhou

Textual emotional intelligence is playing a ubiquitously important role in leveraging human emotions on social media platforms. Social media platforms are privileged with emotional content and are leveraged for various purposes like opinion…

Computation and Language · Computer Science 2023-01-10 Danish Muzafar , Furqan Yaqub Khan , Mubashir Qayoom

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promising results in…

Machine Learning · Computer Science 2026-03-05 Hantong Feng , Yonggang Wu , Duxin Chen , Wenwu Yu

The proliferation of multi-modal fake news on social media poses a significant threat to public trust and social stability. Traditional detection methods, primarily text-based, often fall short due to the deceptive interplay between…

Cryptography and Security · Computer Science 2025-08-11 Junhao He , Tianyu Liu , Jingyuan Zhao , Benjamin Turner

This study investigates the use of Large Language Models (LLMs) for improved depression detection from users social media data. Through the use of fine-tuned GPT 3.5 Turbo 1106 and LLaMA2-7B models and a sizable dataset from earlier…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Shahid Munir Shah , Syeda Anshrah Gillani , Mirza Samad Ahmed Baig , Muhammad Aamer Saleem , Muhammad Hamzah Siddiqui

This paper introduces an innovative multi-modal fusion deep learning approach to overcome the drawbacks of traditional single-modal recognition techniques. These drawbacks include incomplete information and limited diagnostic accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xiaoyi Liu , Hongjie Qiu , Muqing Li , Zhou Yu , Yutian Yang , Yafeng Yan

Depression is a mental disorder and can cause a variety of symptoms, including psychological, physical, and social. Speech has been proved an objective marker for the early recognition of depression. For this reason, many studies have been…

Machine Learning · Computer Science 2026-05-12 Loukas Ilias , Dimitris Askounis

Major depressive disorder is a serious and heterogeneous psychiatric disorder that needs accurate diagnosis. Resting-state functional MRI (rsfMRI), which captures multiple perspectives on brain structure, function, and connectivity, is…

Machine Learning · Computer Science 2023-08-21 Yunsong Luo , Wenyu Chen , Ling Zhan , Jiang Qiu , Tao Jia

The diagnosis of medical diseases faces challenges such as the misdiagnosis of small lesions. Deep learning, particularly multimodal approaches, has shown great potential in the field of medical disease diagnosis. However, the differences…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jianxun Yu , Ruiquan Ge , Zhipeng Wang , Cheng Yang , Chenyu Lin , Xianjun Fu , Jikui Liu , Ahmed Elazab , Changmiao Wang

Fake news detection has received increasing attention from researchers in recent years, especially multi-modal fake news detection containing both text and images. However, many previous works have fed two modal features, text and image,…

Multimedia · Computer Science 2024-07-02 Hongzhen Lv , Wenzhong Yang , Fuyuan Wei , Jiaren Peng , Haokun Geng