English
Related papers

Related papers: MMFformer: Multimodal Fusion Transformer Network f…

200 papers

Automated depression diagnosis aims to analyze multimodal information from interview videos to predict participants' depression scores. Previous studies often lack clear explanations of how these scores were determined, limiting their…

Artificial Intelligence · Computer Science 2026-03-19 Wei Zhang , Juan Chen , En Zhu , Wenhong Cheng , YunPeng Li , Yanbo J. Wang

LiDAR point clouds have become the most common data source in autonomous driving. However, due to the sparsity of point clouds, accurate and reliable detection cannot be achieved in specific scenarios. Because of their complementarity with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Leichao Cui , Xiuxian Li , Min Meng , Xiaoyu Mo

Massive social media data can reflect people's authentic thoughts, emotions, communication, etc., and therefore can be analyzed for early detection of mental health problems such as depression. Existing works about early depression…

Social and Information Networks · Computer Science 2025-03-04 Chen Chen , Mingwei Li , Fenghuan Li , Haopeng Chen , Yuankun Lin

Individual's general well-being is greatly impacted by mental health conditions including depression and Post-Traumatic Stress Disorder (PTSD), underscoring the importance of early detection and precise diagnosis in order to facilitate…

Machine Learning · Computer Science 2025-02-07 Himanshi Singh , Sadhana Tiwari , Sonali Agarwal , Ritesh Chandra , Sanjay Kumar Sonbhadra , Vrijendra Singh

Depression is a growing concern gaining attention in both public discourse and AI research. While deep neural networks (DNNs) have been used for recognition, they still lack real-world effectiveness. Large language models (LLMs) show strong…

Human-Computer Interaction · Computer Science 2025-08-27 Yupei Li , Shuaijie Shao , Manuel Milling , Björn W. Schuller

As a vital aspect of affective computing, Multimodal Emotion Recognition has been an active research area in the multimedia community. Despite recent progress, this field still confronts two major challenges in real-world applications: 1)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Chengxin Chen , Pengyuan Zhang

Depression is increasingly impacting individuals both physically and psychologically worldwide. It has become a global major public health problem and attracts attention from various research fields. Traditionally, the diagnosis of…

Human-Computer Interaction · Computer Science 2022-02-28 Kaining Mao , Wei Zhang , Deborah Baofeng Wang , Ang Li , Rongqi Jiao , Yanhui Zhu , Bin Wu , Tiansheng Zheng , Lei Qian , Wei Lyu , Minjie Ye , Jie Chen

Crowd counting presents enormous challenges in the form of large variation in scales within images and across the dataset. These issues are further exacerbated in highly congested scenes. Approaches based on straightforward fusion of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-30 Vishwanath A Sindagi , Vishal M. Patel

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

Recent developments in image classification and natural language processing, coupled with the rapid growth in social media usage, have enabled fundamental advances in detecting breaking events around the world in real-time. Emergency…

Machine Learning · Computer Science 2020-04-13 Mahdi Abavisani , Liwei Wu , Shengli Hu , Joel Tetreault , Alejandro Jaimes

Multimodal deep learning methods capture synergistic features from multiple modalities and have the potential to improve accuracy for stress detection compared to unimodal methods. However, this accuracy gain typically comes from high…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Morteza Bodaghi , Majid Hosseini , Raju Gottumukkala

Micro-expression recognition (MER), a critical subfield of affective computing, presents greater challenges than macro-expression recognition due to its brief duration and low intensity. While incorporating prior knowledge has been shown to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Chuang Ma , Shaokai Zhao , Dongdong Zhou , Yu Pei , Zhiguo Luo , Liang Xie , Ye Yan , Erwei Yin

Point clouds and images could provide complementary information when representing 3D objects. Fusing the two kinds of data usually helps to improve the detection results. However, it is challenging to fuse the two data modalities, due to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Xun Tan , Xingyu Chen , Guowei Zhang , Jishiyu Ding , Xuguang Lan

Crowd counting, which is a key computer vision task, has emerged as a fundamental technology in crowd analysis and public safety management. However, challenges such as scale variations and complex backgrounds significantly impact the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Peng Liu , Heng-Chao Li , Sen Lei , Nanqing Liu , Bin Feng , Xiao Wu

Mental disorders, such as anxiety and depression, have become a global concern that affects people of all ages. Early detection and treatment are crucial to mitigate the negative effects these disorders can have on daily life. Although…

Computers and Society · Computer Science 2025-02-05 Jinghui Qin , Changsong Liu , Tianchi Tang , Dahuang Liu , Minghao Wang , Qianying Huang , Rumin Zhang

Depression is one of the most common mental disorders, which imposes heavy negative impacts on one's daily life. Diagnosing depression based on the interview is usually in the form of questions and answers. In this process, the audio…

Multimedia · Computer Science 2022-06-28 Yanrong Guo , Chenyang Zhu , Shijie Hao , Richang Hong

When emotions are repressed, an individual's true feelings may be revealed through micro-expressions. Consequently, micro-expressions are regarded as a genuine source of insight into an individual's authentic emotions. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Feng Liu , Bingyu Nan , Xuezhong Qian , Xiaolan Fu

Advancements in machine learning algorithms have had a beneficial impact on representation learning, classification, and prediction models built using electronic health record (EHR) data. Effort has been put both on increasing models'…

Machine Learning · Computer Science 2021-03-24 Yiwen Meng , William Speier , Michael K. Ong , Corey W. Arnold

Depression, as a typical mental disorder, has become a prevalent issue significantly impacting public health. However, the prevention and treatment of depression still face multiple challenges, including complex diagnostic procedures,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yu Luo , Nan Huang , Sophie Yu , Hendry Xu , Jerry Wang , Colin Wang , Zhichao Liu , Chen Zeng

In multimodal tasks, we find that the importance of text and image modal information is different for different input cases, and for this motivation, we propose a high-performance and highly general Dual-Router Dynamic Framework (DRDF),…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Haiwen Hong , Xuan Jin , Yin Zhang , Yunqing Hu , Jingfeng Zhang , Yuan He , Hui Xue