English
Related papers

Related papers: Neural Networks with Different Initialization Meth…

200 papers

Deep learning relies on good initialization schemes and hyperparameter choices prior to training a neural network. Random weight initializations induce random network ensembles, which give rise to the trainability, training speed, and…

Machine Learning · Statistics 2019-10-25 Rebekka Burkholz , Alina Dubatovka

Depression remains a pressing global mental health issue, driving considerable research into AI-driven detection approaches. While pre-trained models, particularly speech self-supervised models (SSL Models), have been applied to depression…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-11 Xiangyu Zhang , Beena Ahmed , Julien Epps

A plethora of deep learning models have been developed for the task of Alzheimer's disease classification from brain MRI scans. Many of these models report high performance, achieving three-class classification accuracy of up to 95%.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Ziqiang Guan , Ritesh Kumar , Yi Ren Fung , Yeahuay Wu , Madalina Fiterau

Physics-Informed Neural Networks (PINNs) are a powerful deep learning method capable of providing solutions and parameter estimations of physical systems. Given the complexity of their neural network structure, the convergence speed is…

Machine Learning · Computer Science 2025-01-28 Sirui Li , Federica Bragone , Matthieu Barreau , Kateryna Morozovska

Alzheimer's disease is an untreatable, progressive brain disorder that slowly robs people of their memory, thinking abilities, and ultimately their capacity to complete even the most basic tasks. Among older adults, it is the most frequent…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Nasser A Alsadhan

The successes of intelligent systems have quite relied on the artificial learning of information, which lead to the broad applications of neural learning solutions. As a common sense, the training of neural networks can be largely improved…

Machine Learning · Computer Science 2025-04-15 Miao Cheng , Feiyan Zhou , Hongwei Zou , Limin Wang

Parkinson's disease is a neurological condition that occurs in nearly 1% of the world's population. The disease is manifested by a drop in dopamine production, symptoms are cognitive and behavioural and include a wide range of personality…

Image and Video Processing · Electrical Eng. & Systems 2024-01-08 Maria Frasca , Davide La Torre , Gabriella Pravettoni , Ilaria Cutica

Emergence in machine learning refers to the spontaneous appearance of complex behaviors or capabilities that arise from the scale and structure of training data and model architectures, despite not being explicitly programmed. We introduce…

Machine Learning · Computer Science 2025-01-07 Johnny Jingze Li , Vivek Kurien George , Gabriel A. Silva

The ability to train randomly initialised deep neural networks is known to depend strongly on the variance of the weight matrices and biases as well as the choice of nonlinear activation. Here we complement the existing geometric analysis…

Information Theory · Computer Science 2021-02-09 Jared Tanner , Giuseppe Ughi

The phenomenon of distinct behaviors exhibited by neural networks under varying scales of initialization remains an enigma in deep learning research. In this paper, based on the earlier work by Luo et al.~\cite{luo2021phase}, we present a…

Machine Learning · Computer Science 2026-04-02 Zhengan Chen , Yuqing Li , Tao Luo , Zhangchen Zhou , Zhi-Qin John Xu

Limited access to mental healthcare resources hinders timely depression diagnosis, leading to detrimental outcomes. Social media platforms present a valuable data source for early detection, yet this task faces two significant challenges:…

Computation and Language · Computer Science 2025-10-10 Xiaochong Lan , Zhiguang Han , Yiming Cheng , Li Sheng , Jie Feng , Chen Gao , Yong Li

Computational research on mental health disorders from written texts covers an interdisciplinary area between natural language processing and psychology. A crucial aspect of this problem is prevention and early diagnosis, as suicide…

Machine Learning · Statistics 2020-11-04 Ana-Maria Bucur , Liviu P. Dinu

Machine learning methods exploiting multi-parametric biomarkers, especially based on neuroimaging, have huge potential to improve early diagnosis of dementia and to predict which individuals are at-risk of developing dementia. To benchmark…

Machine Learning · Computer Science 2022-02-21 Esther E. Bron , Stefan Klein , Annika Reinke , Janne M. Papma , Lena Maier-Hein , Daniel C. Alexander , Neil P. Oxtoby

Normalization methods play an important role in enhancing the performance of deep learning while their theoretical understandings have been limited. To theoretically elucidate the effectiveness of normalization, we quantify the geometry of…

Machine Learning · Statistics 2019-10-29 Ryo Karakida , Shotaro Akaho , Shun-ichi Amari

Uncertainty calibration is crucial for various machine learning applications, yet it remains challenging. Many models exhibit hallucinations - confident yet inaccurate responses - due to miscalibrated confidence. Here, we show that the…

Machine Learning · Computer Science 2025-03-28 Jeonghwan Cheon , Se-Bum Paik

This paper addresses the critical need for improved explainability in text-based depression detection. While offering predictive outcomes, current solutions often overlook the understanding of model predictions which can hinder trust in the…

Computation and Language · Computer Science 2025-06-02 Patawee Prakrankamanant , Shinji Watanabe , Ekapol Chuangsuwanich

The rapid global aging trend has led to an increase in dementia cases, including Alzheimer's disease, underscoring the urgent need for early and accurate diagnostic methods. Traditional diagnostic techniques, such as cognitive tests,…

Machine Learning · Computer Science 2024-09-06 Juan A. Berrios Moya

Weight initialization is important for faster convergence and stability of deep neural networks training. In this paper, a robust initialization method is developed to address the training instability in long short-term memory (LSTM)…

This study investigates the utility of speech signals for AI-based depression screening across varied interaction scenarios, including psychiatric interviews, chatbot conversations, and text readings. Participants include depressed patients…

Sound · Computer Science 2024-06-13 Yangbin Chen , Chenyang Xu , Chunfeng Liang , Yanbao Tao , Chuan Shi

Depression is a widespread mental health disorder, and clinical interviews are the gold standard for assessment. However, their reliance on scarce professionals highlights the need for automated detection. Current systems mainly employ…

Computation and Language · Computer Science 2025-03-04 Linhai Zhang , Ziyang Gao , Deyu Zhou , Yulan He