English
Related papers

Related papers: Why Pre-trained Models Fail: Feature Entanglement …

200 papers

Depression remains widely underdiagnosed and undertreated because stigma and subjective symptom ratings hinder reliable screening. To address this challenge, we propose a coarse-to-fine, multi-stage framework that leverages large language…

Artificial Intelligence · Computer Science 2026-04-14 Shiyu Teng , Jiaqing Liu , Hao Sun , Yu Li , Shurong Chai , Ruibo Hou , Tomoko Tateyama , Lanfen Lin , Yen-Wei Chen

Depression is one of the most common mental illness problems, and the symptoms shown by patients are not consistent, making it difficult to diagnose in the process of clinical practice and pathological research. Although researchers hope…

Computers and Society · Computer Science 2024-10-08 Xiaohang Xu , Hao Peng , Lichao Sun , Md Zakirul Alam Bhuiyan , Lianzhong Liu , Lifang He

The rapid advancement of pre-trained language models (PLMs) has demonstrated promising results for various code-related tasks. However, their effectiveness in detecting real-world vulnerabilities remains a critical challenge. While existing…

Cryptography and Security · Computer Science 2025-11-25 Youpeng Li , Weiliang Qi , Xuyu Wang , Fuxun Yu , Xinda Wang

Individual's general well-being is greatly impacted by mental health conditions including depression and Post-Traumatic Stress Disorder (PTSD), underscoring the importance of early detection and precise diagnosis in order to facilitate…

Machine Learning · Computer Science 2025-02-07 Himanshi Singh , Sadhana Tiwari , Sonali Agarwal , Ritesh Chandra , Sanjay Kumar Sonbhadra , Vrijendra Singh

Large language models (LLMs) show promise for health applications when combined with behavioral sensing data. Traditional approaches convert sensor data into text prompts, but this process is prone to errors, computationally expensive, and…

The increasing frequency of suicidal thoughts highlights the importance of early detection and intervention. Social media platforms, where users often share personal experiences and seek help, could be utilized to identify individuals at…

Computation and Language · Computer Science 2024-11-04 Vy Nguyen , Chau Pham

Depression is ranked as the largest contributor to global disability and is also a major reason for suicide. Still, many individuals suffering from forms of depression are not treated for various reasons. Previous studies have shown that…

Computation and Language · Computer Science 2024-10-30 Marcel Trotzek , Sven Koitka , Christoph M. Friedrich

The collection and curation of large-scale medical datasets from multiple institutions is essential for training accurate deep learning models, but privacy concerns often hinder data sharing. Federated learning (FL) is a promising solution…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Rui Yan , Liangqiong Qu , Qingyue Wei , Shih-Cheng Huang , Liyue Shen , Daniel Rubin , Lei Xing , Yuyin Zhou

Large Language Models (LLMs) are becoming increasingly popular in pervasive computing due to their versatility and strong performance. However, despite their ubiquitous use, the exact mechanisms underlying their outstanding performance…

Computation and Language · Computer Science 2026-02-02 Alhassan Abdelhalim , Janick Edinger , Sören Laue , Michaela Regneri

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

Machine Learning · Computer Science 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam

Disorganized thinking is a key diagnostic indicator of schizophrenia-spectrum disorders. Recently, clinical estimates of the severity of disorganized thinking have been shown to correlate with measures of how difficult speech transcripts…

Computation and Language · Computer Science 2025-03-27 Changye Li , Weizhe Xu , Serguei Pakhomov , Ellen Bradley , Dror Ben-Zeev , Trevor Cohen

In the training data used by large language models (LLMs), the same latent concept is often presented in multiple distinct ways: the same facts appear in English and Swahili; many functions can be expressed in both Python and Haskell; we…

Computation and Language · Computer Science 2026-05-20 Thomas Vincent Howe , David Wingate

Understanding the dynamics of counseling conversations is an important task, yet it is a challenging NLP problem regardless of the recent advance of Transformer-based pre-trained language models. This paper proposes a systematic approach to…

Computation and Language · Computer Science 2024-02-23 Younghun Lee , Dan Goldwasser , Laura Schwab Reese

Recent work on discrete speech tokenization has paved the way for models that can seamlessly perform multiple tasks across modalities, e.g., speech recognition, text to speech, speech to speech translation. Moreover, large language models…

Computation and Language · Computer Science 2024-06-26 Viet Anh Trinh , Rosy Southwell , Yiwen Guan , Xinlu He , Zhiyong Wang , Jacob Whitehill

Trained on massive publicly available data, large language models (LLMs) have demonstrated tremendous success across various fields. While more data contributes to better performance, a disconcerting reality is that high-quality public data…

Machine Learning · Computer Science 2024-02-13 Rui Ye , Wenhao Wang , Jingyi Chai , Dihan Li , Zexi Li , Yinda Xu , Yaxin Du , Yanfeng Wang , Siheng Chen

Recent large-scale natural language processing (NLP) systems use a pre-trained Large Language Model (LLM) on massive and diverse corpora as a headstart. In practice, the pre-trained model is adapted to a wide array of tasks via fine-tuning…

Computation and Language · Computer Science 2022-09-12 Jimit Majmudar , Christophe Dupuy , Charith Peris , Sami Smaili , Rahul Gupta , Richard Zemel

Depression detection using deep learning models has been widely explored in previous studies, especially due to the large amounts of data available from social media posts. These posts provide valuable information about individuals' mental…

Machine Learning · Computer Science 2025-03-25 Mustofa Ahmed , Abdul Muntakim , Nawrin Tabassum , Mohammad Asifur Rahim , Faisal Muhammad Shah

The rapid advancement of multimodal large language models (MLLMs) has significantly enhanced performance across benchmarks. However, data contamination-unintentional memorization of benchmark data during model training-poses critical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Dingjie Song , Sicheng Lai , Mingxuan Wang , Shunian Chen , Lichao Sun , Benyou Wang

Timely identification is essential for the efficient handling of mental health illnesses such as depression. However, the current research fails to adequately address the prediction of mental health conditions from social media data in…

Computation and Language · Computer Science 2024-04-16 Zita Lifelo , Huansheng Ning , Sahraoui Dhelim

In the last decade, the generalization and adaptation abilities of deep learning models were typically evaluated on fixed training and test distributions. Contrary to traditional deep learning, large language models (LLMs) are (i) even more…

Computation and Language · Computer Science 2024-10-17 Fırat Öncel , Matthias Bethge , Beyza Ermis , Mirco Ravanelli , Cem Subakan , Çağatay Yıldız