English
Related papers

Related papers: Does Rationale Quality Matter? Enhancing Mental Di…

200 papers

Large language models (LLMs) have showcased remarkable capabilities in complex reasoning through chain of thought (CoT) prompting. Recently, there has been a growing interest in transferring these reasoning abilities from LLMs to smaller…

Computation and Language · Computer Science 2023-12-21 Hongzhan Chen , Siyue Wu , Xiaojun Quan , Rui Wang , Ming Yan , Ji Zhang

Large language models (LLMs) have demonstrated impressive capabilities in various reasoning tasks, aided by techniques like chain-of-thought prompting that elicits verbalized reasoning. However, LLMs often generate text with obvious…

Artificial Intelligence · Computer Science 2024-12-06 Zhihui Xie , Jizhou Guo , Tong Yu , Shuai Li

Deploying accurate Text-to-SQL systems at the enterprise level faces a difficult trilemma involving cost, security and performance. Current solutions force enterprises to choose between expensive, proprietary Large Language Models (LLMs)…

Computation and Language · Computer Science 2026-03-13 Khushboo Thaker , Yony Bresler

Large reasoning models such as DeepSeek-R1 and their distilled variants achieve strong performance on complex reasoning tasks. Yet, distilling these models often demands large-scale data for supervised fine-tuning (SFT), motivating the…

Computation and Language · Computer Science 2026-01-16 Lechen Zhang , Yunxiang Zhang , Wei Hu , Lu Wang

In psychological practices, standardized questionnaires serve as essential tools for assessing mental health through structured, clinically-validated questions (i.e., items). While social media platforms offer rich data for mental health…

Computation and Language · Computer Science 2025-06-03 Federico Ravenda , Seyed Ali Bahrainian , Andrea Raballo , Antonietta Mira , Noriko Kando

Large language models (LLMs) have achieved strong performance on medical exam-style tasks, motivating growing interest in their deployment in real-world clinical settings. However, clinical decision-making is inherently safety-critical,…

Computation and Language · Computer Science 2026-04-13 Xiaohan Ren , Chenxiao Fan , Wenyin Ma , Hongliang He , Chongming Gao , Xiaoyan Zhao , Fuli Feng

The diagnosis of most mental disorders, including psychiatric evaluations, primarily depends on dialogues between psychiatrists and patients. This subjective process can lead to variability in diagnoses across clinicians and patients,…

Artificial Intelligence · Computer Science 2025-10-30 Eranga Bandara , Ross Gore , Atmaram Yarlagadda , Anita H. Clayton , Preston Samuel , Christopher K. Rhea , Sachin Shetty

Background Major depressive disorder (MDD) is a leading cause of global disability, yet current diagnostic approaches often rely on subjective assessments and lack the ability to integrate multimodal clinical information. Large language…

Machine Learning · Computer Science 2025-09-30 Yuyang Sha , Hongxin Pan , Gang Luo , Caijuan Shi , Jing Wang , Kefeng Li

Recent studies suggest that the deeper layers of Large Language Models (LLMs) contribute little to representation learning and can often be removed without significant performance loss. However, such claims are typically drawn from narrow…

Artificial Intelligence · Computer Science 2026-01-28 Xinyuan Song , Keyu Wang , PengXiang Li , Lu Yin , Shiwei Liu

In enterprise search, building high-quality datasets at scale remains a central challenge due to the difficulty of acquiring labeled data. To resolve this challenge, we propose an efficient approach to fine-tune small language models (SLMs)…

Large Language Models (LLMs) display strikingly different generalization behaviors: supervised fine-tuning (SFT) often narrows capability, whereas reinforcement-learning (RL) tuning tends to preserve it. The reasons behind this divergence…

Machine Learning · Computer Science 2026-01-01 Haoyue Bai , Yiyou Sun , Wenjie Hu , Shi Qiu , Maggie Ziyu Huan , Peiyang Song , Robert Nowak , Dawn Song

We present a novel approach for training small language models for reasoning-intensive document ranking that combines knowledge distillation with reinforcement learning optimization. While existing methods often rely on expensive human…

Information Retrieval · Computer Science 2025-07-01 Chris Samarinas , Hamed Zamani

Deploying large language models (LLMs) is challenging because they are memory inefficient and compute-intensive for practical applications. In reaction, researchers train smaller task-specific models by either finetuning with human labels…

Computation and Language · Computer Science 2023-07-06 Cheng-Yu Hsieh , Chun-Liang Li , Chih-Kuan Yeh , Hootan Nakhost , Yasuhisa Fujii , Alexander Ratner , Ranjay Krishna , Chen-Yu Lee , Tomas Pfister

Recent advances in large language models (LLMs) have significantly enhanced automated legal reasoning. Yet, it remains unclear whether their performance reflects genuine legal reasoning ability or artifacts of data contamination. We present…

Artificial Intelligence · Computer Science 2026-05-18 Parisa Kordjamshidi , Samer Aslan , Madhavan Seshadri , Leslie Barrett , Enrico Santus

Despite the wide adoption of Large Language Models (LLM)s, clinical decision support systems face a critical challenge: achieving high predictive accuracy while generating explanations aligned with the predictions. Current approaches suffer…

Artificial Intelligence · Computer Science 2026-05-07 H M Quamran Hasan , Housam Khalifa Bashier , Jiayi Dai , Mi-Young Kim , Randy Goebel

Large Reasoning Models (LRMs) generate explicit reasoning traces alongside final answers, yet the extent to which these traces influence answer generation remains unclear. In this work, we conduct a three-stage investigation into the…

Artificial Intelligence · Computer Science 2025-09-30 Jue Zhang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

Small language models (SLMs) are promising for real-world deployment due to their efficiency and low operational cost. However, their limited capacity struggles with high-stakes legal reasoning tasks that require coherent statute…

Computation and Language · Computer Science 2026-04-28 Tianchun Li , Haochen Liu , Vishwa Pardeshi , Xingchen Wang , Tianci Liu , Huijun Zhao , Wei Fan , Jing Gao

Large Language Models (LLMs) have displayed remarkable performances across various complex tasks by leveraging Chain-of-Thought (CoT) prompting. Recently, studies have proposed a Knowledge Distillation (KD) approach, reasoning distillation,…

Computation and Language · Computer Science 2024-10-14 Hojae Lee , Junho Kim , SangKeun Lee

Social media platforms provide valuable insights into mental health trends by capturing user-generated discussions on conditions such as depression, anxiety, and suicidal ideation. Machine learning (ML) and deep learning (DL) models have…

Computation and Language · Computer Science 2025-04-28 Zhanyi Ding , Zhongyan Wang , Yeyubei Zhang , Yuchen Cao , Yunchong Liu , Xiaorui Shen , Yexin Tian , Jianglai Dai

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

Computation and Language · Computer Science 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song