English
Related papers

Related papers: H-DDx: A Hierarchical Evaluation Framework for Dif…

200 papers

While Large Language Models (LLMs) are fundamentally next-token prediction systems, their practical applications extend far beyond this basic function. From natural language processing and text generation to conversational assistants and…

Computation and Language · Computer Science 2025-03-10 Vishakha Agrawal , Archie Chaudhury , Shreya Agrawal

Large language models (LLMs) have emerged as powerful tools for analyzing complex datasets. Recent studies demonstrate their potential to generate useful, personalized responses when provided with patient-specific health information that…

Large Language Models (LLMs) demonstrate strong generalization and reasoning abilities, making them well-suited for complex decision-making tasks such as medical consultation (MC). However, existing LLM-based methods often fail to capture…

Computation and Language · Computer Science 2025-10-13 Zhihao Jia , Mingyi Jia , Junwen Duan , Jianxin Wang

Evaluating Large Language Models (LLMs) for mental health support is challenging due to the emotionally and cognitively complex nature of therapeutic dialogue. Existing benchmarks are limited in scale, reliability, often relying on…

Building effective clinical decision support systems requires the synthesis of complex heterogeneous multimodal data. Such modalities include temporal electronic health records data, medical images, radiology reports, and clinical notes.…

Artificial Intelligence · Computer Science 2026-05-12 Baraa Al Jorf , Farah E. Shamout

Hierarchy is a common and effective way of organizing data and representing their relationships at different levels of abstraction. However, hierarchical data dependencies cause difficulties in the estimation of "separable" models that can…

Information Retrieval · Computer Science 2016-09-05 Mostafa Dehghani , Hosein Azarbonyad , Jaap Kamps , Maarten Marx

In trustworthy medical diagnosis systems, integrating out-of-distribution (OOD) detection aims to identify unknown diseases in samples, thereby mitigating the risk of misdiagnosis. In this study, we propose a novel OOD detection framework…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Runhe Lai , Xinhua Lu , Kanghao Chen , Qichao Chen , Wei-Shi Zheng , Ruixuan Wang

Accurate International Classification of Diseases (ICD) coding is critical for clinical documentation, billing, and healthcare analytics, yet it remains a labour-intensive and error-prone task. Although large language models (LLMs) show…

Artificial Intelligence · Computer Science 2025-09-24 Hong-Jie Dai , Zheng-Hao Li , An-Tai Lu , Bo-Tsz Shain , Ming-Ta Li , Tatheer Hussain Mir , Kuang-Te Wang , Min-I Su , Pei-Kang Liu , Ming-Ju Tsai

We introduce OPENXRD, a comprehensive benchmarking framework for evaluating large language models (LLMs) and multimodal LLMs (MLLMs) in crystallography question answering. The framework measures context assimilation, or how models use…

Computation and Language · Computer Science 2026-03-11 Ali Vosoughi , Ayoub Shahnazari , Yufeng Xi , Zeliang Zhang , Griffin Hess , Chenliang Xu , Niaz Abdolrahim

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

Computation and Language · Computer Science 2025-06-12 Yuxin Jiang

Fine-tuning of Large Language Models (LLMs) has become the default practice for improving model performance on a given task. However, performance improvement comes at the cost of training on vast amounts of annotated data which could be…

Computation and Language · Computer Science 2025-04-25 Jose G. Moreno , Jesus Lovon , M'Rick Robin-Charlet , Christine Damase-Michel , Lynda Tamine

Accurate clinical coding is essential for healthcare documentation, billing, and decision-making. While prior work shows that off-the-shelf LLMs struggle with this task, evaluations based on exact match metrics often overlook errors where…

Computation and Language · Computer Science 2025-10-10 Zhangdie Yuan , Han-Chin Shing , Mitch Strong , Chaitanya Shivade

Most of the world's languages and dialects are low-resource, and lack support in mainstream machine translation (MT) models. However, many of them have a closely-related high-resource language (HRL) neighbor, and differ in linguistically…

Computation and Language · Computer Science 2025-10-22 Niyati Bafna , Emily Chang , Nathaniel R. Robinson , David R. Mortensen , Kenton Murray , David Yarowsky , Hale Sirin

CXRs are a crucial and extraordinarily common diagnostic tool, leading to heavy research for CAD solutions. However, both high classification accuracy and meaningful model predictions that respect and incorporate clinical taxonomies are…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Haomin Chen , Shun Miao , Daguang Xu , Gregory D. Hager , Adam P. Harrison

Clinical decision-making is a dynamic, interactive, and cyclic process where doctors have to repeatedly decide on which clinical action to perform and consider newly uncovered information for diagnosis and treatment. Large Language Models…

Computation and Language · Computer Science 2026-03-03 David Bani-Harouni , Chantal Pellegrini , Ege Özsoy , Nassir Navab , Matthias Keicher

Deep learning frameworks serve as the foundation for developing and deploying deep learning applications. To enhance the quality of deep learning frameworks, researchers have proposed numerous testing methods using deep learning models as…

Software Engineering · Computer Science 2025-10-22 Yinglong Zou , Juan Zhai , Chunrong Fang , Yanzhou Mu , Jiawei Liu , Zhenyu Chen

Artificial intelligence holds great promise for expanding access to expert medical knowledge and reasoning. However, most evaluations of language models rely on static vignettes and multiple-choice questions that fail to reflect the…

As Large Language Models (LLMs) become increasingly integrated into real-world applications, ensuring their outputs align with human values and safety standards has become critical. The field has developed diverse alignment approaches…

Large language models (LLMs) are increasingly applied in mental health support systems, where reliable recognition of high-risk states such as suicidal ideation and self-harm is safety-critical. However, existing evaluations primarily rely…

Artificial Intelligence · Computer Science 2026-03-12 Yihe Zhang , Cheyenne N Mohawk , Kaiying Han , Vijay Srinivas Tida , Manyu Li , Xiali Hei

Large language models (LLMs) have attracted growing interest as supportive tools for psychiatric assessment and clinical decision support. However, existing mental health benchmarks largely rely on social media data or supportive dialogue…

Computation and Language · Computer Science 2026-05-19 Hoyun Song , Migyeong Kang , Jisu Shin , Jihyun Kim , Chanbi Park , Hangyeol Yoo , Jihyun An , Alice Oh , Jinyoung Han , KyungTae Lim