中文
相关论文

相关论文: H-DDx: A Hierarchical Evaluation Framework for Dif…

200 篇论文

While Large Language Models (LLMs) are fundamentally next-token prediction systems, their practical applications extend far beyond this basic function. From natural language processing and text generation to conversational assistants and…

计算与语言 · 计算机科学 2025-03-10 Vishakha Agrawal , Archie Chaudhury , Shreya Agrawal

Large language models (LLMs) have emerged as powerful tools for analyzing complex datasets. Recent studies demonstrate their potential to generate useful, personalized responses when provided with patient-specific health information that…

Large Language Models (LLMs) demonstrate strong generalization and reasoning abilities, making them well-suited for complex decision-making tasks such as medical consultation (MC). However, existing LLM-based methods often fail to capture…

计算与语言 · 计算机科学 2025-10-13 Zhihao Jia , Mingyi Jia , Junwen Duan , Jianxin Wang

Evaluating Large Language Models (LLMs) for mental health support is challenging due to the emotionally and cognitively complex nature of therapeutic dialogue. Existing benchmarks are limited in scale, reliability, often relying on…

Building effective clinical decision support systems requires the synthesis of complex heterogeneous multimodal data. Such modalities include temporal electronic health records data, medical images, radiology reports, and clinical notes.…

人工智能 · 计算机科学 2026-05-12 Baraa Al Jorf , Farah E. Shamout

Hierarchy is a common and effective way of organizing data and representing their relationships at different levels of abstraction. However, hierarchical data dependencies cause difficulties in the estimation of "separable" models that can…

信息检索 · 计算机科学 2016-09-05 Mostafa Dehghani , Hosein Azarbonyad , Jaap Kamps , Maarten Marx

In trustworthy medical diagnosis systems, integrating out-of-distribution (OOD) detection aims to identify unknown diseases in samples, thereby mitigating the risk of misdiagnosis. In this study, we propose a novel OOD detection framework…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Runhe Lai , Xinhua Lu , Kanghao Chen , Qichao Chen , Wei-Shi Zheng , Ruixuan Wang

Accurate International Classification of Diseases (ICD) coding is critical for clinical documentation, billing, and healthcare analytics, yet it remains a labour-intensive and error-prone task. Although large language models (LLMs) show…

We introduce OPENXRD, a comprehensive benchmarking framework for evaluating large language models (LLMs) and multimodal LLMs (MLLMs) in crystallography question answering. The framework measures context assimilation, or how models use…

计算与语言 · 计算机科学 2026-03-11 Ali Vosoughi , Ayoub Shahnazari , Yufeng Xi , Zeliang Zhang , Griffin Hess , Chenliang Xu , Niaz Abdolrahim

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

计算与语言 · 计算机科学 2025-06-12 Yuxin Jiang

Fine-tuning of Large Language Models (LLMs) has become the default practice for improving model performance on a given task. However, performance improvement comes at the cost of training on vast amounts of annotated data which could be…

计算与语言 · 计算机科学 2025-04-25 Jose G. Moreno , Jesus Lovon , M'Rick Robin-Charlet , Christine Damase-Michel , Lynda Tamine

Accurate clinical coding is essential for healthcare documentation, billing, and decision-making. While prior work shows that off-the-shelf LLMs struggle with this task, evaluations based on exact match metrics often overlook errors where…

计算与语言 · 计算机科学 2025-10-10 Zhangdie Yuan , Han-Chin Shing , Mitch Strong , Chaitanya Shivade

Most of the world's languages and dialects are low-resource, and lack support in mainstream machine translation (MT) models. However, many of them have a closely-related high-resource language (HRL) neighbor, and differ in linguistically…

计算与语言 · 计算机科学 2025-10-22 Niyati Bafna , Emily Chang , Nathaniel R. Robinson , David R. Mortensen , Kenton Murray , David Yarowsky , Hale Sirin

CXRs are a crucial and extraordinarily common diagnostic tool, leading to heavy research for CAD solutions. However, both high classification accuracy and meaningful model predictions that respect and incorporate clinical taxonomies are…

计算机视觉与模式识别 · 计算机科学 2021-01-01 Haomin Chen , Shun Miao , Daguang Xu , Gregory D. Hager , Adam P. Harrison

Clinical decision-making is a dynamic, interactive, and cyclic process where doctors have to repeatedly decide on which clinical action to perform and consider newly uncovered information for diagnosis and treatment. Large Language Models…

计算与语言 · 计算机科学 2026-03-03 David Bani-Harouni , Chantal Pellegrini , Ege Özsoy , Nassir Navab , Matthias Keicher

Deep learning frameworks serve as the foundation for developing and deploying deep learning applications. To enhance the quality of deep learning frameworks, researchers have proposed numerous testing methods using deep learning models as…

软件工程 · 计算机科学 2025-10-22 Yinglong Zou , Juan Zhai , Chunrong Fang , Yanzhou Mu , Jiawei Liu , Zhenyu Chen

Artificial intelligence holds great promise for expanding access to expert medical knowledge and reasoning. However, most evaluations of language models rely on static vignettes and multiple-choice questions that fail to reflect the…

As Large Language Models (LLMs) become increasingly integrated into real-world applications, ensuring their outputs align with human values and safety standards has become critical. The field has developed diverse alignment approaches…

Large language models (LLMs) are increasingly applied in mental health support systems, where reliable recognition of high-risk states such as suicidal ideation and self-harm is safety-critical. However, existing evaluations primarily rely…

人工智能 · 计算机科学 2026-03-12 Yihe Zhang , Cheyenne N Mohawk , Kaiying Han , Vijay Srinivas Tida , Manyu Li , Xiali Hei

Large language models (LLMs) have attracted growing interest as supportive tools for psychiatric assessment and clinical decision support. However, existing mental health benchmarks largely rely on social media data or supportive dialogue…

计算与语言 · 计算机科学 2026-05-19 Hoyun Song , Migyeong Kang , Jisu Shin , Jihyun Kim , Chanbi Park , Hangyeol Yoo , Jihyun An , Alice Oh , Jinyoung Han , KyungTae Lim