中文
相关论文

相关论文: A Scalable Framework for Evaluating Health Languag…

200 篇论文

Large language models (LLMs) show promise for extracting clinically meaningful information from unstructured health records, yet their translation into real-world settings is constrained by the lack of scalable and trustworthy validation…

The emergence of large language models (LLMs) has significantly influenced numerous fields, including healthcare, by enhancing the capabilities of automated systems to process and generate human-like text. However, despite their…

信息检索 · 计算机科学 2025-04-23 Mohit Gupta , Akiko Aizawa , Rajiv Ratn Shah

Large language models (LLMs) have demonstrated strong performance on medical benchmarks, including question answering and diagnosis. To enable their use in clinical settings, LLMs are typically further adapted through continued pretraining…

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

计算与语言 · 计算机科学 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia

The utilization of large language models (LLMs) in the Healthcare domain has generated both excitement and concern due to their ability to effectively respond to freetext queries with certain professional knowledge. This survey outlines the…

计算与语言 · 计算机科学 2025-01-28 Kai He , Rui Mao , Qika Lin , Yucheng Ruan , Xiang Lan , Mengling Feng , Erik Cambria

The introduction of Large Language Models (LLMs), and the vast volume of publicly available medical data, amplified the application of NLP to the medical domain. However, LLMs are pretrained on data that are not explicitly relevant to the…

计算与语言 · 计算机科学 2023-12-12 Chris Solomou

Evaluating large language models (LLMs) on open-ended questions is difficult because response quality depends on the question's context. Binary scores and static rubrics fail to capture these context-dependent requirements. Existing methods…

计算与语言 · 计算机科学 2026-03-26 Shanghua Gao , Yuchang Su , Pengwei Sui , Curtis Ginder , Marinka Zitnik

Evaluating the output of generative large language models (LLMs) is challenging and difficult to scale. Many evaluations of LLMs focus on tasks such as single-choice question-answering or text classification. These tasks are not suitable…

信息检索 · 计算机科学 2025-01-20 Sebastian Heineking , Jonas Probst , Daniel Steinbach , Martin Potthast , Harrisen Scells

Since the inception of the Transformer architecture in 2017, Large Language Models (LLMs) such as GPT and BERT have evolved significantly, impacting various industries with their advanced capabilities in language understanding and…

计算与语言 · 计算机科学 2024-05-30 Yining Huang , Keke Tang , Meilian Chen , Boyuan Wang

Large language models (LLMs) process and predict sequences containing text to answer questions, and address tasks including document summarization, providing recommendations, writing software and solving quantitative problems. We provide a…

数值分析 · 数学 2026-02-02 Ricardo Baptista , Andrew Stuart , Son Tran

This position paper examines how large language models (LLMs) can support thematic analysis of unstructured clinical transcripts, a widely used but resource-intensive method for uncovering patterns in patient and provider narratives. We…

The integration of Large Language Models (LLMs) into healthcare holds significant potential to enhance diagnostic accuracy and support medical treatment planning. These AI-driven systems can analyze vast datasets, assisting clinicians in…

计算与语言 · 计算机科学 2025-04-15 Diogo Sousa , Guilherme Barbosa , Catarina Rocha , Dulce Oliveira

Free-text responses are commonly collected in psychological studies, providing rich qualitative insights that quantitative measures may not capture. Labeling curated topics of research interest in free-text data by multiple trained human…

Recently, Large Language Models (LLMs) have showcased remarkable capabilities in natural language understanding. While demonstrating proficiency in everyday conversations and question-answering situations, these models frequently struggle…

计算与语言 · 计算机科学 2023-08-28 Chaoyi Wu , Weixiong Lin , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with…

计算与语言 · 计算机科学 2025-05-06 Jian Guan , Junfei Wu , Jia-Nan Li , Chuanqi Cheng , Wei Wu

Large Language Models (LLMs) have demonstrated impressive capabilities in role-playing scenarios, particularly in simulating domain-specific experts using tailored prompts. This ability enables LLMs to adopt the persona of individuals with…

人工智能 · 计算机科学 2025-01-14 Xinyao Ma , Rui Zhu , Zihao Wang , Jingwei Xiong , Qingyu Chen , Haixu Tang , L. Jean Camp , Lucila Ohno-Machado

With the proliferation of large language models (LLMs) in the medical domain, there is increasing demand for improved evaluation techniques to assess their capabilities. However, traditional metrics like F1 and ROUGE, which rely on token…

计算与语言 · 计算机科学 2025-05-20 Xiechi Zhang , Zetian Ouyang , Linlin Wang , Gerard de Melo , Zhu Cao , Xiaoling Wang , Ya Zhang , Yanfeng Wang , Liang He

Generative Artificial Intelligence is set to revolutionize healthcare delivery by transforming traditional patient care into a more personalized, efficient, and proactive process. Chatbots, serving as interactive conversational models, will…

Large language models (LLMs) can capture rich representations of concepts that are useful for real-world tasks. However, language alone is limited. While existing LLMs excel at text-based inferences, health applications require that models…

The intricate relationship between genetic variation and human diseases has been a focal point of medical research, evidenced by the identification of risk genes regarding specific diseases. The advent of advanced genome sequencing…

定量方法 · 定量生物学 2024-01-19 Jiayu Chang , Shiyu Wang , Chen Ling , Zhaohui Qin , Liang Zhao