中文
相关论文

相关论文: LLM-Mini-CEX: Automatic Evaluation of Large Langua…

200 篇论文

Automatic evaluation is an integral aspect of dialogue system research. The traditional reference-based NLG metrics are generally found to be unsuitable for dialogue assessment. Consequently, recent studies have suggested various unique,…

计算与语言 · 计算机科学 2024-01-23 Chen Zhang , Luis Fernando D'Haro , Yiming Chen , Malu Zhang , Haizhou Li

While modern dialogue systems heavily rely on large language models (LLMs), their implementation often goes beyond pure LLM interaction. Developers integrate multiple LLMs, external tools, and databases. Therefore, assessment of the…

人工智能 · 计算机科学 2025-07-23 Roman Mayr , Michel Schimpf , Thomas Bohné

The integration of Large Language Models (LLMs) into healthcare settings has gained significant attention, particularly for question-answering tasks. Given the high-stakes nature of healthcare, it is essential to ensure that LLM-generated…

Large Language Models (LLMs) have showcased remarkable capabilities in various Natural Language Processing tasks. For automatic open-domain dialogue evaluation in particular, LLMs have been seamlessly integrated into evaluation frameworks,…

计算与语言 · 计算机科学 2024-07-08 John Mendonça , Alon Lavie , Isabel Trancoso

The recent success of large language models (LLMs) has shown great potential to develop more powerful conversational recommender systems (CRSs), which rely on natural language conversations to satisfy user needs. In this paper, we embark on…

计算与语言 · 计算机科学 2024-06-21 Xiaolei Wang , Xinyu Tang , Wayne Xin Zhao , Jingyuan Wang , Ji-Rong Wen

Background: Large Language Models (LLMs) are transforming artificial intelligence applications in healthcare due to their ability to understand, generate, and summarize complex medical text. They offer valuable support to clinicians,…

计算与语言 · 计算机科学 2026-04-14 Subin Santhosh , Farwa Abbas , Hussain Ahmad , Claudia Szabo

The widespread adoption of Large Language Models (LLMs) and publicly available ChatGPT have marked a significant turning point in the integration of Artificial Intelligence (AI) into people's everyday lives. This study examines the ability…

计算与语言 · 计算机科学 2025-10-28 Sandeep Kumar , Tirthankar Ghosal , Vinayak Goyal , Asif Ekbal

Rapid integration of large language models (LLMs) in health care is sparking global discussion about their potential to revolutionize health care quality and accessibility. At a time when improving health care quality and access remains a…

计算机与社会 · 计算机科学 2025-04-01 Troy Zada , Natalie Tam , Francois Barnard , Marlize Van Sittert , Venkat Bhat , Sirisha Rambhatla

Large language models (LLMs), such as ChatGPT, have received substantial attention due to their capabilities for understanding and generating human language. While there has been a burgeoning trend in research focusing on the employment of…

Large language models (LLMs) are gaining increasing interests to improve clinical efficiency for medical diagnosis, owing to their unprecedented performance in modelling natural language. Ensuring the safe and reliable clinical…

The integration of Large Language Models (LLMs) into the healthcare domain has the potential to significantly enhance patient care and support through the development of empathetic, patient-facing chatbots. This study investigates an…

计算与语言 · 计算机科学 2024-05-28 Man Luo , Christopher J. Warren , Lu Cheng , Haidar M. Abdul-Muhsin , Imon Banerjee

Large Language Models (LLMs) have demonstrated promise in medical knowledge assessments, yet their practical utility in real-world clinical decision-making remains underexplored. In this study, we evaluated the performance of three…

计算与语言 · 计算机科学 2025-12-30 Mengdi Chai , Ali R. Zomorrodi

Developing high-performing dialogue systems benefits from the automatic identification of undesirable behaviors in system responses. However, detecting such behaviors remains challenging, as it draws on a breadth of general knowledge and…

计算与语言 · 计算机科学 2023-09-14 Sarah E. Finch , Ellie S. Paek , Jinho D. Choi

Generative Artificial Intelligence is set to revolutionize healthcare delivery by transforming traditional patient care into a more personalized, efficient, and proactive process. Chatbots, serving as interactive conversational models, will…

The shortage of clinical workforce presents significant challenges in mental healthcare, limiting access to formal diagnostics and services. We aim to tackle this shortage by integrating a customized large language model (LLM) into the…

计算与语言 · 计算机科学 2025-05-02 Sichang Tu , Abigail Powers , Natalie Merrill , Negar Fani , Sierra Carter , Stephen Doogan , Jinho D. Choi

Evaluating large language models (LLMs) has recently emerged as a critical issue for safe and trustworthy application of LLMs in the medical domain. Although a variety of static medical question-answering (QA) benchmarks have been proposed,…

计算与语言 · 计算机科学 2025-12-12 Gyutaek Oh , Sangjoon Park , Byung-Hoon Kim

Universal healthcare access is critically needed, especially in resource-limited settings. Large Language Models (LLMs) offer promise for democratizing healthcare with advanced diagnostics, but their reliability requires thorough…

计算与语言 · 计算机科学 2025-03-17 Krishna Subedi

Large language models (LLMs), such as ChatGPT, have rapidly penetrated into people's work and daily lives over the past few years, due to their extraordinary conversational skills and intelligence. ChatGPT has become the fastest-growing…

计算与语言 · 计算机科学 2024-09-04 Wenxuan Wang

The recent progress of large language models (LLMs), including ChatGPT and GPT-4, in comprehending and responding to human instructions has been remarkable. Nevertheless, these models typically perform better in English and have not been…

计算与语言 · 计算机科学 2023-04-18 Honglin Xiong , Sheng Wang , Yitao Zhu , Zihao Zhao , Yuxiao Liu , Linlin Huang , Qian Wang , Dinggang Shen
‹ 上一页 1 2 3 10 下一页 ›