中文
相关论文

相关论文: Distilling Large Language Models for Biomedical Kn…

200 篇论文

Automatic detection of hate and abusive language is essential to combat its online spread. Moreover, recognising and explaining hate speech serves to educate people about its negative effects. However, most current detection models operate…

计算与语言 · 计算机科学 2025-05-06 Paloma Piot , Javier Parapar

Metadata play a crucial role in ensuring the findability, accessibility, interoperability, and reusability of datasets. This paper investigates the potential of large language models (LLMs), specifically GPT-4, to improve adherence to…

人工智能 · 计算机科学 2025-02-24 Sowmya S. Sundaram , Benjamin Solomon , Avani Khatri , Anisha Laumas , Purvesh Khatri , Mark A. Musen

Objective: To develop a natural language processing (NLP) system to extract medications and contextual information that help understand drug changes. This project is part of the 2022 n2c2 challenge. Materials and methods: We developed NLP…

计算与语言 · 计算机科学 2023-05-10 Aokun Chen , Zehao Yu , Xi Yang , Yi Guo , Jiang Bian , Yonghui Wu

The recent swift development of LLMs like GPT-4, Gemini, and GPT-3.5 offers a transformative opportunity in medicine and healthcare, especially in digital diagnostics. This study evaluates each model diagnostic abilities by interpreting a…

计算与语言 · 计算机科学 2024-05-14 Gaurav Kumar Gupta , Aditi Singh , Sijo Valayakkad Manikandan , Abul Ehtesham

Knowledge distillation allows smaller neural networks to emulate the performance of larger, teacher models with reduced computational demands. Traditional methods for Large Language Models (LLMs) often necessitate extensive fine-tuning,…

计算与语言 · 计算机科学 2025-05-02 Tyler McDonald , Ali Emami

This paper presents a novel approach to epidemic surveillance, leveraging the power of Artificial Intelligence and Large Language Models (LLMs) for effective interpretation of unstructured big data sources, like the popular ProMED and WHO…

计算工程、金融与科学 · 计算机科学 2024-08-27 Sergio Consoli , Peter Markov , Nikolaos I. Stilianakis , Lorenzo Bertolini , Antonio Puertas Gallardo , Mario Ceresa

Despite pre-trained language models such as BERT have achieved appealing performance in a wide range of natural language processing tasks, they are computationally expensive to be deployed in real-time applications. A typical method is to…

计算与语言 · 计算机科学 2021-06-22 Lingyun Feng , Minghui Qiu , Yaliang Li , Hai-Tao Zheng , Ying Shen

The push to compress and impart the proficiency of Large Language Models (LLMs) into more deployable and efficient Small Language Models (SLMs) has benefited from improvements in knowledge distillation (KD) techniques. These techniques…

人工智能 · 计算机科学 2025-07-02 Shreyansh Padarha

This paper describes a rapid feasibility study of using GPT-4, a large language model (LLM), to (semi)automate data extraction in systematic reviews. Despite the recent surge of interest in LLMs there is still a lack of understanding of how…

Accurate and comprehensive material databases extracted from research papers are crucial for materials science and engineering, but their development requires significant human effort. With large language models (LLMs) transforming the way…

Large language models having hundreds of millions, and even billions, of parameters have performed extremely well on a variety of natural language processing (NLP) tasks. Their widespread use and adoption, however, is hindered by the lack…

计算与语言 · 计算机科学 2022-12-23 Dan DeGenaro , Jugal Kalita

Adverse event (AE) extraction following COVID-19 vaccines from text data is crucial for monitoring and analyzing the safety profiles of immunizations. Traditional deep learning models are adept at learning intricate feature representations…

计算与语言 · 计算机科学 2024-06-27 Yiming Li , Deepthi Viswaroopan , William He , Jianfu Li , Xu Zuo , Hua Xu , Cui Tao

The use of Large language models (LLMs) to augment clinical decision support systems is a topic with rapidly growing interest, but current shortcomings such as hallucinations and lack of clear source citations make them unreliable for use…

人机交互 · 计算机科学 2024-09-25 Daniel Jung , Alex Butler , Joongheum Park , Yair Saperstein

Large Language Models (LLMs) have displayed remarkable performances across various complex tasks by leveraging Chain-of-Thought (CoT) prompting. Recently, studies have proposed a Knowledge Distillation (KD) approach, reasoning distillation,…

计算与语言 · 计算机科学 2024-10-14 Hojae Lee , Junho Kim , SangKeun Lee

The exponential growth of online textual content across diverse domains has necessitated advanced methods for automated text classification. Large Language Models (LLMs) based on transformer architectures have shown significant success in…

计算与语言 · 计算机科学 2025-09-09 Zhyar Rzgar K Rostam , Gábor Kertész

Large language models (LLMs) demonstrate remarkable reasoning capabilities in tasks such as algorithmic coding and mathematical problem-solving. Recent methods have improved reasoning through expanded corpus and multistage training…

This paper introduces a system that integrates large language models (LLMs) into the clinical trial retrieval process, enhancing the effectiveness of matching patients with eligible trials while maintaining information privacy and allowing…

信息检索 · 计算机科学 2024-11-01 Georgios Peikos , Pranav Kasela , Gabriella Pasi

Large Language Models (LLMs) enable advanced natural language processing but face deployment challenges on resource-constrained edge devices due to high computational, memory, and energy demands. Optimizing these models requires addressing…

机器学习 · 计算机科学 2026-01-16 Jacob Sander , Brian Jalaian , Venkat R. Dasari

Extracting patient information from unstructured text is a critical task in health decision-support and clinical research. Large language models (LLMs) have shown the potential to accelerate clinical curation via few-shot in-context…

计算与语言 · 计算机科学 2023-06-21 Zelalem Gero , Chandan Singh , Hao Cheng , Tristan Naumann , Michel Galley , Jianfeng Gao , Hoifung Poon

Large Language Models (LLMs) like OpenAI's GPT series, Anthropic's Claude, and Meta's LLaMa have shown remarkable capabilities in text generation. However, their susceptibility to toxic prompts presents significant security challenges. This…

密码学与安全 · 计算机科学 2024-12-03 Jie Li , Yi Liu , Chongyang Liu , Xiaoning Ren , Ling Shi , Weisong Sun , Yinxing Xue