中文
相关论文

相关论文: From Memorization to Generalization: Fine-Tuning L…

200 篇论文

Large Language Models (LLMs) perform well on reasoning benchmarks but often fail when inputs alter slightly, raising concerns about the extent to which their success relies on memorization. This issue is especially acute in Chain-of-Thought…

计算与语言 · 计算机科学 2025-08-22 Huihan Li , You Chen , Siyuan Wang , Yixin He , Ninareh Mehrabi , Rahul Gupta , Xiang Ren

As Large Language Models (LLMs) are increasingly integrated into healthcare to address complex inquiries, ensuring their reliability remains a critical challenge. Recent studies have highlighted that generic LLMs often struggle in clinical…

计算与语言 · 计算机科学 2026-04-01 Bian Sun , Zhenjian Wang , Orvill de la Torre , Zirui Wang

Sequence-to-sequence models with an implicit alignment mechanism (e.g. attention) are closing the performance gap towards traditional hybrid hidden Markov models (HMM) for the task of automatic speech recognition. One important factor to…

音频与语音处理 · 电气工程与系统科学 2020-05-21 Wilfried Michel , Ralf Schlüter , Hermann Ney

The application of large language models (LLMs) to healthcare information extraction has emerged as a promising approach. This study evaluates the classification performance of five open-source LLMs: GEMMA-3-27B-IT, LLAMA3-70B, LLAMA4-109B,…

计算与语言 · 计算机科学 2025-05-09 Yuting Guo , Abeed Sarker

Veterinary medical records represent a large data resource for application to veterinary and One Health clinical research efforts. Use of the data is limited by interoperability challenges including inconsistent data formats and data…

计算与语言 · 计算机科学 2025-08-22 Mayla R. Boguslav , Adam Kiehl , David Kott , G. Joseph Strecker , Tracy Webb , Nadia Saklou , Terri Ward , Michael Kirby

In the ongoing wave of impact driven by large language models (LLMs) like ChatGPT, the adaptation of LLMs to medical domain has emerged as a crucial research frontier. Since mainstream LLMs tend to be designed for general-purpose…

计算与语言 · 计算机科学 2023-12-04 Issey Sukeda , Masahiro Suzuki , Hiroki Sakaji , Satoshi Kodera

Ontology matching (OM) plays an essential role in enabling semantic interoperability and integration across heterogeneous knowledge sources, particularly in the biomedical domain which contains numerous complex concepts related to diseases…

人工智能 · 计算机科学 2026-04-03 Yiping Song , Jiaoyan Chen , Renate A. Schmidt

How can we train models to perform well on hard test data when hard training data is by definition difficult to label correctly? This question has been termed the scalable oversight problem and has drawn increasing attention as language…

计算与语言 · 计算机科学 2024-06-06 Peter Hase , Mohit Bansal , Peter Clark , Sarah Wiegreffe

The deployment of Large Language Models (LLMs) in mental health counseling faces the dual challenges of hallucinations and lack of empathy. While the former may be mitigated by RAG (retrieval-augmented generation) by anchoring answers in…

计算与语言 · 计算机科学 2026-01-06 Md Abdullah Al Kafi , Raka Moni , Sumit Kumar Banshal

This study investigated the application of Large Language Models (LLMs) for simplifying biomedical texts to enhance health literacy. Using a public dataset, which included plain language adaptations of biomedical abstracts, we developed and…

计算与语言 · 计算机科学 2025-12-19 Primoz Kocbek , Leon Kopitar , Gregor Stiglic

The reusability of state-of-the-art Pre-trained Language Models (PLMs) is often limited by their generalization problem, where their performance drastically decreases when evaluated on examples that differ from the training dataset, known…

计算与语言 · 计算机科学 2023-08-09 Somayeh Ghanbarzadeh , Hamid Palangi , Yan Huang , Radames Cruz Moreno , Hamed Khanpour

Large Language Models (LLMs) have demonstrated substantial progress in biomedical and clinical applications, motivating rigorous evaluation of their ability to answer nuanced, evidence-based questions. We curate a multi-source benchmark…

计算与语言 · 计算机科学 2025-09-16 Can Wang , Yiqun Chen

Large Language Models (LLMs) are increasingly adopted for applications in healthcare, reaching the performance of domain experts on tasks such as question answering and document summarisation. Despite their success on these tasks, it is…

计算与语言 · 计算机科学 2025-05-20 Aishik Nagar , Viktor Schlegel , Thanh-Tung Nguyen , Hao Li , Yuping Wu , Kuluhan Binici , Stefan Winkler

Large language models (LLMs) have shown considerable promise in clinical natural language processing, yet few domain-specific datasets exist to rigorously evaluate their performance on radiology tasks. In this work, we introduce an…

计算与语言 · 计算机科学 2025-11-18 Namu Park , Giridhar Kaushik Ramachandran , Kevin Lybarger , Fei Xia , Ozlem Uzuner , Meliha Yetisgen , Martin Gunn

Customizable role-playing in large language models (LLMs), also known as character generalization, is gaining increasing attention for its versatility and cost-efficiency in developing and deploying role-playing dialogue agents. This study…

计算与语言 · 计算机科学 2025-02-19 Xiaoyang Wang , Hongming Zhang , Tao Ge , Wenhao Yu , Dian Yu , Dong Yu

The biomedical field relies heavily on concept linking in various areas such as literature mining, graph alignment, information retrieval, question-answering, data, and knowledge integration. Although large language models (LLMs) have made…

计算与语言 · 计算机科学 2023-07-04 Qinyong Wang , Zhenxiang Gao , Rong Xu

Large language models have been adopted in the medical domain for clinical documentation to reduce clinician burden. However, studies have reported that LLMs often "forget" a significant amount of instruction-following ability when…

计算与语言 · 计算机科学 2026-04-03 Mengxian Lyu , Cheng Peng , Ziyi Chen , Mengyuan Zhang , Jieting Li Lu , Yonghui Wu

Large Language Models (LLMs) can enhance their capabilities as AI assistants by integrating external tools, allowing them to access a wider range of information. While recent LLMs are typically fine-tuned with tool usage examples during…

计算与语言 · 计算机科学 2025-02-27 Jie He , Jennifer Neville , Mengting Wan , Longqi Yang , Hui Liu , Xiaofeng Xu , Xia Song , Jeff Z. Pan , Pei Zhou

The fine-tuning of Large Language Models (LLMs) has enabled them to recently achieve milestones in natural language processing applications. The emergence of ever larger LLMs has paved the way for more efficient fine-tuning methods. Among…

计算与语言 · 计算机科学 2024-02-01 Christophe Tribes , Sacha Benarroch-Lelong , Peng Lu , Ivan Kobyzev

Drug repurposing is often framed as a candidate identification task, but existing approaches provide limited guidance for distinguishing biologically plausible candidates from historically well-connected ones. Here we introduce DrugKLM, a…