English
Related papers

Related papers: Extracting Biomedical Factual Knowledge Using Pret…

200 papers

Tuning pre-trained language models (PLMs) with task-specific prompts has been a promising approach for text classification. Particularly, previous studies suggest that prompt-tuning has remarkable superiority in the low-data scenario over…

Computation and Language · Computer Science 2022-03-21 Shengding Hu , Ning Ding , Huadong Wang , Zhiyuan Liu , Jingang Wang , Juanzi Li , Wei Wu , Maosong Sun

In this work, we evaluate the potential of Large Language Models (LLMs) in building Bayesian Networks (BNs) by approximating domain expert priors. LLMs have demonstrated potential as factual knowledge bases; however, their capability to…

Computation and Language · Computer Science 2025-08-12 Aliakbar Nafar , Kristen Brent Venable , Zijun Cui , Parisa Kordjamshidi

The grammatical knowledge of language models (LMs) is often measured using a benchmark of linguistic minimal pairs, where the LMs are presented with a pair of acceptable and unacceptable sentences and required to judge which is more…

Computation and Language · Computer Science 2025-02-10 Yusuke Ide , Yuto Nishida , Justin Vasselli , Miyu Oba , Yusuke Sakai , Hidetaka Kamigaito , Taro Watanabe

As two important textual modalities in electronic health records (EHR), both structured data (clinical codes) and unstructured data (clinical narratives) have recently been increasingly applied to the healthcare domain. Most existing…

Computation and Language · Computer Science 2022-11-01 Sicen Liu , Xiaolong Wang , Yongshuai Hou , Ge Li , Hui Wang , Hui Xu , Yang Xiang , Buzhou Tang

Large language models (LLMs) have made significant progress in various domains, including healthcare. However, the specialized nature of clinical language understanding tasks presents unique challenges and limitations that warrant further…

Computation and Language · Computer Science 2023-08-01 Yuqing Wang , Yun Zhao , Linda Petzold

Medical reasoning in large language models (LLMs) aims to emulate clinicians' diagnostic thinking, but current benchmarks such as MedQA-USMLE, MedMCQA, and PubMedQA often mix reasoning with factual recall. We address this by separating 11…

Despite demonstrating impressive capabilities, Large Language Models (LLMs) still often struggle to accurately express the factual knowledge they possess, especially in cases where the LLMs' knowledge boundaries are ambiguous. To improve…

Computation and Language · Computer Science 2025-05-26 Boyang Xue , Fei Mi , Qi Zhu , Hongru Wang , Rui Wang , Sheng Wang , Erxin Yu , Xuming Hu , Kam-Fai Wong

Large pre-trained language models have demonstrated their proficiency in storing factual knowledge within their parameters and achieving remarkable results when fine-tuned for downstream natural language processing tasks. Nonetheless, their…

Computation and Language · Computer Science 2023-09-29 Konstantinos Andriopoulos , Johan Pouwelse

Clinicians often need to retrieve patient-specific information from electronic health records (EHRs), a task that is time-consuming and error-prone. We present a locally deployable Clinical Contextual Question Answering (CCQA) framework…

Computation and Language · Computer Science 2026-03-30 Mikko Saukkoriipi , Nicole Hernandez , Jaakko Sahlsten , Kimmo Kaski , Otso Arponen

We present EHRMIND, a practical recipe for adapting large language models (LLMs) to complex clinical reasoning tasks using reinforcement learning with verifiable rewards (RLVR). While RLVR has succeeded in mathematics and coding, its…

Computation and Language · Computer Science 2025-06-02 Jiacheng Lin , Zhenbang Wu , Jimeng Sun

Large Language Models (LLMs) have recently been shown to produce estimates of psycholinguistic norms, such as valence, arousal, or concreteness, for words and multiword expressions, that correlate with human judgments. These estimates are…

Computation and Language · Computer Science 2026-03-13 Thomas Hikaru Clark , Carlos Arriaga , Javier Conde , Gonzalo Martínez , Pedro Reviriego

Large Language Models (LLMs) can generate text by transferring style attributes like formality resulting in formal or informal text. However, instructing LLMs to generate text that when spoken, is more intelligible in an acoustically…

Computation and Language · Computer Science 2024-08-09 Anupama Chingacham , Miaoran Zhang , Vera Demberg , Dietrich Klakow

Document-level biomedical concept extraction is the task of identifying biomedical concepts mentioned in a given document. Recent advancements have adapted pre-trained language models for this task. However, the scarcity of domain-specific…

Computation and Language · Computer Science 2024-07-04 Qiwei Shao , Fengran Mo , Jian-Yun Nie

In recent years, Large Language Models (LLMs) have garnered significant attention from the research community due to their exceptional performance and generalization capabilities. In this paper, we introduce a novel method for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-21 Egor Lakomkin , Chunyang Wu , Yassir Fathullah , Ozlem Kalinli , Michael L. Seltzer , Christian Fuegen

Recent Language Models (LMs) have shown impressive capabilities in generating texts with the knowledge internalized in parameters. Yet, LMs often generate the factually incorrect responses to the given queries, since their knowledge may be…

Computation and Language · Computer Science 2023-10-20 Jinheon Baek , Soyeong Jeong , Minki Kang , Jong C. Park , Sung Ju Hwang

Large Language Models (LLMs) are gaining significant popularity in recent years for specialized tasks using prompts due to their low computational cost. Standard methods like prefix tuning utilize special, modifiable tokens that lack…

Computation and Language · Computer Science 2024-10-14 Nusrat Jahan Prottasha , Asif Mahmud , Md. Shohanur Islam Sobuj , Prakash Bhat , Md Kowsher , Niloofar Yousefi , Ozlem Ozmen Garibay

Pre-trained language models (LMs) are used for knowledge intensive tasks like question answering, but their knowledge gets continuously outdated as the world changes. Prior work has studied targeted updates to LMs, injecting individual…

Computation and Language · Computer Science 2023-05-03 Yasumasa Onoe , Michael J. Q. Zhang , Shankar Padmanabhan , Greg Durrett , Eunsol Choi

Despite advances in machine learning (ML) and large language models (LLMs), rule-based natural language processing (NLP) systems remain active in clinical settings due to their interpretability and operational efficiency. However, their…

Computation and Language · Computer Science 2025-06-23 Jianlin Shi , Brian T. Bucher

Evidence-based medicine (EBM) is at the forefront of modern healthcare, emphasizing the use of the best available scientific evidence to guide clinical decisions. Due to the sheer volume and rapid growth of medical literature and the high…

Computation and Language · Computer Science 2025-05-29 Zihan Xu , Haotian Ma , Gongbo Zhang , Yihao Ding , Chunhua Weng , Yifan Peng

Large Language Models (LLMs) are increasingly deployed for clinical reasoning tasks, which inherently require eliciting calibrated probabilistic beliefs based on available evidence. However, real-world clinical data are frequently…

Artificial Intelligence · Computer Science 2026-03-19 Yuta Kobayashi , Vincent Jeanselme , Shalmali Joshi