English
Related papers

Related papers: PrecLLM: A Privacy-Preserving Framework for Effici…

200 papers

Instruction tuning benefits from large and diverse datasets; however, creating such datasets involves a high cost of human labeling. While synthetic datasets generated by large language models (LLMs) have partly solved this issue, they…

Computation and Language · Computer Science 2024-08-28 Ritik Sachin Parkar , Jaehyung Kim , Jong Inn Park , Dongyeop Kang

Recent advances in Retrieval-Augmented Generation (RAG) have enabled large language models (LLMs) to ground outputs in clinical evidence. However, connecting LLMs with external databases introduces the risk of contextual leakage: a subtle…

Computation and Language · Computer Science 2026-03-17 Shaowei Guan , Yu Zhai , Hin Chi Kwok , Jiawei Du , Xinyu Feng , Jing Li , Harry Qin , Vivian Hui

Large Language Models (LLMs) have demonstrated remarkable performance across various domains, including healthcare. However, their ability to effectively represent structured non-textual data, such as the alphanumeric medical codes used in…

Medical consultation dialogues contain critical clinical information, yet their unstructured nature hinders effective utilization in diagnosis and treatment. Traditional methods, relying on rule-based or shallow machine learning techniques,…

Computation and Language · Computer Science 2025-04-24 Shuguang Zhao , Qiangzhong Feng , Zhiyang He , Peipei Sun , Yingying Wang , Xiaodong Tao , Xiaoliang Lu , Mei Cheng , Xinyue Wu , Yanyan Wang , Wei Liang

Healthcare systems continuously generate vast amounts of electronic health records (EHRs), commonly stored in the Fast Healthcare Interoperability Resources (FHIR) standard. Despite the wealth of information in these records, their…

Computation and Language · Computer Science 2025-01-24 Sara Kothari , Ayush Gupta

Unstructured notes within the electronic health record (EHR) contain rich clinical information vital for cancer treatment decision making and research, yet reliably extracting structured oncology data remains challenging due to extensive…

Most of the existing medication recommendation models are predicted with only structured data such as medical codes, with the remaining other large amount of unstructured or semi-structured data underutilization. To increase the utilization…

Computation and Language · Computer Science 2024-07-16 Yu-Tzu Lee

Large pre-trained language models (LMs) have been widely adopted in biomedical and clinical domains, introducing many powerful LMs such as bio-lm and BioELECTRA. However, the applicability of these methods to real clinical use cases is…

Computation and Language · Computer Science 2022-11-16 Samuel Cahyawijaya , Bryan Wilie , Holy Lovenia , Huan Zhong , MingQian Zhong , Yuk-Yu Nancy Ip , Pascale Fung

Pre-trained Large Language Models (LLMs) often struggle on out-of-domain datasets like healthcare focused text. We explore specialized pre-training to adapt smaller LLMs to different healthcare datasets. Three methods are assessed:…

Computation and Language · Computer Science 2024-04-01 Niall Taylor , Dan Schofield , Andrey Kormilitzin , Dan W Joyce , Alejo Nevado-Holgado

Large language models (LLMs) are increasingly used by researchers in the social sciences and humanities (SSH) for text analysis, particularly to automate text annotation. However, many researchers still face challenges in adopting LLMs,…

Computers and Society · Computer Science 2026-05-28 Qixiang Fang , Javier Garcia Bernardo , Erik-Jan van Kesteren

Automated clinical text anonymization has the potential to unlock the widespread sharing of textual health data for secondary usage while assuring patient privacy and safety. Despite the proposal of many complex and theoretically successful…

Computation and Language · Computer Science 2024-06-05 David Pissarra , Isabel Curioso , João Alveira , Duarte Pereira , Bruno Ribeiro , Tomás Souper , Vasco Gomes , André V. Carreiro , Vitor Rolla

As two important textual modalities in electronic health records (EHR), both structured data (clinical codes) and unstructured data (clinical narratives) have recently been increasingly applied to the healthcare domain. Most existing…

Computation and Language · Computer Science 2022-11-01 Sicen Liu , Xiaolong Wang , Yongshuai Hou , Ge Li , Hui Wang , Hui Xu , Yang Xiang , Buzhou Tang

The scarcity of high-quality annotated medical data, particularly in mental health, poses a significant bottleneck for training robust machine learning models. Privacy regulations restrict data sharing, making synthetic data generation a…

Healthcare alert systems (HAS) are undergoing rapid evolution, propelled by advancements in artificial intelligence (AI), Internet of Things (IoT) technologies, and increasing health consciousness. Despite significant progress, a…

Computers and Society · Computer Science 2024-08-26 Yulan Gao , Ziqiang Ye , Ming Xiao , Yue Xiao , Dong In Kim

Users interacting with large language models (LLMs) under their real identifiers often unknowingly risk disclosing private information. Automatically notifying users whether their queries leak privacy and which phrases leak what private…

Computation and Language · Computer Science 2025-08-11 Hang Zeng , Xiangyu Liu , Yong Hu , Chaoyue Niu , Fan Wu , Shaojie Tang , Guihai Chen

Hidden Markov Models (HMMs) are foundational tools for modeling sequential data with latent Markovian structure, yet fitting them to real-world data remains computationally challenging. In this work, we show that pre-trained large language…

Machine Learning · Computer Science 2026-04-27 Yijia Dai , Zhaolin Gao , Yahya Sattar , Sarah Dean , Jennifer J. Sun

Large Language Models (LLMs) are increasingly adopted for applications in healthcare, reaching the performance of domain experts on tasks such as question answering and document summarisation. Despite their success on these tasks, it is…

Computation and Language · Computer Science 2025-05-20 Aishik Nagar , Viktor Schlegel , Thanh-Tung Nguyen , Hao Li , Yuping Wu , Kuluhan Binici , Stefan Winkler

Natural Language Processing (NLP) is a key technique for developing Medical Artificial Intelligence (AI) systems that leverage Electronic Health Record (EHR) data to build diagnostic and prognostic models. NLP enables the conversion of…

Large Language Models (LLMs) have revolutionized numerous fields, yet their adaptation to specialized tasks in privacy-sensitive domains such as healthcare and finance remains constrained due to the scarcity of accessible training data…

Machine Learning · Computer Science 2026-03-03 Jinglong Luo , Zhuo Zhang , Yehong Zhang , Shiyu Liu , Ye Dong , Hui Wang , Yue Yu , Xun Zhou , Zenglin Xu

Objective: Clinical trials are essential for advancing pharmaceutical interventions, but they face a bottleneck in selecting eligible participants. Although leveraging electronic health records (EHR) for recruitment has gained popularity,…

Computation and Language · Computer Science 2026-01-15 Mojdeh Rahmanian , Seyed Mostafa Fakhrahmad , Seyedeh Zahra Mousavi