English
Related papers

Related papers: PrecLLM: A Privacy-Preserving Framework for Effici…

200 papers

Recently, Large Language Models (LLM) have demonstrated impressive capability to solve a wide range of tasks. However, despite their success across various tasks, no prior work has investigated their capability in the biomedical domain yet.…

Computation and Language · Computer Science 2024-02-21 Israt Jahan , Md Tahmid Rahman Laskar , Chun Peng , Jimmy Huang

Large volumes of text data have contributed significantly to the development of large language models (LLMs) in recent years. This data is typically acquired by scraping the internet, leading to pretraining datasets comprised of noisy web…

Computation and Language · Computer Science 2023-09-12 Max Marion , Ahmet Üstün , Luiza Pozzobon , Alex Wang , Marzieh Fadaee , Sara Hooker

Parameter-Efficient Fine-Tuning (PEFT) provides a practical way for users to customize Large Language Models (LLMs) with their private data in LLM service scenarios. However, the inherently sensitive nature of private data demands robust…

Computation and Language · Computer Science 2025-10-13 Yansong Li , Zhixing Tan , Paula Branco , Yang Liu

Large Language Models (LLMs) have shown impressive abilities in data annotation, opening the way for new approaches to solve classic NLP problems. In this paper, we show how to use LLMs to create NuNER, a compact language representation…

Computation and Language · Computer Science 2024-02-26 Sergei Bogdanov , Alexandre Constantin , Timothée Bernard , Benoit Crabbé , Etienne Bernard

Extracting structured medical insights from unstructured clinical text using Natural Language Processing (NLP) remains an open challenge in healthcare, particularly in non-English contexts where resources are scarce. This study presents a…

Artificial Intelligence · Computer Science 2025-11-21 Paulina Tworek , Miłosz Bargieł , Yousef Khan , Tomasz Pełech-Pilichowski , Marek Mikołajczyk , Roman Lewandowski , Jose Sousa

Long text classification is challenging for Large Language Models (LLMs) due to token limits and high computational costs. This study explores whether a Retrieval Augmented Generation (RAG) approach using only the most relevant text…

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

Artificial Intelligence · Computer Science 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

The application of Artificial Intelligence (AI) in healthcare has been revolutionary, especially with the recent advancements in transformer-based Large Language Models (LLMs). However, the task of understanding unstructured electronic…

Computation and Language · Computer Science 2023-08-08 Shivani Shekhar , Simran Tiwari , T. C. Rensink , Ramy Eskander , Wael Salloum

Clinical natural language processing requires methods that can address domain-specific challenges, such as complex medical terminology and clinical contexts. Recently, large language models (LLMs) have shown promise in this domain. Yet,…

Computation and Language · Computer Science 2025-01-28 Ran Xu , Hejie Cui , Yue Yu , Xuan Kan , Wenqi Shi , Yuchen Zhuang , Wei Jin , Joyce Ho , Carl Yang

The community explored to build private inference frameworks for transformer-based large language models (LLMs) in a server-client setting, where the server holds the model parameters and the client inputs its private data (or prompt) for…

Machine Learning · Computer Science 2023-12-18 Xuanqi Liu , Zhuotao Liu

Fine-tuning large language models (LLMs) raises privacy concerns due to the risk of exposing sensitive training data. Federated learning (FL) mitigates this risk by keeping training samples on local devices, while facing the following…

Cryptography and Security · Computer Science 2025-05-15 Zhichao You , Xuewen Dong , Ke Cheng , Xutong Mu , Jiaxuan Fu , Shiyang Ma , Qiang Qu , Yulong Shen

Large language models (LLMs) power modern AI applications, but processing sensitive data on untrusted servers raises privacy concerns. Homomorphic encryption (HE) enables computation on encrypted data for secure inference. However, neural…

Machine Learning · Computer Science 2025-11-19 Matan Avitan , Moran Baruch , Nir Drucker , Itamar Zimerman , Yoav Goldberg

Scientific research indicates that for every hour spent in direct patient care, physicians spend nearly two additional hours on administrative tasks, particularly on electronic health records (EHRs) and desk work. This excessive…

Computation and Language · Computer Science 2025-09-25 Hui Yi Leong , Yi Fan Gao , Ji Shuai , Yang Zhang , Uktu Pamuksuz

As large language models (LLMs) become progressively more embedded in clinical decision-support, documentation, and patient-information systems, ensuring their privacy and trustworthiness has emerged as an imperative challenge for the…

Cryptography and Security · Computer Science 2025-10-22 Alexander Nemecek , Zebin Yun , Zahra Rahmani , Yaniv Harel , Vipin Chaudhary , Mahmood Sharif , Erman Ayday

The current pretraining paradigm for large language models relies on massive compute and internet-scale raw text, creating a significant barrier to foundational research. In contrast, biological systems demonstrate highly sample-efficient…

Computation and Language · Computer Science 2026-05-21 Guan Wang , Changling Liu , Chenyu Wang , Cai Zhou , Yuhao Sun , Yifei Wu , Shuai Zhen , Luca Scimeca , Yasin Abbasi Yadkori

Interactions with online Large Language Models raise privacy issues where providers can gather sensitive information about users and their companies from the prompts. While textual prompts can be sanitized using Differential Privacy, we…

Cryptography and Security · Computer Science 2025-06-16 Robin Carpentier , Benjamin Zi Hao Zhao , Hassan Jameel Asghar , Dali Kaafar

Patient-trial matching requires reasoning over long, heterogeneous electronic health records (EHRs) and complex eligibility criteria, posing significant challenges for scalability, generalization, and computational efficiency. Existing…

Computation and Language · Computer Science 2026-04-27 Xiaodi Li , Yang Xiao , Munhwan Lee , Konstantinos Leventakos , Young J. Juhn , David Jones , Terence T. Sio , Wei Liu , Maria Vassilaki , Nansu Zong

Large language models (LLMs) have revolutionized the landscape of Natural Language Processing systems, but are computationally expensive. To reduce the cost without sacrificing performance, previous studies have explored various approaches…

Computation and Language · Computer Science 2024-10-01 Chia-Hsuan Lee , Hao Cheng , Mari Ostendorf

Modern software systems generate massive volumes of runtime logs, necessitating efficient and accurate log parsing to enable critical downstream tasks such as anomaly detection and root cause analysis. Recently, large language models (LLMs)…

Software Engineering · Computer Science 2025-09-17 Yilun Wang , Pengfei Chen , Haiyu Huang , Zilong He , Gou Tan , Chuanfu Zhang , Jingkai He , Zibin Zheng

Large Language Models have advanced clinical text classification, but their opaque predictions remain a critical barrier to practical adoption in research and clinical settings where investigators and physicians need to understand which…

Computation and Language · Computer Science 2025-11-18 Karthikeyan K , Raghuveer Thirukovalluru , David Carlson