English
Related papers

Related papers: Towards Automatic Evaluation and Selection of PHI …

200 papers

Objective: Develop a cost-effective, large language model (LLM)-based pipeline for automatically extracting Review of Systems (ROS) entities from clinical notes. Materials and Methods: The pipeline extracts ROS section from the clinical…

Computation and Language · Computer Science 2026-05-15 Hieu Nghiem , Zhuqi Miao , Hemanth Reddy Singareddy , Jivan Lamichhane , Abdulaziz Ahmed , Johnson Thomas , Dursun Delen , William Paiva

Evaluating large language model (LLM)-based multi-agent systems remains a critical challenge, as these systems must exhibit reliable coordination, transparent decision-making, and verifiable performance across evolving tasks. Existing…

Artificial Intelligence · Computer Science 2026-01-21 YenTing Lee , Keerthi Koneru , Zahra Moslemi , Sheethal Kumar , Ramesh Radhakrishnan

Many research areas rely on data from the web to gain insights and test their methods. However, collecting comprehensive research datasets often demands manually reviewing many web pages to identify and record relevant data points, which is…

Multiagent Systems · Computer Science 2025-12-29 Sunith Vallabhaneni , Thomas Berkane , Maimuna Majumder

Ensuring clinical data privacy while preserving utility is critical for AI-driven healthcare and data analytics. Existing de-identification (De-ID) methods, including rule-based techniques, deep learning models, and large language models…

Artificial Intelligence · Computer Science 2025-07-28 Praphul Singh , Charlotte Dzialo , Jangwon Kim , Sumana Srivatsa , Irfan Bulu , Sri Gadde , Krishnaram Kenthapadi

Advancing large language models (LLMs) for the next point-of-interest (POI) recommendation task faces two fundamental challenges: (i) although existing methods produce semantic IDs that incorporate semantic information, their topology-blind…

Information Retrieval · Computer Science 2026-03-13 Peibo Li , Shuang Ao , Hao Xue , Yang Song , Maarten de Rijke , Johan Barthélemy , Tomasz Bednarz , Flora D. Salim

The increasing availability of sensitive textual data has created an urgent need for robust de-identification methods that enable compliant data sharing while preserving downstream utility. This paper presents DeID-Clinic, a multi-layered…

Computation and Language · Computer Science 2026-05-26 Angel Paul , Dhivin Shaji , Lifeng Han , Warren Del-Pinto , Goran Nenadic , Suzan Verberne

Large language models (LLMs) offer an inexpensive yet powerful way to annotate text, but are often inconsistent when compared with experts. These errors can bias downstream estimates of population parameters such as regression coefficients…

Computation and Language · Computer Science 2025-09-22 Nicolas Audinet de Pieuchon , Adel Daoud , Connor T. Jerzak , Moa Johansson , Richard Johansson

Large Language Model (LLM) agents deployed for real-world tasks face a fundamental dilemma: user requests are underspecified, yet agents must decide whether to act on incomplete information or interrupt users for clarification. Existing…

Computation and Language · Computer Science 2026-01-13 Yijiang River Dong , Tiancheng Hu , Zheng Hui , Caiqi Zhang , Ivan Vulić , Andreea Bobu , Nigel Collier

Automated deidentification of clinical text data is crucial due to the high cost of manual deidentification, which has been a barrier to sharing clinical text and the advancement of clinical natural language processing. However, creating…

Computation and Language · Computer Science 2023-11-07 Callandra Moore , Jonathan Ranisau , Walter Nelson , Jeremy Petch , Alistair Johnson

To fully leverage the advantages of large-scale pre-trained language models (PLMs) on downstream tasks, it has become a ubiquitous adaptation paradigm to fine-tune the entire parameters of PLMs. However, this paradigm poses issues of…

Computation and Language · Computer Science 2023-05-09 Anchun Gui , Han Xiao

Large Language Models (LLMs) can be fine-tuned on domain-specific data to enhance their performance in specialized fields. However, such data often contains numerous low-quality samples, necessitating effective data processing (DP). In…

Machine Learning · Computer Science 2026-05-08 Wei Huang , Anda Cheng , Yinggui Wang , Lei Wang , Tao Wei

Large Language Models (LLMs) have demonstrated their efficacy across a broad spectrum of tasks in healthcare applications. However, often LLMs need to be fine-tuned on task-specific expert annotated data to achieve optimal performance,…

Machine Learning · Computer Science 2024-08-06 Bhawesh Kumar , Jonathan Amar , Eric Yang , Nan Li , Yugang Jia

Thematic analysis (TA) is a widely used qualitative approach for uncovering latent meanings in unstructured text data. TA provides valuable insights in healthcare but is resource-intensive. Large Language Models (LLMs) have been introduced…

Human-Computer Interaction · Computer Science 2025-03-27 Huimin Xu , Seungjun Yi , Terence Lim , Jiawei Xu , Andrew Well , Carlos Mery , Aidong Zhang , Yuji Zhang , Heng Ji , Keshav Pingali , Yan Leng , Ying Ding

Large language models (LLMs) have shown strong performance on clinical de-identification, the task of identifying sensitive identifiers to protect privacy. However, previous work has not examined their generalizability between formats,…

Computation and Language · Computer Science 2026-02-19 Noopur Zambare , Kiana Aghakasiri , Carissa Lin , Carrie Ye , J. Ross Mitchell , Mohamed Abdalla

Background : De-identification of DICOM (Digital Imaging and Communi-cations in Medicine) files is an essential component of medical image research. Personal Identifiable Information (PII) and/or Personal Health Identifying Information…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Bufano Michele , Kotter Elmar

In the context of text classification, the financial burden of annotation exercises for creating training data is a critical issue. Active learning techniques, particularly those rooted in uncertainty sampling, offer a cost-effective…

Computation and Language · Computer Science 2024-06-19 Hamidreza Rouzegar , Masoud Makrehchi

Identifying medication discontinuations in electronic health records (EHRs) is vital for patient safety but is often hindered by information being buried in unstructured notes. This study aims to evaluate the capabilities of advanced…

Computation and Language · Computer Science 2025-11-10 Chong Shao , Douglas Snyder , Chiran Li , Bowen Gu , Kerry Ngan , Chun-Ting Yang , Jiageng Wu , Richard Wyss , Kueiyu Joshua Lin , Jie Yang

Measuring innovation often relies on context-specific proxies and on expert evaluation. Hence, empirical innovation research is often limited to settings where such data is available. We investigate how large language models (LLMs) can be…

Computation and Language · Computer Science 2025-08-05 Robin Nowak , Patrick Figge , Carolin Haeussler

We introduce TeMLM, a set of transparency-first release artifacts for clinical language models. TeMLM unifies provenance, data transparency, modeling transparency, and governance into a single, machine-checkable release bundle. We define an…

Recent advances in large language models (LLMs) have yielded impressive performance on various tasks, yet they often depend on high-quality feedback that can be costly. Self-refinement methods attempt to leverage LLMs' internal evaluation…

Computation and Language · Computer Science 2025-12-01 Hikaru Asano , Tadashi Kozuno , Yukino Baba