中文
相关论文

相关论文: Adapting Pretrained Language Models for Solving Ta…

200 篇论文

Large Transformers pretrained over clinical notes from Electronic Health Records (EHR) have afforded substantial gains in performance on predictive clinical tasks. The cost of training such models (and the necessity of data access to do so)…

计算与语言 · 计算机科学 2021-04-26 Eric Lehman , Sarthak Jain , Karl Pichotta , Yoav Goldberg , Byron C. Wallace

We explore state-of-the-art neural models for question answering on electronic medical records and improve their ability to generalize better on previously unseen (paraphrased) questions at test time. We enable this by learning to predict…

人工智能 · 计算机科学 2021-02-23 Bhanu Pratap Singh Rawat , Wei-Hung Weng , So Yeon Min , Preethi Raghavan , Peter Szolovits

The breadth, scale, and temporal granularity of modern electronic health records (EHR) systems offers great potential for estimating personalized and contextual patient health trajectories using sequential deep learning. However, learning…

Multiple adverse health conditions co-occurring in a patient are typically associated with poor prognosis and increased office or hospital visits. Developing methods to identify patterns of co-occurring conditions can assist in diagnosis.…

计算与语言 · 计算机科学 2017-11-30 Moumita Bhattacharya , Claudine Jurkovitz , Hagit Shatkay

Unsupervised pretraining is an integral part of many natural language processing systems, and transfer learning with language models has achieved remarkable results in many downstream tasks. In the clinical application of medical code…

计算与语言 · 计算机科学 2022-06-03 Shaoxiong Ji , Matti Hölttä , Pekka Marttinen

Recent advances in natural language processing (NLP) have been driven bypretrained language models like BERT, RoBERTa, T5, and GPT. Thesemodels excel at understanding complex texts, but biomedical literature, withits domain-specific…

计算与语言 · 计算机科学 2025-07-28 K. Sahit Reddy , N. Ragavenderan , Vasanth K. , Ganesh N. Naik , Vishalakshi Prabhu , Nagaraja G. S

In medical information extraction, medical Named Entity Recognition (NER) is indispensable, playing a crucial role in developing medical knowledge graphs, enhancing medical question-answering systems, and analyzing electronic medical…

计算与语言 · 计算机科学 2024-03-26 Xiaojing Du , Hanjie Zhao , Danyan Xing , Yuxiang Jia , Hongying Zan

Mental health is a critical issue in modern society, and mental disorders could sometimes turn to suicidal ideation without adequate treatment. Early detection of mental disorders and suicidal ideation from social content provides a…

计算与语言 · 计算机科学 2022-07-19 Shaoxiong Ji , Tianlin Zhang , Luna Ansari , Jie Fu , Prayag Tiwari , Erik Cambria

Domain adaptation is an effective solution to data scarcity in low-resource scenarios. However, when applied to token-level tasks such as bioNER, domain adaptation methods often suffer from the challenging linguistic characteristics that…

计算与语言 · 计算机科学 2022-11-14 Ngoc Dang Nguyen , Lan Du , Wray Buntine , Changyou Chen , Richard Beare

The research explores the utilization of a deep learning model employing an attention mechanism in medical text mining. It targets the challenge of analyzing unstructured text information within medical data. This research seeks to enhance…

计算与语言 · 计算机科学 2024-06-04 Lingxi Xiao , Muqing Li , Yinqiu Feng , Meiqi Wang , Ziyi Zhu , Zexi Chen

Advancements in machine learning algorithms have had a beneficial impact on representation learning, classification, and prediction models built using electronic health record (EHR) data. Effort has been put both on increasing models'…

机器学习 · 计算机科学 2021-03-24 Yiwen Meng , William Speier , Michael K. Ong , Corey W. Arnold

The objective of this work is to develop an Electronic Medical Record (EMR) data processing tool that confers clinical context to Machine Learning (ML) algorithms for error handling, bias mitigation and interpretability. We present…

Medical tabular data, abundant in Electronic Health Records (EHRs), is a valuable resource for diverse medical tasks such as risk prediction. While deep learning approaches, particularly transformer-based models, have shown remarkable…

计算与语言 · 计算机科学 2025-04-11 Yucheng Ruan , Xiang Lan , Daniel J. Tan , Hairil Rizal Abdullah , Mengling Feng

Question: Can an encoder-decoder architecture pretrained on a large dataset of longitudinal electronic health records improves patient outcome predictions? Findings: In this prognostic study of 6.8 million patients, our denoising…

人工智能 · 计算机科学 2022-12-26 Zhichao Yang , Weisong Liu , Dan Berlowitz , Hong Yu

This work investigates multiple approaches to Named Entity Recognition (NER) for text in Electronic Health Record (EHR) data. In particular, we look into the application of (i) rule-based, (ii) deep learning and (iii) transfer learning…

Recently, pretrained language models based on BERT have been introduced for the French biomedical domain. Although these models have achieved state-of-the-art results on biomedical and clinical NLP tasks, they are constrained by a limited…

计算与语言 · 计算机科学 2024-02-27 Adrien Bazoge , Emmanuel Morin , Beatrice Daille , Pierre-Antoine Gourraud

Electronic health records contain inconsistently structured or free-text data, requiring efficient preprocessing to enable predictive health care models. Although artificial intelligence-driven natural language processing tools show promise…

In the emergency department (ED), patients undergo triage and multiple laboratory tests before diagnosis. This time-consuming process causes ED crowding which impacts patient mortality, medical errors, staff burnout, etc. This work proposes…

计算与语言 · 计算机科学 2024-05-29 Liwen Sun , Abhineet Agarwal , Aaron Kornblith , Bin Yu , Chenyan Xiong

Objective: Temporal electronic health records (EHRs) can be a wealth of information for secondary uses, such as clinical events prediction or chronic disease management. However, challenges exist for temporal data representation. We…

机器学习 · 计算机科学 2024-06-11 Feng Xie , Han Yuan , Yilin Ning , Marcus Eng Hock Ong , Mengling Feng , Wynne Hsu , Bibhas Chakraborty , Nan Liu

Estimating effort based on requirement texts presents many challenges, especially in obtaining viable features to infer effort. Aiming to explore a more effective technique for representing textual requirements to infer effort estimates by…

软件工程 · 计算机科学 2020-07-01 Eliane M. De Bortoli Fávero , Dalcimar Casanova , Andrey Ricardo Pimentel