中文
相关论文

相关论文: MT-Clinical BERT: Scaling Clinical Information Ext…

200 篇论文

Effective clinical history taking is a foundational yet underexplored component of clinical reasoning. While large language models (LLMs) have shown promise on static benchmarks, they often fall short in dynamic, multi-turn diagnostic…

计算与语言 · 计算机科学 2026-01-30 Yang Zhou , Zhenting Sheng , Mingrui Tan , Yuting Song , Jun Zhou , Yu Heng Kwan , Lian Leng Low , Yang Bai , Yong Liu

Large Transformers pretrained over clinical notes from Electronic Health Records (EHR) have afforded substantial gains in performance on predictive clinical tasks. The cost of training such models (and the necessity of data access to do so)…

计算与语言 · 计算机科学 2021-04-26 Eric Lehman , Sarthak Jain , Karl Pichotta , Yoav Goldberg , Byron C. Wallace

This paper addresses the challenges posed by the unstructured nature and high-dimensional semantic complexity of electronic health record texts. A deep learning method based on attention mechanisms is proposed to achieve unified modeling…

计算与语言 · 计算机科学 2025-07-03 Ting Xu , Xiaoxiao Deng , Xiandong Meng , Haifeng Yang , Yan Wu

Parallel deep learning architectures like fine-tuned BERT and MT-DNN, have quickly become the state of the art, bypassing previous deep and shallow learning methods by a large margin. More recently, pre-trained models from large related…

信息检索 · 计算机科学 2019-07-04 Hemant Pugaliya , Karan Saxena , Shefali Garg , Sheetal Shalini , Prashant Gupta , Eric Nyberg , Teruko Mitamura

Deep learning (DL) based predictive models from electronic health records (EHR) deliver impressive performance in many clinical tasks. Large training cohorts, however, are often required to achieve high accuracy, hindering the adoption of…

计算与语言 · 计算机科学 2020-05-27 Laila Rasmy , Yang Xiang , Ziqian Xie , Cui Tao , Degui Zhi

Liver tumor segmentation, dynamic enhancement regression, and classification are critical for clinical assessment and diagnosis. However, no prior work has attempted to achieve these tasks simultaneously in an end-to-end framework,…

图像与视频处理 · 电气工程与系统科学 2025-11-27 Xiaojiao Xiao , Qinmin Vivian Hu , Tae Hyun Kim , Guanghui Wang

This study evaluated the effect of BioBERT in medical text processing for the task of medical named entity recognition. Through comparative experiments with models such as BERT, ClinicalBERT, SciBERT, and BlueBERT, the results showed that…

计算与语言 · 计算机科学 2024-12-12 Jiacheng Hu , Runyuan Bao , Yang Lin , Hanchao Zhang , Yanlin Xiang

Shortage of labeled data has been holding the surge of deep learning in healthcare back, as sample sizes are often small, patient information cannot be shared openly, and multi-center collaborative studies are a burden to set up.…

State-of-the-art studies have demonstrated the superiority of joint modelling over pipeline implementation for medical named entity recognition and normalization due to the mutual benefits between the two processes. To exploit these…

计算与语言 · 计算机科学 2018-12-17 Sendong Zhao , Ting Liu , Sicheng Zhao , Fei Wang

This study aims to explore the performance improvement method of large language models based on GPT-4 under the multi-task learning framework and conducts experiments on two tasks: text classification and automatic summary generation.…

计算与语言 · 计算机科学 2024-12-10 Zhen Qi , Jiajing Chen , Shuo Wang , Bingying Liu , Hongye Zheng , Chihang Wang

Clinical texts, represented in electronic medical records (EMRs), contain rich medical information and are essential for disease prediction, personalised information recommendation, clinical decision support, and medication pattern mining…

计算与语言 · 计算机科学 2023-10-10 Hangyu Tu , Lifeng Han , Goran Nenadic

We propose a unified cross-domain transfer learning framework that leverages knowledge from multiple heterogeneous medical imaging datasets to improve performance across segmentation, classification, and object detection tasks. Our approach…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Ceausescu Ciprian-Mihai , Anghelina Ion-Marian , Alexe Dumitru-Bogdan

Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are simultaneously learned by a shared model. Such approaches offer advantages like improved data efficiency, reduced overfitting through shared…

机器学习 · 计算机科学 2020-09-22 Michael Crawshaw

Although BERT is widely used by the NLP community, little is known about its inner workings. Several attempts have been made to shed light on certain aspects of BERT, often with contradicting conclusions. A much raised concern focuses on…

计算与语言 · 计算机科学 2020-10-13 Nikolaos Manginas , Ilias Chalkidis , Prodromos Malakasiotis

Clinicians are interested in better understanding complex diseases, such as cancer or rare diseases, so they need to produce and exchange data to mutualize sources and join forces. To do so and ensure privacy, a natural way consists in…

数据库 · 计算机科学 2025-09-29 Nelly Barret , Anna Bernasconi , Boris Bikbov , Pietro Pinoli

Multitask deep learning has been applied to patient outcome prediction from text, taking clinical notes as input and training deep neural networks with a joint loss function of multiple tasks. However, the joint training scheme of multitask…

计算与语言 · 计算机科学 2023-01-26 Shaoxiong Ji , Pekka Marttinen

Machine Reading Comprehension (MRC) aims to extract answers to questions given a passage. It has been widely studied recently, especially in open domains. However, few efforts have been made on closed-domain MRC, mainly due to the lack of…

计算与语言 · 计算机科学 2021-08-23 Taolin Zhang , Chengyu Wang , Minghui Qiu , Bite Yang , Xiaofeng He , Jun Huang

Multi-task Learning (MTL) for classification with disjoint datasets aims to explore MTL when one task only has one labeled dataset. In existing methods, for each task, the unlabeled datasets are not fully exploited to facilitate this task.…

计算机视觉与模式识别 · 计算机科学 2020-03-17 Yan Hong , Li Niu , Jianfu Zhang , Liqing Zhang

Clinical studies often require understanding elements of a patient's narrative that exist only in free text clinical notes. To transform notes into structured data for downstream use, these elements are commonly extracted and normalized to…

计算与语言 · 计算机科学 2020-08-03 Monica Agrawal , Chloe O'Connell , Yasmin Fatemi , Ariel Levy , David Sontag

Massive digital data processing provides a wide range of opportunities and benefits, but at the cost of endangering personal data privacy. Anonymisation consists in removing or replacing sensitive information from data, enabling its…

计算与语言 · 计算机科学 2020-03-18 Aitor García-Pablos , Naiara Perez , Montse Cuadros