English
Related papers

Related papers: Towards Automated Anamnesis Summarization: BERT-ba…

200 papers

Extracting information from electronic health records (EHR) is a challenging task since it requires prior knowledge of the reports and some natural language processing algorithm (NLP). With the growing number of EHR implementations, such…

Machine Learning · Computer Science 2019-08-02 Sanghyun Choi , Nikita Ivkin , Vladimir Braverman , Michael A. Jacobs

The success of pre-trained word embeddings has motivated its use in tasks in the biomedical domain. The BERT language model has shown remarkable results on standard performance metrics in tasks such as Named Entity Recognition (NER) and…

Computation and Language · Computer Science 2020-04-24 Vladimir Araujo , Andres Carvallo , Carlos Aspillaga , Denis Parra

NLP in mental health has been primarily social media focused. Real world practitioners also have high case loads and often domain specific variables, of which modern LLMs lack context. We take a dataset made by recruiting 644 participants,…

Computation and Language · Computer Science 2024-06-19 Ankit Aich , Avery Quynh , Pamela Osseyi , Amy Pinkham , Philip Harvey , Brenda Curtis , Colin Depp , Natalie Parde

The digitalization of stored information in hospitals now allows for the exploitation of medical data in text format, as electronic health records (EHRs), initially gathered for other purposes than epidemiology. Manual search and analysis…

Large language models (LLMs) have shown remarkable capabilities in Natural Language Processing (NLP), especially in domains where labeled data is scarce or expensive, such as clinical domain. However, to unlock the clinical knowledge hidden…

Computation and Language · Computer Science 2023-09-18 Sonish Sivarajkumar , Mark Kelley , Alyssa Samolyk-Mazzanti , Shyam Visweswaran , Yanshan Wang

Extraction of concepts and entities of interest from non-formal texts such as social media posts and informal communication is an important capability for decision support systems in many domains, including healthcare, customer relationship…

Computation and Language · Computer Science 2024-01-11 Tamara Babaian , Jennifer Xu

Most current extractive summarization models generate summaries by selecting salient sentences. However, one of the problems with sentence-level extractive summarization is that there exists a gap between the human-written gold summary and…

Computation and Language · Computer Science 2020-11-20 Ruifeng Yuan , Zili Wang , Wenjie Li

Objective: We sought to develop a classification algorithm to extract diagnoses from free-text radiology reports of brain imaging performed in patients with acute respiratory failure (ARF) undergoing invasive mechanical ventilation.…

This paper presents a novel Natural Language Processing (NLP) framework for enhancing medical diagnosis through the integration of advanced techniques in data augmentation, feature extraction, and classification. The proposed approach…

Computation and Language · Computer Science 2025-02-12 Mohammad Ali Labbaf Khaniki , Sahabeh Saadati , Mohammad Manthouri

Natural Language Processing (NLP) has witnessed a transformative leap with the advent of transformer-based architectures, which have significantly enhanced the ability of machines to understand and generate human-like text. This paper…

Computation and Language · Computer Science 2025-03-27 Tianhao Wu , Yu Wang , Ngoc Quach

Pre-training large-scale neural language models on raw texts has made a significant contribution to improving transfer learning in natural language processing (NLP). With the introduction of transformer-based language models, such as…

Computation and Language · Computer Science 2024-05-08 Shoya Wada , Toshihiro Takeda , Shiro Manabe , Shozo Konishi , Jun Kamohara , Yasushi Matsumura

Named entity recognition (NER) stands as a fundamental and pivotal task within the realm of Natural Language Processing. Particularly within the domain of Biomedical Method NER, this task presents notable challenges, stemming from the…

Computation and Language · Computer Science 2024-07-01 Chen Tang , Bohao Yang , Kun Zhao , Bo Lv , Chenghao Xiao , Frank Guerin , Chenghua Lin

Adding linguistic information (syntax or semantics) to neural machine translation (NMT) has mostly focused on using point estimates from pre-trained models. Directly using the capacity of massive pre-trained contextual word embedding models…

Computation and Language · Computer Science 2021-04-08 Hassan S. Shavarani , Anoop Sarkar

Deep learning approaches are superior in NLP due to their ability to extract informative features and patterns from languages. The two most successful neural architectures are LSTM and transformers, used in large pretrained language models…

Computation and Language · Computer Science 2022-03-03 Matej Klemen , Luka Krsnik , Marko Robnik-Šikonja

Electronic Health Records are large repositories of valuable clinical data, with a significant portion stored in unstructured text format. This textual data includes clinical events (e.g., disorders, symptoms, findings, medications and…

Computation and Language · Computer Science 2024-09-02 Shubham Agarwal , Thomas Searle , Mart Ratas , Anthony Shek , James Teo , Richard Dobson

Burnout, classified as a syndrome in the ICD-11, arises from chronic workplace stress that has not been effectively managed. It is characterized by exhaustion, cynicism, and reduced professional efficacy, and estimates of its prevalence…

Large-scale clinical data is invaluable to driving many computational scientific advances today. However, understandable concerns regarding patient privacy hinder the open dissemination of such data and give rise to suboptimal siloed…

Computation and Language · Computer Science 2019-05-23 Oren Melamud , Chaitanya Shivade

The rapid advancement of large language models (LLMs) has opened new boundaries in the extraction and synthesis of medical knowledge, particularly within evidence synthesis. This paper reviews the state-of-the-art applications of LLMs in…

Transformer-based models have pushed state of the art in many areas of NLP, but our understanding of what is behind their success is still limited. This paper is the first survey of over 150 studies of the popular BERT model. We review the…

Computation and Language · Computer Science 2020-11-10 Anna Rogers , Olga Kovaleva , Anna Rumshisky

Backgrounds: Information extraction (IE) is critical in clinical natural language processing (NLP). While large language models (LLMs) excel on generative tasks, their performance on extractive tasks remains debated. Methods: We…