English
Related papers

Related papers: Biomedical Interpretable Entity Representations

200 papers

We present a refined approach to biomedical question-answering (QA) services by integrating large language models (LLMs) with Multi-BERT configurations. By enhancing the ability to process and prioritize vast amounts of complex biomedical…

Computation and Language · Computer Science 2024-10-18 Cheng Qian , Xianglong Shi , Shanshan Yao , Yichen Liu , Fengming Zhou , Zishu Zhang , Junaid Akram , Ali Braytee , Ali Anaissi

Pretrained language models such as Bidirectional Encoder Representations from Transformers (BERT) have achieved state-of-the-art performance in natural language processing (NLP) tasks. Recently, BERT has been adapted to the biomedical…

Computation and Language · Computer Science 2023-02-06 Li Fang , Qingyu Chen , Chih-Hsuan Wei , Zhiyong Lu , Kai Wang

The success of pre-trained word embeddings has motivated its use in tasks in the biomedical domain. The BERT language model has shown remarkable results on standard performance metrics in tasks such as Named Entity Recognition (NER) and…

Computation and Language · Computer Science 2020-04-24 Vladimir Araujo , Andres Carvallo , Carlos Aspillaga , Denis Parra

The ability to interpret machine learning model decisions is critical in such domains as healthcare, where trust in model predictions is as important as their accuracy. Inspired by the development of prototype parts-based deep neural…

Machine Learning · Computer Science 2026-03-06 Jacek Karolczak , Jerzy Stefanowski

Automatically locating named entities in natural language text - named entity recognition - is an important task in the biomedical domain. Many named entity mentions are ambiguous between several bioconcept types, however, causing text…

Computation and Language · Computer Science 2019-09-24 Chih-Hsuan Wei , Kyubum Lee , Robert Leaman , Zhiyong Lu

External knowledge,e.g., entities and entity descriptions, can help humans understand texts. Many works have been explored to include external knowledge in the pre-trained models. These methods, generally, design pre-training tasks and…

Computation and Language · Computer Science 2022-08-19 Qinghua Zhao , Shuai Ma , Yuxuan Lei

Objective: The generalizability of clinical large language models is usually ignored during the model development process. This study evaluated the generalizability of BERT-based clinical NLP models across different clinical settings…

Computation and Language · Computer Science 2023-03-16 Sicheng Zhou , Nan Wang , Liwei Wang , Ju Sun , Anne Blaes , Hongfang Liu , Rui Zhang

The delivery of appropriate targeted therapies to cancer patients requires the complete analysis of the molecular profiling of tumors and the patient's clinical characteristics in the context of existing knowledge and recent findings…

Computation and Language · Computer Science 2024-12-13 Ting He , Kory Kreimeyer , Mimi Najjar , Jonathan Spiker , Maria Fatteh , Valsamo Anagnostou , Taxiarchis Botsis

Although deep learning techniques have shown significant achievements, they frequently depend on extensive amounts of hand-labeled data and tend to perform inadequately in few-shot scenarios. The objective of this study is to devise a…

Computation and Language · Computer Science 2024-10-28 Leilei Su , Jian Chen , Yifan Peng , Cong Sun

Named entity disambiguation (NED), which involves mapping textual mentions to structured entities, is particularly challenging in the medical domain due to the presence of rare entities. Existing approaches are limited by the presence of…

Computation and Language · Computer Science 2021-10-18 Maya Varma , Laurel Orr , Sen Wu , Megan Leszczynski , Xiao Ling , Christopher Ré

State-of-the-art models in NLP are now predominantly based on deep neural networks that are opaque in terms of how they come to make predictions. This limitation has increased interest in designing more interpretable deep models for NLP…

Computation and Language · Computer Science 2020-04-27 Jay DeYoung , Sarthak Jain , Nazneen Fatema Rajani , Eric Lehman , Caiming Xiong , Richard Socher , Byron C. Wallace

How can we find interpretable, domain-appropriate models of natural phenomena given some complex, raw data such as images? Can we use such models to derive scientific insight from the data? In this paper, we propose some methods for…

Machine Learning · Computer Science 2024-02-06 Christopher J. Soelistyo , Alan R. Lowe

Encoder-based transformer models are central to biomedical and clinical Natural Language Processing (NLP), as their bidirectional self-attention makes them well-suited for efficiently extracting structured information from unstructured text…

Disease name recognition and normalization, which is generally called biomedical entity linking, is a fundamental process in biomedical text mining. Recently, neural joint learning of both tasks has been proposed to utilize the mutual…

Computation and Language · Computer Science 2021-04-22 Shogo Ujiie , Hayate Iso , Shuntaro Yada , Shoko Wakamiya , Eiji Aramaki

Despite their strong linguistic capabilities, Large Language Models (LLMs) are computationally demanding and require substantial resources for fine-tuning, which is unadapted to privacy and budget constraints of many healthcare settings. To…

Computation and Language · Computer Science 2026-04-30 Pierre Epron , Adrien Coulet , Mehwish Alam

Medical entity linking is the task of identifying and standardizing medical concepts referred to in an unstructured text. Most of the existing methods adopt a three-step approach of (1) detecting mentions, (2) generating a list of candidate…

Computation and Language · Computer Science 2021-08-24 Shikhar Vashishth , Denis Newman-Griffis , Rishabh Joshi , Ritam Dutt , Carolyn Rose

We have three contributions in this work: 1. We explore the utility of a stacked denoising autoencoder and a paragraph vector model to learn task-independent dense patient representations directly from clinical notes. To analyze if these…

Computation and Language · Computer Science 2018-07-05 Madhumita Sushil , Simon Šuster , Kim Luyckx , Walter Daelemans

Objective: Our study aimed to construct an exhaustive Complementary and Integrative Health (CIH) Lexicon (CIHLex) to better represent the often underrepresented physical and psychological CIH approaches in standard terminologies. We also…

Computation and Language · Computer Science 2023-11-15 Huixue Zhou , Robin Austin , Sheng-Chieh Lu , Greg Silverman , Yuqi Zhou , Halil Kilicoglu , Hua Xu , Rui Zhang

Deep learning (DL) based predictive models from electronic health records (EHR) deliver impressive performance in many clinical tasks. Large training cohorts, however, are often required to achieve high accuracy, hindering the adoption of…

Computation and Language · Computer Science 2020-05-27 Laila Rasmy , Yang Xiang , Ziqian Xie , Cui Tao , Degui Zhi

Entities lie in the heart of biomedical natural language understanding, and the biomedical entity linking (EL) task remains challenging due to the fine-grained and diversiform concept names. Generative methods achieve remarkable…

Computation and Language · Computer Science 2022-05-24 Hongyi Yuan , Zheng Yuan , Sheng Yu