English
Related papers

Related papers: Improving ICD coding using Chapter based Named Ent…

200 papers

Advances in language modeling have led to the development of deep attention-based models that are performant across a wide variety of natural language processing (NLP) problems. These language models are typified by a pre-training process…

Human-Computer Interaction · Computer Science 2020-09-16 Joseph F DeRose , Jiayao Wang , Matthew Berger

ICD coding is the international standard for capturing and reporting health conditions and diagnosis for revenue cycle management in healthcare. Manually assigning ICD codes is prone to human error due to the large code vocabulary and the…

Machine Learning · Computer Science 2021-03-16 Youngwoo Kim , Cheng Li , Bingyang Ye , Amir Tahmasebi , Javed Aslam

Log-based anomaly detection is fundamentally constrained by training data sparsity. Our empirical study reveals that public benchmark datasets cover less than 10% of source code log templates. Consequently, models frequently misclassify…

Software Engineering · Computer Science 2026-04-14 Xinyu Li , Yintong Huo , Chenxi Mao , Shiwen Shan , Yuxin Su , Yanlin Wang , Zibin Zheng

In this paper, we explore the task of mapping spoken language utterances to one of thousands of natural language understanding domains in intelligent personal digital assistants (IPDAs). This scenario is observed for many mainstream IPDAs…

Computation and Language · Computer Science 2018-04-24 Young-Bum Kim , Dongchan Kim , Anjishnu Kumar , Ruhi Sarikaya

Extracting phenotypes from clinical text has been shown to be useful for a variety of clinical use cases such as identifying patients with rare diseases. However, reasoning with numerical values remains challenging for phenotyping in…

Computation and Language · Computer Science 2022-04-22 Ashwani Tanwar , Jingqing Zhang , Julia Ive , Vibhor Gupta , Yike Guo

Attention mechanisms have improved the performance of NLP tasks while allowing models to remain explainable. Self-attention is currently widely used, however interpretability is difficult due to the numerous attention distributions. Recent…

Computation and Language · Computer Science 2020-10-30 Khalil Mrini , Franck Dernoncourt , Quan Tran , Trung Bui , Walter Chang , Ndapa Nakashole

Cell imaging and analysis are fundamental to biomedical research because cells are the basic functional units of life. Among different cell-related analysis, cell counting and detection are widely used. In this paper, we focus on one common…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Haoyi Liang , Aijaz Naik , Cedric L. Williams , Jaideep Kapur , Daniel S. Weller

Numbers are essential components of text, like any other word tokens, from which natural language processing (NLP) models are built and deployed. Though numbers are typically not accounted for distinctly in most NLP tasks, there is still an…

Computation and Language · Computer Science 2022-09-20 Dhanasekar Sundararaman , Vivek Subramanian , Guoyin Wang , Liyan Xu , Lawrence Carin

Attention-based deep networks have been successfully applied on textual data in the field of NLP. However, their application on protein sequences poses additional challenges due to the weak semantics of the protein words, unlike the plain…

Machine Learning · Computer Science 2022-08-29 Ashish Ranjan , Md Shah Fahad , Akshay Deepak

Data-centric AI has recently proven to be more effective and high-performance, while traditional model-centric AI delivers fewer and fewer benefits. It emphasizes improving the quality of datasets to achieve better model performance. This…

Computation and Language · Computer Science 2021-11-18 Liang Xu , Jiacheng Liu , Xiang Pan , Xiaojing Lu , Xiaofeng Hou

Clinicians may rely on medical coding systems such as International Classification of Diseases (ICD) to identify patients with diseases from Electronic Health Records (EHRs). However, due to the lack of detail and specificity as well as a…

Computation and Language · Computer Science 2022-05-19 Jingqing Zhang , Atri Sharma , Luis Bolanos , Tong Li , Ashwani Tanwar , Vibhor Gupta , Yike Guo

Various deep learning algorithms have been developed to analyze different types of clinical data including clinical text classification and extracting information from 'free text' and so on. However, automate the keyword extraction from the…

Computation and Language · Computer Science 2019-10-25 Matthew Tang , Priyanka Gandhi , Md Ahsanul Kabir , Christopher Zou , Jordyn Blakey , Xiao Luo

Clinical coding is an administrative process that involves the translation of diagnostic data from episodes of care into a standard code format such as ICD10. It has many critical applications such as billing and aetiology research. The…

Decoding-free reranking methods that read relevance signals directly from LLM attention weights offer significant latency advantages over autoregressive approaches, yet suffer from attention score homogenization: middle-context documents…

Information Retrieval · Computer Science 2026-05-20 Juyuan Wang , Chenxing Wang , Yuchen Fang , Huiyun Hu , Junwu Du , Aolin Li , Shunlin Rong , Haijun Wu , Jin Xu , Ligang Liu , Dongliang Liao

Existing prompt-based approaches have demonstrated impressive performance in continual learning, leveraging pre-trained large-scale models for classification tasks; however, the tight coupling between foreground-background information and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Huahui Yi , Wei Xu , Ziyuan Qin , Xi Chen , Xiaohu Wu , Kang Li , Qicheng Lao

Continual Named Entity Recognition (CNER) is a burgeoning area, which involves updating an existing model by incorporating new entity types sequentially. Nevertheless, continual learning approaches are often severely afflicted by…

Computation and Language · Computer Science 2023-10-24 Duzhen Zhang , Wei Cong , Jiahua Dong , Yahan Yu , Xiuyi Chen , Yonggang Zhang , Zhen Fang

Text segmentation plays an important role in various Natural Language Processing (NLP) tasks like summarization, context understanding, document indexing and document noise removal. Previous methods for this task require manual feature…

Machine Learning · Computer Science 2018-08-30 Pinkesh Badjatiya , Litton J Kurisinkel , Manish Gupta , Vasudeva Varma

Automatic extraction of clinical concepts is an essential step for turning the unstructured data within a clinical note into structured and actionable information. In this work, we propose a clinical concept extraction model for automatic…

Computation and Language · Computer Science 2018-11-28 Henghui Zhu , Ioannis Ch. Paschalidis , Amir Tahmasebi

There are several opportunities for automation in healthcare that can improve clinician throughput. One such example is assistive tools to document diagnosis codes when clinicians write notes. We study the automation of medical code…

Machine Learning · Computer Science 2022-08-05 Weiming Ren , Ruijing Zeng , Tongzi Wu , Tianshu Zhu , Rahul G. Krishnan

Data annotated by humans is a source of knowledge by describing the peculiarities of the problem and therefore fueling the decision process of the trained model. Unfortunately, the annotation process for subjective natural language…

Computation and Language · Computer Science 2023-12-14 Kamil Kanclerz , Julita Bielaniewicz , Marcin Gruza , Jan Kocon , Stanisław Woźniak , Przemysław Kazienko