English
Related papers

Related papers: Extensive Error Analysis and a Learning-Based Eval…

200 papers

Fine-grained annotations---e.g. dense image labels, image segmentation and text tagging---are useful in many ML applications but they are labor-intensive to generate. Moreover there are often systematic, structured errors in these…

Machine Learning · Computer Science 2020-03-26 Abubakar Abid , James Zou

The processing of entities in natural language is essential to many medical NLP systems. Unfortunately, existing datasets vastly under-represent the entities required to model public health relevant texts such as health advice often found…

Computation and Language · Computer Science 2022-10-10 Joseph Gatto , Parker Seegmiller , Garrett Johnston , Sarah M. Preum

Entity linking aims to link ambiguous mentions to their corresponding entities in a knowledge base, which is significant and fundamental for various downstream applications, e.g., knowledge base completion, question answering, and…

Computation and Language · Computer Science 2022-07-20 Xiuxing Li , Zhenyu Li , Zhengyan Zhang , Ning Liu , Haitao Yuan , Wei Zhang , Zhiyuan Liu , Jianyong Wang

Clinical concept extraction often begins with clinical Named Entity Recognition (NER). Often trained on annotated clinical notes, clinical NER models tend to struggle with tagging clinical entities in user queries because of the structural…

Information Retrieval · Computer Science 2019-12-25 Yue Zhao , John Handley

Performance metrics for medical image segmentation models are used to measure the agreement between the reference annotation and the predicted segmentation. Usually, overlap metrics, such as the Dice, are used as a metric to evaluate the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Sophie Ostmeier , Brian Axelrod , Jeroen Bertels , Fabian Isensee , Maarten G. Lansberg , Soren Christensen , Gregory W. Albers , Li-Jia Li , Jeremy J. Heit

High-quality Machine Translation (MT) evaluation relies heavily on human judgments. Comprehensive error classification methods, such as Multidimensional Quality Metrics (MQM), are expensive as they are time-consuming and can only be done by…

Multiclass neural network classifiers are typically trained using cross-entropy loss but evaluated using metrics derived from the confusion matrix, such as Accuracy, $F_\beta$-Score, and Matthews Correlation Coefficient. This mismatch…

Machine Learning · Computer Science 2025-05-27 Deyuan Li , Taesoo Daniel Lee , Marynel Vázquez , Nathan Tsoi

Fine-grained entity type classification (FETC) is the task of classifying an entity mention to a broad set of types. Distant supervision paradigm is extensively used to generate training data for this task. However, generated training data…

Computation and Language · Computer Science 2017-02-23 Abhishek , Ashish Anand , Amit Awekar

Medical image segmentation annotations exhibit variations among experts due to the ambiguous boundaries of segmented objects and backgrounds in medical images. Although using multiple annotations for each image in the fully-supervised has…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Shuai Wang , Tengjin Weng , Jingyi Wang , Yang Shen , Zhidong Zhao , Yixiu Liu , Pengfei Jiao , Zhiming Cheng , Yaqi Wang

The classification performance of deep neural networks relies strongly on access to large, accurately annotated datasets. In medical imaging, however, obtaining such datasets is particularly challenging since annotations must be provided by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Julia Werner , Julius Oexle , Oliver Bause , Maxime Le Floch , Franz Brinkmann , Hannah Tolle , Jochen Hampe , Oliver Bringmann

Data annotation plays a crucial role in ensuring your named entity recognition (NER) projects are trained with the right information to learn from. Producing the most accurate labels is a challenge due to the complexity involved with…

Computation and Language · Computer Science 2021-09-24 Qingkai Zeng , Mengxia Yu , Wenhao Yu , Tianwen Jiang , Meng Jiang

Entity and relation extraction is the necessary step in structuring medical text. However, the feature extraction ability of the bidirectional long short term memory network in the existing model does not achieve the best effect. At the…

Computation and Language · Computer Science 2019-10-23 Kui Xue , Yangming Zhou , Zhiyuan Ma , Tong Ruan , Huanhuan Zhang , Ping He

Identification of key variables such as medications, diseases, relations from health records and clinical notes has a wide range of applications in the clinical domain. n2c2 2022 provided shared tasks on challenges in natural language…

Computation and Language · Computer Science 2025-07-01 Shouvon Sarker , Xishuang Dong , Lijun Qian

Many recent works on Entity Resolution (ER) leverage Deep Learning techniques involving language models to improve effectiveness. This is applied to both main steps of ER, i.e., blocking and matching. Several pre-trained embeddings have…

Databases · Computer Science 2023-04-26 Alexandros Zeakis , George Papadakis , Dimitrios Skoutas , Manolis Koubarakis

Probably yes. -- Supervised Deep Learning dominates performance scores for many computer vision tasks and defines the state-of-the-art. However, medical image analysis lags behind natural image applications. One of the many reasons is the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Samuel Budd , Thomas Day , John Simpson , Karen Lloyd , Jacqueline Matthew , Emily Skelton , Reza Razavi , Bernhard Kainz

The emergence and rapid progress of the Internet have brought ever-increasing impact on financial domain. How to rapidly and accurately mine the key information from the massive negative financial texts has become one of the key issues for…

Computation and Language · Computer Science 2020-01-16 Lingyun Zhao , Lin Li , Xinhao Zheng

Recognizing spans of biomedical concepts and their types (e.g., drug or gene) in free text, often called biomedical named entity recognition (NER), is a basic component of information extraction (IE) pipelines. Without a strong NER…

Computation and Language · Computer Science 2025-04-02 Motasem S Obeidat , Md Sultan Al Nahian , Ramakanth Kavuluru

Few-shot named entity recognition (NER) aims to recognize novel named entities in low-resource domains utilizing existing knowledge. However, the present few-shot NER models assume that the labeled data are all clean without noise or…

Computation and Language · Computer Science 2023-12-14 Xiaojun Xue , Chunxia Zhang , Tianxiang Xu , Zhendong Niu

Functioning is gaining recognition as an important indicator of global health, but remains under-studied in medical natural language processing research. We present the first analysis of automatically extracting descriptions of patient…

Computation and Language · Computer Science 2018-06-08 Denis Newman-Griffis , Ayah Zirikly

State-of-the-art Named Entity Recognition(NER) models rely heavily on large amountsof fully annotated training data. However, ac-cessible data are often incompletely annotatedsince the annotators usually lack comprehen-sive knowledge in the…

Computation and Language · Computer Science 2022-06-10 Hongtao Ruan , Liying Zheng , Peixian Hu