English
Related papers

Related papers: Span-based Named Entity Recognition by Generating …

200 papers

Named entity recognition (NER) is highly sensitive to sentential syntactic and semantic properties where entities may be extracted according to how they are used and placed in the running text. To model such properties, one could rely on…

Computation and Language · Computer Science 2020-10-30 Yuyang Nie , Yuanhe Tian , Yan Song , Xiang Ao , Xiang Wan

Span-based nested named-entity recognition (NER) has a cubic-time complexity using a variant of the CYK algorithm. We show that by adding a supplementary structural constraint on the search space, nested NER has a quadratic-time complexity,…

Computation and Language · Computer Science 2023-05-29 Caio Corro

The information bottleneck (IB) method is a technique designed to extract meaningful information related to one random variable from another random variable, and has found extensive applications in machine learning problems. In this paper,…

Information Theory · Computer Science 2025-07-29 Lingyi Chen , Shitong Wu , Sicheng Xu , Huihui Wu , Wenyi Zhang

Named Entity Recognition (NER) is an essential precursor task for many natural language applications, such as relation extraction or event extraction. Much of the NER research has been done on datasets with few classes of entity types (e.g.…

Computation and Language · Computer Science 2020-09-17 Parul Awasthy , Taesun Moon , Jian Ni , Radu Florian

The Information Bottleneck (IB) principle offers an information-theoretic framework for analyzing the training process of deep neural networks (DNNs). Its essence lies in tracking the dynamics of two mutual information (MI) values: between…

Machine Learning · Computer Science 2024-05-10 Ivan Butakov , Alexander Tolmachev , Sofia Malanchuk , Anna Neopryatnaya , Alexey Frolov , Kirill Andreev

Representation learning of graph-structured data is challenging because both graph structure and node features carry important information. Graph Neural Networks (GNNs) provide an expressive way to fuse information from network structure…

Machine Learning · Computer Science 2020-10-27 Tailin Wu , Hongyu Ren , Pan Li , Jure Leskovec

Deep neural networks (DNNs) have achieved significant success in various applications with large-scale and balanced data. However, data in real-world visual recognition are usually long-tailed, bringing challenges to efficient training and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yifan Lan , Xin Cai , Jun Cheng , Shan Tan

Although named entity recognition (NER) helps us to extract domain-specific entities from text (e.g., artists in the music domain), it is costly to create a large amount of training data or a structured knowledge base to perform accurate…

Computation and Language · Computer Science 2023-06-07 Kosuke Nishida , Naoki Yoshinaga , Kyosuke Nishida

Named Entity Recognition (NER) is the task of identifying spans that represent entities in sentences. Whether the entity spans are nested or discontinuous, the NER task can be categorized into the flat NER, nested NER, and discontinuous NER…

Computation and Language · Computer Science 2021-06-03 Hang Yan , Tao Gui , Junqi Dai , Qipeng Guo , Zheng Zhang , Xipeng Qiu

Few-shot named entity recognition (NER) systems recognize entities using a few labeled training examples. The general pipeline consists of a span detector to identify entity spans in text and an entity-type classifier to assign types to…

Computation and Language · Computer Science 2024-06-21 Chang Tian , Wenpeng Yin , Dan Li , Marie-Francine Moens

The Information Bottleneck (IB) objective uses information theory to formulate a task-performance versus robustness trade-off. It has been successfully applied in the standard discriminative classification setting. We pose the question…

Machine Learning · Computer Science 2021-01-13 Lynton Ardizzone , Radek Mackowiak , Carsten Rother , Ullrich Köthe

The Information Bottleneck (IB) principle has emerged as a promising approach for enhancing the generalization, robustness, and interpretability of deep neural networks, demonstrating efficacy across image segmentation, document clustering,…

Information Theory · Computer Science 2025-04-18 Hanzhe Yang , Youlong Wu , Dingzhu Wen , Yong Zhou , Yuanming Shi

Named entity recognition (NER), which focuses on the extraction of semantically meaningful named entities and their semantic classes from text, serves as an indispensable component for several down-stream natural language processing (NLP)…

Computation and Language · Computer Science 2018-10-23 Zhanming Jie , Aldrian Obaja Muis , Wei Lu

Recent advances in named entity recognition (NER) have pushed the boundary of the task to incorporate visual signals, leading to many variants, including multi-modal NER (MNER) or grounded MNER (GMNER). A key challenge to these tasks is…

Computation and Language · Computer Science 2024-04-03 Hyunjong Ok , Taeho Kil , Sukmin Seo , Jaeho Lee

Named entity recognition (NER) is a fundamental component in many applications, such as Web Search and Voice Assistants. Although deep neural networks greatly improve the performance of NER, due to the requirement of large amounts of…

Computation and Language · Computer Science 2021-06-02 Shining Liang , Ming Gong , Jian Pei , Linjun Shou , Wanli Zuo , Xianglin Zuo , Daxin Jiang

Named Entity Disambiguation (NED) refers to the task of resolving multiple named entity mentions in a document to their correct references in a knowledge base (KB) (e.g., Wikipedia). In this paper, we propose a novel embedding method…

Computation and Language · Computer Science 2016-06-13 Ikuya Yamada , Hiroyuki Shindo , Hideaki Takeda , Yoshiyasu Takefuji

Span-based joint extraction simultaneously conducts named entity recognition (NER) and relation extraction (RE) in text span form. Recent studies have shown that token labels can convey crucial task-specific information and enrich token…

Computation and Language · Computer Science 2022-07-19 Bin Ji , Shasha Li , Jie Yu , Jun Ma , Huijun Liu

As a fundamental natural language processing task and one of core knowledge extraction techniques, named entity recognition (NER) is widely used to extract information from texts for downstream tasks. Nested NER is a branch of NER in which…

Computation and Language · Computer Science 2022-04-19 Yifei Yang , Zuchao Li , Hai Zhao

In this theory paper, we investigate training deep neural networks (DNNs) for classification via minimizing the information bottleneck (IB) functional. We show that the resulting optimization problem suffers from two severe issues: First,…

Machine Learning · Computer Science 2020-08-10 Rana Ali Amjad , Bernhard C. Geiger

Named Entity Recognition (NER) aims to extract and classify entity mentions in the text into pre-defined types (e.g., organization or person name). Recently, many works have been proposed to shape the NER as a machine reading comprehension…

Computation and Language · Computer Science 2023-09-21 Yibo Wang , Wenting Zhao , Yao Wan , Zhongfen Deng , Philip S. Yu