English
Related papers

Related papers: Raw-to-End Name Entity Recognition in Social Media

200 papers

Named Entity Recognition (NER) aims to extract and classify entity mentions in the text into pre-defined types (e.g., organization or person name). Recently, many works have been proposed to shape the NER as a machine reading comprehension…

Computation and Language · Computer Science 2023-09-21 Yibo Wang , Wenting Zhao , Yao Wan , Zhongfen Deng , Philip S. Yu

We study the effectiveness of several techniques to personalize end-to-end speech models and improve the recognition of proper names relevant to the user. These techniques differ in the amounts of user effort required to provide…

Named Entity Recognition (NER) is a challenging and widely studied task that involves detecting and typing entities in text. So far,NER still approaches entity typing as a task of classification into universal classes (e.g. date, person, or…

Computation and Language · Computer Science 2023-02-22 Tristan Luiggi , Laure Soulier , Vincent Guigue , Siwar Jendoubi , Aurélien Baelde

Sequence modeling has demonstrated state-of-the-art performance on natural language and document understanding tasks. However, it is challenging to correctly serialize tokens in form-like documents in practice due to their variety of layout…

Computation and Language · Computer Science 2022-03-25 Chen-Yu Lee , Chun-Liang Li , Timothy Dozat , Vincent Perot , Guolong Su , Nan Hua , Joshua Ainslie , Renshen Wang , Yasuhisa Fujii , Tomas Pfister

Despite recent advances, standard sequence labeling systems often fail when processing noisy user-generated text or consuming the output of an Optical Character Recognition (OCR) process. In this paper, we improve the noise-aware training…

Computation and Language · Computer Science 2021-05-26 Marcin Namysl , Sven Behnke , Joachim Köhler

As a cornerstone in language modeling, tokenization involves segmenting text inputs into pre-defined atomic units. Conventional statistical tokenizers often disrupt constituent boundaries within words, thereby corrupting semantic…

Computation and Language · Computer Science 2025-07-11 Qingyang Zhu , Xiang Hu , Pengyu Ji , Wei Wu , Kewei Tu

The emergence and rapid progress of the Internet have brought ever-increasing impact on financial domain. How to rapidly and accurately mine the key information from the massive negative financial texts has become one of the key issues for…

Computation and Language · Computer Science 2020-01-16 Lingyun Zhao , Lin Li , Xinhao Zheng

This thesis addresses automatic lexical error recovery and tokenization of corrupt text input. We propose a technique that can automatically correct misspellings, segmentation errors and real-word errors in a unified framework that uses…

cmp-lg · Computer Science 2009-09-25 Peter Ingels

The automated and timely conversion of cybersecurity information from unstructured online sources, such as blogs and articles to more formal representations has become a necessity for many applications in the domain nowadays. Named Entity…

Information Retrieval · Computer Science 2024-09-18 Houssem Gasmi , Jannik Laval , Abdelaziz Bouras

Named entity recognition (NER) suffers from the scarcity of annotated training data, especially for low-resource languages without labeled data. Cross-lingual NER has been proposed to alleviate this issue by transferring knowledge from…

Computation and Language · Computer Science 2022-10-14 Jian Yang , Shaohan Huang , Shuming Ma , Yuwei Yin , Li Dong , Dongdong Zhang , Hongcheng Guo , Zhoujun Li , Furu Wei

In this paper we show how the performance of tweet clustering can be improved by leveraging character-based neural networks. The proposed approach overcomes the limitations related to the vocabulary explosion in the word-based models and…

Information Retrieval · Computer Science 2017-03-17 Svitlana Vakulenko , Lyndon Nixon , Mihai Lupu

Recurrent neural networks (RNNs) are a powerful model for sequential data. End-to-end training methods such as Connectionist Temporal Classification make it possible to train RNNs for sequence labelling problems where the input-output…

Neural and Evolutionary Computing · Computer Science 2013-03-26 Alex Graves , Abdel-rahman Mohamed , Geoffrey Hinton

Deep neural models for named entity recognition (NER) have shown impressive results in overcoming label scarcity and generalizing to unseen entities by leveraging distant supervision and auxiliary information such as explanations. However,…

Named entity recognition (NER) is frequently addressed as a sequence classification task where each input consists of one sentence of text. It is nevertheless clear that useful information for the task can often be found outside of the…

Computation and Language · Computer Science 2020-12-18 Jouni Luoma , Sampo Pyysalo

Offline handwritten text recognition from images is an important problem for enterprises attempting to digitize large volumes of handmarked scanned documents/reports. Deep recurrent models such as Multi-dimensional LSTMs have been shown to…

Computation and Language · Computer Science 2018-07-27 Arindam Chowdhury , Lovekesh Vig

Named entity recognition (NER) models often struggle with noisy inputs, such as those with spelling mistakes or errors generated by Optical Character Recognition processes, and learning a robust NER model is challenging. Existing robust NER…

Computation and Language · Computer Science 2024-07-29 Chaoyi Ai , Yong Jiang , Shen Huang , Pengjun Xie , Kewei Tu

Character-level patterns have been widely used as features in English Named Entity Recognition (NER) systems. However, to date there has been no direct investigation of the inherent differences between name and non-name tokens in text, nor…

Computation and Language · Computer Science 2018-09-21 Xiaodong Yu , Stephen Mayhew , Mark Sammons , Dan Roth

Building named entity recognition (NER) models for languages that do not have much training data is a challenging task. While recent work has shown promising results on cross-lingual transfer from high-resource languages to low-resource…

Computation and Language · Computer Science 2019-09-10 Xiaolei Huang , Jonathan May , Nanyun Peng

Named entity recognition is a challenging task in Natural Language Processing, especially for informal and noisy social media text. Chinese word boundaries are also entity boundaries, therefore, named entity recognition for Chinese text can…

Computation and Language · Computer Science 2020-02-28 Zhaoheng Gong , Ping Chen , Jiang Zhou

Implicit neural representations (INRs) such as NeRF and SIREN encode a signal in neural network parameters and show excellent results for signal reconstruction. Using INRs for downstream tasks, such as classification, is however not…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Alexander Gielisse , Jan van Gemert