English
Related papers

Related papers: Rethinking Negative Sampling for Handling Missing …

200 papers

Although named entity recognition (NER) helps us to extract domain-specific entities from text (e.g., artists in the music domain), it is costly to create a large amount of training data or a structured knowledge base to perform accurate…

Computation and Language · Computer Science 2023-06-07 Kosuke Nishida , Naoki Yoshinaga , Kyosuke Nishida

Negative sampling methods are vital in implicit recommendation models as they allow us to obtain negative instances from massive unlabeled data. Most existing approaches focus on sampling hard negative samples in various ways. These studies…

Information Retrieval · Computer Science 2023-11-08 Fuyuan Lyu , Yaochen Hu , Xing Tang , Yingxue Zhang , Ruiming Tang , Xue Liu

We investigate the issue of parameter estimation with nonuniform negative sampling for imbalanced data. We first prove that, with imbalanced data, the available information about unknown parameters is only tied to the relatively small…

Machine Learning · Statistics 2021-10-26 HaiYing Wang , Aonan Zhang , Chong Wang

Named Entity Recognition (NER) is a well-studied problem in NLP. However, there is much less focus on studying NER datasets, compared to developing new NER models. In this paper, we employed three simple techniques to detect annotation…

Computation and Language · Computer Science 2024-06-28 Gabriel Bernier-Colborne , Sowmya Vajjala

For several purposes in Natural Language Processing (NLP), such as Information Extraction, Sentiment Analysis or Chatbot, Named Entity Recognition (NER) holds an important role as it helps to determine and categorize entities in text into…

Computation and Language · Computer Science 2020-03-24 Thong Nguyen , Duy Nguyen , Pramod Rao

Annotated datasets are an essential ingredient to train, evaluate, compare and productionalize supervised machine learning models. It is therefore imperative that annotations are of high quality. For their creation, good quality management…

Machine Learning · Computer Science 2024-05-30 Jan-Christoph Klie , Juan Haladjian , Marc Kirchner , Rahul Nair

How to sample high quality negative instances from unlabeled data, i.e., negative sampling, is important for training implicit collaborative filtering and contrastive learning models. Although previous studies have proposed some approaches…

Information Retrieval · Computer Science 2022-07-12 Bin Liu , Bang Wang

Named Entity Recognition (NER) performance often degrades rapidly when applied to target domains that differ from the texts observed during training. When in-domain labelled data is available, transfer learning techniques can be used to…

Computation and Language · Computer Science 2020-05-01 Pierre Lison , Aliaksandr Hubin , Jeremy Barnes , Samia Touileb

Named Entity Recognition (NER) is a critical task that requires substantial annotated data, making it challenging in low-resource scenarios where label acquisition is expensive. While zero-shot and instruction-tuned approaches have made…

Computation and Language · Computer Science 2025-10-21 Nanda Kumar Rengarajan , Jun Yan , Chun Wang

Telephone transcription data can be very noisy due to speech recognition errors, disfluencies, etc. Not only that annotating such data is very challenging for the annotators, but also such data may have lots of annotation errors even after…

Computation and Language · Computer Science 2022-11-03 Md Tahmid Rahman Laskar , Cheng Chen , Xue-Yong Fu , Shashi Bhushan TN

Named Entity Recognition seeks to extract substrings within a text that name real-world objects and to determine their type (for example, whether they refer to persons or organizations). In this survey, we first present an overview of…

Computation and Language · Computer Science 2024-12-23 Imed Keraghel , Stanislas Morbieu , Mohamed Nadif

Sampling proper negatives from a large document pool is vital to effectively train a dense retrieval model. However, existing negative sampling strategies suffer from the uninformative or false negative problem. In this work, we empirically…

Computation and Language · Computer Science 2022-10-25 Kun Zhou , Yeyun Gong , Xiao Liu , Wayne Xin Zhao , Yelong Shen , Anlei Dong , Jingwen Lu , Rangan Majumder , Ji-Rong Wen , Nan Duan , Weizhu Chen

The focus of this paper is to address the knowledge acquisition bottleneck for Named Entity Recognition (NER) of mutations, by analysing different approaches to build manually-annotated data. We address first the impact of using a single…

Computation and Language · Computer Science 2021-01-20 David Martinez Iraola , Antonio Jimeno Yepes

Named entity recognition (NER) is the very first step in the linguistic processing of any new domain. It is currently a common process in BioNLP on English clinical text. However, it is still in its infancy in other major languages, as it…

Computation and Language · Computer Science 2019-12-20 Fernando Sánchez León , Ana González Ledesma

A large amount of information in today's world is now stored in knowledge bases. Named Entity Recognition (NER) is a process of extracting, disambiguation, and linking an entity from raw text to insightful and structured knowledge bases.…

Computation and Language · Computer Science 2024-11-11 Monica Munnangi

State-of-the-art machine learning models require access to significant amount of annotated data in order to achieve the desired level of performance. While unlabelled data can be largely available and even abundant, annotation process can…

Machine Learning · Computer Science 2020-10-15 Rahaf Aljundi , Nikolay Chumerin , Daniel Olmeda Reino

Named entity recognition (NER) is a crucial task that aims to identify structured information, which is often replete with complex, technical terms and a high degree of variability. Accurate and reliable NER can facilitate the extraction…

Computation and Language · Computer Science 2024-10-21 Grace Yang , Zhiyi Li , Yadong Liu , Jungyeul Park

Weak supervision has shown promising results in many natural language processing tasks, such as Named Entity Recognition (NER). Existing work mainly focuses on learning deep NER models only with weak supervision, i.e., without any human…

Computation and Language · Computer Science 2021-08-03 Haoming Jiang , Danqing Zhang , Tianyu Cao , Bing Yin , Tuo Zhao

InfoNCE loss is a widely used loss function for contrastive model training. It aims to estimate the mutual information between a pair of variables by discriminating between each positive pair and its associated $K$ negative pairs. It is…

Machine Learning · Computer Science 2021-05-28 Chuhan Wu , Fangzhao Wu , Yongfeng Huang

Most existing image-text matching methods adopt triplet loss as the optimization objective, and choosing a proper negative sample for the triplet of <anchor, positive, negative> is important for effectively training the model, e.g., hard…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Haoxuan Li , Yi Bin , Junrong Liao , Yang Yang , Heng Tao Shen