English
Related papers

Related papers: WCL-BBCD: A Contrastive Learning and Knowledge Gra…

200 papers

Named entity recognition (NER) has been one of the essential preliminary steps in modern NLP applications. This report focuses on implementing the NER task on finetuning two pretrained models: (i) an encoder-only model (BERT) with a simple…

Computation and Language · Computer Science 2026-05-19 Mei Jia

The Entity Disambiguation and Linking (EDL) task matches entity mentions in text to a unique Knowledge Base (KB) identifier such as a Wikipedia or Freebase id. It plays a critical role in the construction of a high quality information…

Information Retrieval · Computer Science 2017-03-14 Preeti Bhargava , Nemanja Spasojevic , Guoning Hu

Inductive knowledge graph completion requires models to comprehend the underlying semantics and logic patterns of relations. With the advance of pretrained language models, recent research have designed transformers for link prediction…

Computation and Language · Computer Science 2022-10-27 Bohua Peng , Shihao Liang , Mobarakol Islam

Bundle Recommendation (BR) aims at recommending bundled items on online content or e-commerce platform, such as song lists on a music platform or book lists on a reading website. Several graph based models have achieved state-of-the-art…

Information Retrieval · Computer Science 2022-12-22 Shixuan Zhu , Qi Shen , Yiming Zhang , Zhenwei Dong , Zhihua Wei

Recent breakthroughs of pretrained language models have shown the effectiveness of self-supervised learning for a wide range of natural language processing (NLP) tasks. In addition to standard syntactic and semantic NLP tasks, pretrained…

Computation and Language · Computer Science 2019-12-23 Wenhan Xiong , Jingfei Du , William Yang Wang , Veselin Stoyanov

End-to-end automatic speech recognition (ASR) systems frequently misrecognize domain-specific phrases like named entities, which can cause catastrophic failures in downstream tasks. A new family of named entity correction methods based on…

Computation and Language · Computer Science 2026-02-16 Junjie An , Jingguang Tian , Tianyi Wang , Yu Gao , Xiaofeng Mou , Yi Xu

Object recognition for the most part has been approached as a one-hot problem that treats classes to be discrete and unrelated. Each image region has to be assigned to one member of a set of objects, including a background class,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Christopher Lang , Alexander Braun , Abhinav Valada

Despite advancements of end-to-end (E2E) models in speech recognition, named entity recognition (NER) is still challenging but critical for semantic understanding. Previous studies mainly focus on various rule-based or attention-based…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-11 Peng Wang , Yifan Yang , Zheng Liang , Tian Tan , Shiliang Zhang , Xie Chen

Previous approaches to the task of implicit discourse relation recognition (IDRR) generally view it as a classification task. Even with pre-trained language models, like BERT and RoBERTa, IDRR still relies on complicated neural networks…

Computation and Language · Computer Science 2024-09-24 Yiheng Wu , Junhui Li , Muhua Zhu

Dependency tree structures capture long-distance and syntactic relationships between words in a sentence. The syntactic relations (e.g., nominal subject, object) can potentially infer the existence of certain named entities. In addition,…

Computation and Language · Computer Science 2019-09-24 Zhanming Jie , Wei Lu

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned model to a target…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Guoxin Wang , Hui Chen , Börje F. Karlsson , Biqing Huang , Chin-Yew Lin

In recent years, large pre-trained language models (PLMs) have achieved remarkable performance on many natural language processing benchmarks. Despite their success, prior studies have shown that PLMs are vulnerable to attacks from…

Computation and Language · Computer Science 2024-02-06 Shuguang Chen , Leonardo Neves , Thamar Solorio

Name Entity Disambiguation is the Natural Language Processing task of identifying textual records corresponding to the same Named Entity, i.e. real-world entities represented as a list of attributes (names, places, organisations, etc.). In…

Computation and Language · Computer Science 2023-11-22 Alessandro Basile , Riccardo Crupi , Michele Grasso , Alessandro Mercanti , Daniele Regoli , Simone Scarsi , Shuyi Yang , Andrea Cosentini

Recurrent Neural Network models are the state-of-the-art for Named Entity Recognition (NER). We present two innovations to improve the performance of these models. The first innovation is the introduction of residual connections between the…

Computation and Language · Computer Science 2017-07-12 Quan Tran , Andrew MacKinlay , Antonio Jimeno Yepes

Accurate Named Entity Recognition (NER) is crucial for various information retrieval tasks in industry. However, despite significant progress in traditional NER methods, the extraction of Complex Named Entities remains a relatively…

Information Retrieval · Computer Science 2023-05-11 Hsiu-Wei Yang , Abhinav Agrawal

The deployment of large language models (LLMs) faces considerable challenges concerning resource constraints and inference efficiency. Recent research has increasingly focused on smaller, task-specific models enhanced by distilling…

Computation and Language · Computer Science 2024-09-20 Wei Wang , Zhaowei Li , Qi Xu , Yiqing Cai , Hang Song , Qi Qi , Ran Zhou , Zhida Huang , Tao Wang , Li Xiao

Using token representation from bidirectional language models (LMs) such as BERT is still a widely used approach for token-classification tasks. Even though there exist much larger unidirectional LMs such as Llama-2, they are rarely used to…

Computation and Language · Computer Science 2024-12-11 Takumi Goto , Hiroyoshi Nagao , Yuta Koreeda

This paper describes an approach for automatic construction of dictionaries for Named Entity Recognition (NER) using large amounts of unlabeled data and a few seed examples. We use Canonical Correlation Analysis (CCA) to obtain lower…

Computation and Language · Computer Science 2015-04-28 Arvind Neelakantan , Michael Collins

Named Entity Disambiguation (NED) is the task of linking a named-entity mention to an instance in a knowledge-base, typically Wikipedia. This task is closely related to word-sense disambiguation (WSD), where the supervised word-expert…

Computation and Language · Computer Science 2016-03-16 Angel X. Chang , Valentin I. Spitkovsky , Christopher D. Manning , Eneko Agirre

The increasing amount of data on the Web, in particular of Linked Data, has led to a diverse landscape of datasets, which make entity retrieval a challenging task. Explicit cross-dataset links, for instance to indicate co-references or…

Information Retrieval · Computer Science 2017-03-31 Besnik Fetahu , Ujwal Gadiraju , Stefan Dietze