English
Related papers

Related papers: Converse Attention Knowledge Transfer for Low-Reso…

200 papers

Traditional language models are unable to efficiently model entity names observed in text. All but the most popular named entities appear infrequently in text providing insufficient context. Recent efforts have recognized that context can…

Computation and Language · Computer Science 2019-06-25 Angli Liu , Jingfei Du , Veselin Stoyanov

Cross-lingual Named Entity Recognition (CL-NER) aims to transfer knowledge from high-resource languages to low-resource languages. However, existing zero-shot CL-NER (ZCL-NER) approaches primarily focus on Latin script language (LSL), where…

Computation and Language · Computer Science 2025-09-03 Zhihao Zhang , Sophia Yat Mei Lee , Dong Zhang , Shoushan Li , Guodong Zhou

We propose a system to develop a basic automatic speech recognizer(ASR) for Cantonese, a low-resource language, through transfer learning of Mandarin, a high-resource language. We take a time-delayed neural network trained on Mandarin, and…

Computation and Language · Computer Science 2019-11-22 Bryan Li , Xinyue Wang , Homayoon Beigi

This paper reports on the evaluation of Deep Learning (DL) transformer architecture models for Named-Entity Recognition (NER) on ten low-resourced South African (SA) languages. In addition, these DL transformer models were compared to other…

Computation and Language · Computer Science 2022-10-04 Ridewaan Hanslo

Recent advances in Named Entity Recognition (NER) show that document-level contexts can significantly improve model performance. In many application scenarios, however, such contexts are not available. In this paper, we propose to find…

Computation and Language · Computer Science 2022-12-09 Xinyu Wang , Yong Jiang , Nguyen Bach , Tao Wang , Zhongqiang Huang , Fei Huang , Kewei Tu

Entity Recognition (ER) within a text is a fundamental exercise in Natural Language Processing, enabling further depending tasks such as Knowledge Extraction, Text Summarisation, or Keyphrase Extraction. An entity consists of single words…

Computation and Language · Computer Science 2021-06-14 Andreas Waldis , Luca Mazzola

Named entity recognition (NER) suffers from the scarcity of annotated training data, especially for low-resource languages without labeled data. Cross-lingual NER has been proposed to alleviate this issue by transferring knowledge from…

Computation and Language · Computer Science 2022-10-14 Jian Yang , Shaohan Huang , Shuming Ma , Yuwei Yin , Li Dong , Dongdong Zhang , Hongcheng Guo , Zhoujun Li , Furu Wei

Text classification is a critical research topic with broad applications in natural language processing. Recently, graph neural networks (GNNs) have received increasing attention in the research community and demonstrated their promising…

Computation and Language · Computer Science 2020-11-03 Kaize Ding , Jianling Wang , Jundong Li , Dingcheng Li , Huan Liu

Entity Linking has two main open areas of research: 1) generate candidate entities without using alias tables and 2) generate more contextual representations for both mentions and entities. Recently, a solution has been proposed for the…

Computation and Language · Computer Science 2020-04-08 Oshin Agarwal , Daniel M. Bikel

The combination of multilingual pre-trained representations and cross-lingual transfer learning is one of the most effective methods for building functional NLP systems for low-resource languages. However, for extremely low-resource…

Computation and Language · Computer Science 2021-04-19 Mengzhou Xia , Guoqing Zheng , Subhabrata Mukherjee , Milad Shokouhi , Graham Neubig , Ahmed Hassan Awadallah

Meta-learning has achieved great success in leveraging the historical learned knowledge to facilitate the learning process of the new task. However, merely learning the knowledge from the historical tasks, adopted by current meta-learning…

Computation and Language · Computer Science 2021-09-13 Huaxiu Yao , Yingxin Wu , Maruan Al-Shedivat , Eric P. Xing

One of the main tasks of Natural Language Processing (NLP), is Named Entity Recognition (NER). It is used in many applications and also can be used as an intermediate step for other tasks. We present ANER, a web-based named entity…

Computation and Language · Computer Science 2023-08-30 Abdelrahman "Boda" Sadallah , Omar Ahmed , Shimaa Mohamed , Omar Hatem , Doaa Hesham , Ahmed H. Yousef

Most current speech technology systems are designed to operate well even in the presence of multiple active speakers. However, most solutions assume that the number of co-current speakers is known. Unfortunately, this information might not…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-02 Midia Yousefi , John H. L. Hansen

There is a recent interest in investigating few-shot NER, where the low-resource target domain has different label sets compared with a resource-rich source domain. Existing methods use a similarity-based metric. However, they cannot make…

Computation and Language · Computer Science 2021-06-04 Leyang Cui , Yu Wu , Jian Liu , Sen Yang , Yue Zhang

To better tackle the named entity recognition (NER) problem on languages with little/no labeled data, cross-lingual NER must effectively leverage knowledge learned from source languages with rich labeled data. Previous works on…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Börje F. Karlsson , Jian-Guang Lou , Biqing Huang

This paper presents a novel approach to constructing an English-to-Telugu translation model by leveraging transfer learning techniques and addressing the challenges associated with low-resource languages. Utilizing the Bharat Parallel…

Computation and Language · Computer Science 2025-04-09 Abhiram Reddy Yanampally

This paper addresses the classification of Arabic text data in the field of Natural Language Processing (NLP), with a particular focus on Natural Language Inference (NLI) and Contradiction Detection (CD). Arabic is considered a…

Computation and Language · Computer Science 2023-07-28 Mohammad Majd Saad Al Deen , Maren Pielka , Jörn Hees , Bouthaina Soulef Abdou , Rafet Sifa

Voice technology has become ubiquitous recently. However, the accuracy, and hence experience, in different languages varies significantly, which makes the technology not equally inclusive. The availability of data for different languages is…

Computation and Language · Computer Science 2023-05-24 Jan Silovsky , Liuhui Deng , Arturo Argueta , Tresi Arvizo , Roger Hsiao , Sasha Kuznietsov , Yiu-Chang Lin , Xiaoqiang Xiao , Yuanyuan Zhang

Named Entity Recognition (NER) and Relation Extraction (RE) are essential tools in distilling knowledge from biomedical literature. This paper presents our findings from participating in BioNLP Shared Tasks 2019. We addressed Named Entity…

Computation and Language · Computer Science 2019-10-09 Usama Yaseen , Pankaj Gupta , Hinrich Schütze

Despite serving as the foundation models for a wide range of NLP benchmarks, pre-trained language models have shown limited capabilities of acquiring implicit commonsense knowledge from self-supervision alone, compared to learning…

Computation and Language · Computer Science 2023-06-06 Wangchunshu Zhou , Ronan Le Bras , Yejin Choi