English
Related papers

Related papers: TKDP: Threefold Knowledge-enriched Deep Prompt Tun…

200 papers

Tuning pre-trained language models (PLMs) with task-specific prompts has been a promising approach for text classification. Particularly, previous studies suggest that prompt-tuning has remarkable superiority in the low-data scenario over…

Computation and Language · Computer Science 2022-03-21 Shengding Hu , Ning Ding , Huadong Wang , Zhiyuan Liu , Jingang Wang , Juanzi Li , Wei Wu , Maosong Sun

Recently, several specialized instruction-tuned Large Language Models (LLMs) for Named Entity Recognition (NER) have emerged. Compared to traditional NER approaches, these models have demonstrated strong generalization capabilities.…

Computation and Language · Computer Science 2024-09-19 Andrew Zamai , Andrea Zugarini , Leonardo Rigutini , Marco Ernandes , Marco Maggini

Pre-trained language models (PLMs) have exhibited remarkable few-shot learning capabilities when provided a few examples in a natural language prompt as demonstrations of test instances, i.e., in-context learning. However, the performance…

Computation and Language · Computer Science 2022-12-06 Feng Nie , Meixi Chen , Zhirui Zhang , Xu Cheng

Supervised named entity recognition (NER) in the biomedical domain depends on large sets of annotated texts with the given named entities. The creation of such datasets can be time-consuming and expensive, while extraction of new entities…

Computation and Language · Computer Science 2024-08-27 Miloš Košprdić , Nikola Prodanović , Adela Ljajić , Bojana Bašaragin , Nikola Milošević

Pre-trained vision-language models, e.g., CLIP, working with manually designed prompts have demonstrated great capacity of transfer learning. Recently, learnable prompts achieve state-of-the-art performance, which however are prone to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Baoshuo Kan , Teng Wang , Wenpeng Lu , Xiantong Zhen , Weili Guan , Feng Zheng

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned model to a target…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Guoxin Wang , Hui Chen , Börje F. Karlsson , Biqing Huang , Chin-Yew Lin

Zero-shot cross-lingual named entity recognition (NER) aims at transferring knowledge from annotated and rich-resource data in source languages to unlabeled and lean-resource data in target languages. Existing mainstream methods based on…

Computation and Language · Computer Science 2022-12-08 Jun-Yu Ma , Beiduo Chen , Jia-Chen Gu , Zhen-Hua Ling , Wu Guo , Quan Liu , Zhigang Chen , Cong Liu

Recently, prompt-tuning has achieved promising results for specific few-shot classification tasks. The core idea of prompt-tuning is to insert text pieces (i.e., templates) into the input and transform a classification task into a masked…

Computation and Language · Computer Science 2023-09-19 Xiang Chen , Ningyu Zhang , Xin Xie , Shumin Deng , Yunzhi Yao , Chuanqi Tan , Fei Huang , Luo Si , Huajun Chen

Few-shot prompting elicits the remarkable abilities of large language models by equipping them with a few demonstration examples in the input. However, the traditional method of providing large language models with all demonstration…

Computation and Language · Computer Science 2023-12-27 Yu Ji , Wen Wu , Yi Hu , Hong Zheng , Liang He

The large language models have achieved superior performance on various natural language tasks. One major drawback of such approaches is they are resource-intensive in fine-tuning new datasets. Soft-prompt tuning presents a…

Computation and Language · Computer Science 2023-10-30 Guoxin Chen , Yiming Qian , Bowen Wang , Liangzhi Li

Molecular property prediction (MPP) is integral to drug discovery and material science, but often faces the challenge of data scarcity in real-world scenarios. Addressing this, few-shot molecular property prediction (FSMPP) has been…

Machine Learning · Computer Science 2024-11-05 Liang Wang , Qiang Liu , Shaozhen Liu , Xin Sun , Shu Wu , Liang Wang

Recognizing entities in texts is a central need in many information-seeking scenarios, and indeed, Named Entity Recognition (NER) is arguably one of the most successful examples of a widely adopted NLP task and corresponding NLP technology.…

Computation and Language · Computer Science 2023-10-24 Uri Katz , Matan Vetzler , Amir DN Cohen , Yoav Goldberg

KnowNER is a multilingual Named Entity Recognition (NER) system that leverages different degrees of external knowledge. A novel modular framework divides the knowledge into four categories according to the depth of knowledge they convey.…

Computation and Language · Computer Science 2017-09-13 Dominic Seyler , Tatiana Dembelova , Luciano Del Corro , Johannes Hoffart , Gerhard Weikum

The rapid expansion of texts' volume and diversity presents formidable challenges in multi-domain settings. These challenges are also visible in the Persian name entity recognition (NER) settings. Traditional approaches, either employing a…

Computation and Language · Computer Science 2024-04-04 Parham Abed Azad , Hamid Beigy

Biomedical Named Entity Recognition (NER) is a fundamental task of Biomedical Natural Language Processing for extracting relevant information from biomedical texts, such as clinical records, scientific publications, and electronic health…

Computation and Language · Computer Science 2023-12-27 Fahime Shahrokh , Nasser Ghadiri , Rasoul Samani , Milad Moradi

Large Language Models (LLMs) are gaining significant popularity in recent years for specialized tasks using prompts due to their low computational cost. Standard methods like prefix tuning utilize special, modifiable tokens that lack…

Computation and Language · Computer Science 2024-10-14 Nusrat Jahan Prottasha , Asif Mahmud , Md. Shohanur Islam Sobuj , Prakash Bhat , Md Kowsher , Niloofar Yousefi , Ozlem Ozmen Garibay

Recent advances in large pre-trained language models (PLMs) lead to impressive gains in natural language understanding (NLU) tasks with task-specific fine-tuning. However, directly fine-tuning PLMs heavily relies on sufficient labeled…

Computation and Language · Computer Science 2023-03-24 Canyu Chen , Kai Shu

Recently, the transductive graph-based methods have achieved great success in the few-shot classification task. However, most existing methods ignore exploring the class-level knowledge that can be easily learned by humans from just a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Chaofan Chen , Xiaoshan Yang , Changsheng Xu , Xuhui Huang , Zhe Ma

Named Entity Recognition (NER) is a fundamental task in NLP that is used to locate the key information in text and is primarily applied in conversational and search systems. In commercial applications, NER or comparable slot-filling methods…

Computation and Language · Computer Science 2023-06-13 Maithili Sabane , Aparna Ranade , Onkar Litake , Parth Patil , Raviraj Joshi , Dipali Kadam

The recent advances in deep learning are mostly driven by availability of large amount of training data. However, availability of such data is not always possible for specific tasks such as speaker recognition where collection of large…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-19 Prashant Anand , Ajeet Kumar Singh , Siddharth Srivastava , Brejesh Lall