中文
相关论文

相关论文: Empirical Study of Zero-Shot NER with ChatGPT

200 篇论文

This work presents our participation in the EvalLLM 2025 challenge on biomedical Named Entity Recognition (NER) and health event extraction in French (few-shot setting). For NER, we propose three approaches combining large language models…

The remarkable advancements in large language models (LLMs) have brought about significant improvements in Natural Language Processing(NLP) tasks. This paper presents a comprehensive review of in-context learning techniques, focusing on…

计算与语言 · 计算机科学 2023-09-26 Yinheng Li

Large language models (LLMs) such as ChatGPT have demonstrated superior performance on a variety of natural language processing (NLP) tasks including sentiment analysis, mathematical reasoning and summarization. Furthermore, since these…

计算与语言 · 计算机科学 2023-10-18 Shiyuan Huang , Siddarth Mamidanna , Shreedhar Jangam , Yilun Zhou , Leilani H. Gilpin

Large language models (LLM) have been successful in several natural language understanding tasks and could be relevant for natural language processing (NLP)-based mental health application research. In this work, we report the performance…

计算与语言 · 计算机科学 2023-03-29 Bishal Lamichhane

This paper presents ReverseNER, a method aimed at overcoming the limitation of large language models (LLMs) in zero-shot named entity recognition (NER) tasks, arising from their reliance on pre-provided demonstrations. ReverseNER tackles…

计算与语言 · 计算机科学 2024-12-30 Anbang Wang , Difei Mei , Zhichao Zhang , Xiuxiu Bai , Ran Yao , Zewen Fang , Min Hu , Zhirui Cao , Haitao Sun , Yifeng Guo , Hongyao Zhou , Yu Guo

We evaluate the effectiveness of Large Language Models (LLMs) in assessing essay quality, focusing on their alignment with human grading. More precisely, we evaluate ChatGPT and Llama in the Automated Essay Scoring (AES) task, a crucial…

计算与语言 · 计算机科学 2024-09-23 Anindita Kundu , Denilson Barbosa

Large Language Models (LLMs) continue to advance natural language processing with their ability to generate human-like text across a range of tasks. Despite the remarkable success of LLMs in Natural Language Processing (NLP), their…

计算与语言 · 计算机科学 2025-07-08 Walid Mohamed Aly , Taysir Hassan A. Soliman , Amr Mohamed AbdelAziz

Recently, several specialized instruction-tuned Large Language Models (LLMs) for Named Entity Recognition (NER) have emerged. Compared to traditional NER approaches, these models have demonstrated strong generalization capabilities.…

计算与语言 · 计算机科学 2024-09-19 Andrew Zamai , Andrea Zugarini , Leonardo Rigutini , Marco Ernandes , Marco Maggini

Large language models (LLMs) such as ChatGPT can produce coherent, cohesive, relevant, and fluent answers for various natural language processing (NLP) tasks. Taking document-level machine translation (MT) as a testbed, this paper provides…

计算与语言 · 计算机科学 2023-10-25 Longyue Wang , Chenyang Lyu , Tianbo Ji , Zhirui Zhang , Dian Yu , Shuming Shi , Zhaopeng Tu

Evaluating natural language generation (NLG) is a vital but challenging problem in natural language processing. Traditional evaluation metrics mainly capturing content (e.g. n-gram) overlap between system outputs and references are far from…

计算与语言 · 计算机科学 2025-05-15 Mingqi Gao , Xinyu Hu , Jie Ruan , Xiao Pu , Xiaojun Wan

This paper presents a comprehensive and practical guide for practitioners and end-users working with Large Language Models (LLMs) in their downstream natural language processing (NLP) tasks. We provide discussions and insights into the…

计算与语言 · 计算机科学 2023-04-28 Jingfeng Yang , Hongye Jin , Ruixiang Tang , Xiaotian Han , Qizhang Feng , Haoming Jiang , Bing Yin , Xia Hu

In any system that uses structured knowledge graph (KG) data as its underlying knowledge representation, KG-to-text generation is a useful tool for turning parts of the graph data into text that can be understood by humans. Recent work has…

计算与语言 · 计算机科学 2023-08-23 Agnes Axelsson , Gabriel Skantze

This paper evaluates Few-Shot Prompting with Large Language Models for Named Entity Recognition (NER). Traditional NER systems rely on extensive labeled datasets, which are costly and time-consuming to obtain. Few-Shot Prompting or…

信息检索 · 计算机科学 2024-09-05 Hédi Zeghidi , Ludovic Moncla

Large Language Models (LLMs) have revo lutionized natural language processing Natural Language Processing (NLP), with Chat Generative Pre-trained Transformer (ChatGPT) standing out as a notable exampledue to its advanced capabilities and…

计算与语言 · 计算机科学 2025-03-25 Azim Akhtarshenas , Afshin Dini , Navid Ayoobi

Scientific workflow systems are increasingly popular for expressing and executing complex data analysis pipelines over large datasets, as they offer reproducibility, dependability, and scalability of analyses by automatic parallelization on…

分布式、并行与集群计算 · 计算机科学 2024-07-09 Mario Sänger , Ninon De Mecquenem , Katarzyna Ewa Lewińska , Vasilis Bountris , Fabian Lehmann , Ulf Leser , Thomas Kosch

Although large language models (LLMs) have achieved excellent performance in a variety of evaluation benchmarks, they still struggle in complex reasoning tasks which require specific knowledge and multi-hop reasoning. To improve the…

计算与语言 · 计算机科学 2023-11-07 Zhipeng Chen , Kun Zhou , Beichen Zhang , Zheng Gong , Wayne Xin Zhao , Ji-Rong Wen

In the field of Natural Language Processing (NLP), Named Entity Recognition (NER) is recognized as a critical technology, employed across a wide array of applications. Traditional methodologies for annotating datasets for NER models are…

计算与语言 · 计算机科学 2025-01-03 Yuji Naraki , Ryosuke Yamaki , Yoshikazu Ikeda , Takafumi Horie , Kotaro Yoshida , Ryotaro Shimizu , Hiroki Naganuma

In recent times, the grandeur of Large Language Models (LLMs) has not only shone in the realm of natural language processing but has also cast its brilliance across a vast array of applications. This remarkable display of LLM capabilities…

计算与语言 · 计算机科学 2024-03-22 Hanieh Alipour , Nick Pendar , Kohinoor Roy

With the development and proliferation of large, complex, black-box models for solving many natural language processing (NLP) tasks, there is also an increasing necessity of methods to stress-test these models and provide some degree of…

计算与语言 · 计算机科学 2024-11-20 Amrita Bhattacharjee , Raha Moraffah , Joshua Garland , Huan Liu

Large Language Models (LLMs) have demonstrated impressive capabilities for generalizing in unseen tasks. In the Named Entity Recognition (NER) task, recent advancements have seen the remarkable improvement of LLMs in a broad range of entity…

计算与语言 · 计算机科学 2024-06-21 Yuyang Ding , Juntao Li , Pinzheng Wang , Zecheng Tang , Bowen Yan , Min Zhang