English
Related papers

Related papers: Empirical Study of Zero-Shot NER with ChatGPT

200 papers

Recent studies have demonstrated the great potential of Large Language Models (LLMs) serving as zero-shot relevance rankers. The typical approach involves making comparisons between pairs or lists of documents. Although effective, these…

Information Retrieval · Computer Science 2023-11-06 Weiwei Sun , Zheng Chen , Xinyu Ma , Lingyong Yan , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

The use of LLMs for natural language processing has become a popular trend in the past two years, driven by their formidable capacity for context comprehension and learning, which has inspired a wave of research from academics and industry…

Computation and Language · Computer Science 2024-04-09 Faren Yan , Peng Yu , Xin Chen

This paper explores the potential of leveraging Large Language Models (LLMs) for data augmentation in multilingual commonsense reasoning datasets where the available training data is extremely limited. To achieve this, we utilise several…

Computation and Language · Computer Science 2023-10-24 Chenxi Whitehouse , Monojit Choudhury , Alham Fikri Aji

The use of large language model (LLM)-powered chatbots, such as ChatGPT, has become popular across various domains, supporting a range of tasks and processes. However, due to the intrinsic complexity of LLMs, effective prompting is more…

Leveraging large language models (LLMs) for various natural language processing tasks has led to superlative claims about their performance. For the evaluation of machine translation (MT), existing research shows that LLMs are able to…

Computation and Language · Computer Science 2024-10-10 Shenbin Qian , Archchana Sindhujan , Minnie Kabra , Diptesh Kanojia , Constantin Orăsan , Tharindu Ranasinghe , Frédéric Blain

Large language models (LLMs) like ChatGPT are increasingly used in academic writing, yet issues such as incorrect or fabricated references raise ethical concerns. Moreover, current content quality evaluations often rely on subjective human…

Computation and Language · Computer Science 2025-09-15 Jing Ren , Weiqi Wang

Large Language Models (LLMs) have demonstrated remarkable success in various natural language processing and software engineering tasks, such as code generation. The LLMs are mainly utilized in the prompt-based zero/few-shot paradigm to…

Software Engineering · Computer Science 2024-01-31 Mohamad Khajezade , Jie JW Wu , Fatemeh Hendijani Fard , Gema Rodríguez-Pérez , Mohamed Sami Shehata

Named entity recognition (NER) is evolving from a sequence labeling task into a generative paradigm with the rise of large language models (LLMs). We conduct a systematic evaluation of open-source LLMs on both flat and nested NER tasks. We…

Computation and Language · Computer Science 2026-01-27 Qi Zhan , Yile Wang , Hui Huang

This study presents an innovative approach to the application of large language models (LLMs) in clinical decision-making, focusing on OpenAI's ChatGPT. Our approach introduces the use of contextual prompts-strategically designed to include…

Artificial Intelligence · Computer Science 2023-08-22 Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia

Mass-shooting events pose a significant challenge to public safety, generating large volumes of unstructured textual data that hinder effective investigations and the formulation of public policy. Despite the urgency, few prior studies have…

Computers and Society · Computer Science 2025-04-18 Benign John Ihugba , Afsana Nasrin , Ling Wu , Lin Li , Lijun Qian , Xishuang Dong

Logical reasoning is a fundamental aspect of human intelligence and a key component of tasks like problem-solving and decision-making. Recent advancements have enabled Large Language Models (LLMs) to potentially exhibit reasoning…

Computation and Language · Computer Science 2023-11-13 Jiazhan Feng , Ruochen Xu , Junheng Hao , Hiteshi Sharma , Yelong Shen , Dongyan Zhao , Weizhu Chen

Large language models (LLMs) find increasing applications in many fields. Here, three LLM chatbots (ChatGPT-3.5, ChatGPT-4 and Bard) are assessed - in their current form, as publicly available - for their ability to recognize Alzheimer's…

Computation and Language · Computer Science 2024-02-06 Balamurali B T , Jer-Ming Chen

Generative large language models (LLMs), e.g., ChatGPT, have demonstrated remarkable proficiency across several NLP tasks, such as machine translation, text summarization. Recent research (Kocmi and Federmann, 2023) has shown that utilizing…

Computation and Language · Computer Science 2024-06-06 Qingyu Lu , Baopu Qiu , Liang Ding , Kanjian Zhang , Tom Kocmi , Dacheng Tao

Rare diseases (RDs) are collectively common and affect 300 million people worldwide. Accurate phenotyping is critical for informing diagnosis and treatment, but RD phenotypes are often embedded in unstructured text and time-consuming to…

Computation and Language · Computer Science 2024-06-28 Cathy Shyr , Yan Hu , Paul A. Harris , Hua Xu

Large Language models (LLMs), such as ChatGPT, have gained popularity in recent years with the advancement of Natural Language Processing (NLP), with use cases spanning many disciplines and daily lives as well. LLMs inherit explicit and…

Computation and Language · Computer Science 2025-12-01 Fatima Kazi

Traditional dataset retrieval systems rely on metadata for indexing, rather than on the underlying data values. However, high-quality metadata creation and enrichment often require manual annotations, which is a labour-intensive and…

Databases · Computer Science 2024-09-09 Margherita Martorana , Tobias Kuhn , Lise Stork , Jacco van Ossenbruggen

Few-shot prompting and step-by-step reasoning have enhanced the capabilities of Large Language Models (LLMs) in tackling complex tasks including code generation. In this paper, we introduce a prompt selection and augmentation algorithm…

Robotics · Computer Science 2024-03-21 On Tai Wu , Frodo Kin Sun Chan , Zunhao Zhang , Yan Nei Law , Benny Drescher , Edmond Shiao Bun Lai

When asked, large language models (LLMs) like ChatGPT claim that they can assist with relevance judgments but it is not clear whether automated judgments can reliably be used in evaluations of retrieval systems. In this perspectives paper,…

Large language models (LLMs), such as GPT-3 and GPT-4, have demonstrated exceptional performance in various natural language processing tasks and have shown the ability to solve certain reasoning problems. However, their reasoning…

Artificial Intelligence · Computer Science 2023-07-18 Adam Ishay , Zhun Yang , Joohyung Lee

Electronic health records contain an enormous amount of valuable information, but many are recorded in free text. Information extraction is the strategy to transform the sequence of characters into structured data, which can be employed for…

Computation and Language · Computer Science 2024-01-03 Danqing Hu , Bing Liu , Xiaofeng Zhu , Xudong Lu , Nan Wu