English
Related papers

Related papers: Systematic Evaluation of GPT-3 for Zero-Shot Perso…

200 papers

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation across various domains, including medicine. We present a comprehensive evaluation of GPT-4, a state-of-the-art LLM, on…

Computation and Language · Computer Science 2023-04-13 Harsha Nori , Nicholas King , Scott Mayer McKinney , Dean Carignan , Eric Horvitz

Assessing learners in ill-defined domains, such as scenario-based human tutoring training, is an area of limited research. Equity training requires a nuanced understanding of context, but do contemporary large language models (LLMs) have a…

Human-Computer Interaction · Computer Science 2025-01-14 Sanjit Kakarla , Conrad Borchers , Danielle Thomas , Shambhavi Bhushan , Kenneth R. Koedinger

This paper extends recent investigations on the emotional reasoning abilities of Large Language Models (LLMs). Current research on LLMs has not directly evaluated the distinction between how LLMs predict the self-attribution of emotions and…

Artificial Intelligence · Computer Science 2024-08-27 Ala N. Tak , Jonathan Gratch

Background: Advancements in large language models (LLMs) have opened new possibilities in psychiatric interviews, an underexplored area where LLMs could be valuable. This study focuses on enhancing psychiatric interviews by analyzing…

Artificial Intelligence · Computer Science 2025-02-11 Jae-hee So , Joonhwan Chang , Eunji Kim , Junho Na , JiYeon Choi , Jy-yong Sohn , Byung-Hoon Kim , Sang Hui Chu

Most of the recent work in leveraging Large Language Models (LLMs) such as GPT-3 for Machine Translation (MT) has focused on selecting the few-shot samples for prompting. In this work, we try to better understand the role of demonstration…

Computation and Language · Computer Science 2023-10-25 Vikas Raunak , Hany Hassan Awadalla , Arul Menezes

With the emergence of numerous Large Language Models (LLM), the usage of such models in various Natural Language Processing (NLP) applications is increasing extensively. Counterspeech generation is one such key task where efforts are made…

Computation and Language · Computer Science 2024-03-25 Punyajoy Saha , Aalok Agrawal , Abhik Jana , Chris Biemann , Animesh Mukherjee

Large language models (LLMs) such as ChatGPT, GPT-4, Claude-3, and Llama are being integrated across a variety of industries. Despite this rapid proliferation, experts are calling for caution in the interpretation and adoption of LLMs,…

Computation and Language · Computer Science 2024-10-23 Ryosuke Sonoda , Ramya Srinivasan

Very large language models (LLMs), such as GPT-3 and Codex have achieved state-of-the-art performance on several natural-language tasks, and show great promise also for code. A particularly exciting aspect of LLMs is their knack for…

Software Engineering · Computer Science 2022-09-09 Toufique Ahmed , Premkumar Devanbu

The rapid expansion of the digital world has propelled sentiment analysis into a critical tool across diverse sectors such as marketing, politics, customer service, and healthcare. While there have been significant advancements in sentiment…

Computation and Language · Computer Science 2024-04-08 Md. Arid Hasan , Shudipta Das , Afiyat Anjum , Firoj Alam , Anika Anjum , Avijit Sarker , Sheak Rashed Haider Noori

Recently, Large Language Models like ChatGPT have demonstrated remarkable proficiency in various Natural Language Processing tasks. Their application in Requirements Engineering, especially in requirements classification, has gained…

Artificial Intelligence · Computer Science 2024-04-17 Abdelkarim El-Hajjami , Nicolas Fafin , Camille Salinesi

Prior work has shown that finetuning large language models (LLMs) using machine-generated instruction-following data enables such models to achieve remarkable zero-shot capabilities on new tasks, and no human-written instructions are…

Computation and Language · Computer Science 2023-04-07 Baolin Peng , Chunyuan Li , Pengcheng He , Michel Galley , Jianfeng Gao

Keyphrases are the essential topical phrases that summarize a document. Keyphrase generation is a long-standing NLP task for automatically generating keyphrases for a given document. While the task has been comprehensively explored in the…

Computation and Language · Computer Science 2025-03-04 Jayanth Mohan , Jishnu Ray Chowdhury , Tomas Malik , Cornelia Caragea

Generative large language models (LLMs) have become central to everyday life, producing human-like text across diverse domains. A growing body of research investigates whether these models also exhibit personality- and demographic-like…

Computation and Language · Computer Science 2025-10-14 Dana Sotto Porat , Ella Rabinovich

Scaling language models have revolutionized widespread NLP tasks, yet little comprehensively explored few-shot relation extraction with large language models. In this paper, we investigate principal methodologies, in-context learning and…

Computation and Language · Computer Science 2023-06-12 Xin Xu , Yuqi Zhu , Xiaohan Wang , Ningyu Zhang

How can we extend a pre-trained model to many language understanding tasks, without labeled or additional unlabeled data? Pre-trained language models (PLMs) have been effective for a wide range of NLP tasks. However, existing approaches…

Computation and Language · Computer Science 2023-05-29 Xuandong Zhao , Siqi Ouyang , Zhiguo Yu , Ming Wu , Lei Li

We investigate the effectiveness of large language models (LLMs), including reasoning-based and non-reasoning models, in performing zero-shot financial sentiment analysis. Using the Financial PhraseBank dataset annotated by domain experts,…

Computation and Language · Computer Science 2025-06-06 Dimitris Vamvourellis , Dhagash Mehta

Large Language Models (LLMs) have shown significant promise across various natural language processing tasks. However, their application in the field of pathology, particularly for extracting meaningful insights from unstructured medical…

Computation and Language · Computer Science 2025-03-04 Rachit Saluja , Jacob Rosenthal , Yoav Artzi , David J. Pisapia , Benjamin L. Liechty , Mert R. Sabuncu

Large-scale generative language models such as GPT-3 are competitive few-shot learners. While these models are known to be able to jointly represent many different languages, their training data is dominated by English, potentially limiting…

Many recent studies have shown the ability of large language models (LLMs) to achieve state-of-the-art performance on many NLP tasks, such as question answering, text summarization, coding, and translation. In some cases, the results…

Computation and Language · Computer Science 2024-10-11 Elnara Galimzhanova , Cristina Ioana Muntean , Franco Maria Nardini , Raffaele Perego , Guido Rocchietti

Self-assessment is a key aspect of reliable intelligence, yet evaluations of large language models (LLMs) focus mainly on task accuracy. We adapted the 10-item General Self-Efficacy Scale (GSES) to elicit simulated self-assessments from ten…

Artificial Intelligence · Computer Science 2025-11-27 Daniel I Jackson , Emma L Jensen , Syed-Amad Hussain , Emre Sezgin