English
Related papers

Related papers: ChatGPT Prompting Cannot Estimate Predictive Uncer…

200 papers

Large Language Models (LLMs) such as ChatGPT, have gained significant attention due to their impressive natural language processing capabilities. It is crucial to prioritize human-centered principles when utilizing these models.…

Computation and Language · Computer Science 2023-06-21 Yue Huang , Qihui Zhang , Philip S. Y , Lichao Sun

Large language models (LLMs) have undergone rapid evolution and achieved remarkable results in recent times. OpenAI's ChatGPT, backed by GPT-3.5 or GPT-4, has gained instant popularity due to its strong capability across a wide range of…

Cryptography and Security · Computer Science 2023-12-12 Fangzhou Wu , Qingzhao Zhang , Ati Priya Bajaj , Tiffany Bao , Ning Zhang , Ruoyu "Fish" Wang , Chaowei Xiao

Hallucinations, the tendency to produce irrelevant/incorrect responses, are prevalent concerns in generative AI-based tools like ChatGPT. Although hallucinations in ChatGPT are studied for textual responses, it is unknown how ChatGPT…

Software Engineering · Computer Science 2024-11-13 Salma Begum Tamanna , Gias Uddin , Song Wang , Lan Xia , Longyu Zhang

This study evaluated the ability of ChatGPT, a recently developed artificial intelligence (AI) agent, to perform high-level cognitive tasks and produce text that is indistinguishable from human-generated text. This capacity raises concerns…

Artificial Intelligence · Computer Science 2022-12-20 Teo Susnjak

Purpose: Assess whether ChatGPT 4.0 is accurate enough to perform research evaluations on journal articles to automate this time-consuming task. Design/methodology/approach: Test the extent to which ChatGPT-4 can assess the quality of…

Digital Libraries · Computer Science 2024-05-01 Mike Thelwall

Large language models have demonstrated exceptional capabilities in tasks involving natural language generation, reasoning, and comprehension. This study aims to construct prompts and comments grounded in the diverse scoring criteria…

Computation and Language · Computer Science 2024-01-09 Wei Xia , Shaoguang Mao , Chanjing Zheng

ChatGPT, with its customization features and Voice Mode, has the potential for more engaging and peresonalized ESL (English as a Second Language) education. This study examines the efficacy of customized ChatGPT conversational features in…

Human-Computer Interaction · Computer Science 2026-03-17 Fanfei Meng

Large language models (LLMs) have demonstrated impressive capabilities across various NLP tasks. Additionally, LLMs are also highly valuable in supporting software engineering tasks, particularly in the field of code generation. Automatic…

Software Engineering · Computer Science 2024-04-16 Zhijie Liu , Yutian Tang , Xiapu Luo , Yuming Zhou , Liang Feng Zhang

The recent success of large language models and AI chatbots such as ChatGPT in various knowledge domains has a severe impact on teaching and learning Geography and GIScience. The underlying revolution is often compared to the introduction…

Computers and Society · Computer Science 2023-07-10 Simon Scheider , Harm Bartholomeus , Judith Verstegen

The proliferation of NLP-powered language technologies, AI-based natural language generation models, and English as a mainstream means of communication among both native and non-native speakers make the output of AI-powered tools especially…

Computation and Language · Computer Science 2025-02-07 Karolina Rudnicka

Large-scale language models (LLMs) have emerged as a groundbreaking innovation in the realm of question-answering and conversational agents. These models, leveraging different deep learning architectures such as Transformers, are trained on…

Software Engineering · Computer Science 2023-07-18 Fardin Ahsan Sakib , Saadat Hasan Khan , A. H. M. Rezaul Karim

Harnessing logical reasoning ability is a comprehensive natural language understanding endeavor. With the release of Generative Pretrained Transformer 4 (GPT-4), highlighted as "advanced" at reasoning tasks, we are eager to learn the GPT-4…

Computation and Language · Computer Science 2023-05-08 Hanmeng Liu , Ruoxi Ning , Zhiyang Teng , Jian Liu , Qiji Zhou , Yue Zhang

There has been a recent explosion of research on Large Language Models (LLMs) for software engineering tasks, in particular code generation. However, results from LLMs can be highly unstable; nondeterministically returning very different…

Software Engineering · Computer Science 2024-10-18 Shuyin Ouyang , Jie M. Zhang , Mark Harman , Meng Wang

Large language models respond well in high-resource languages like English but struggle in low-resource languages. It may arise from the lack of high-quality instruction following data in these languages. Directly translating English…

Computation and Language · Computer Science 2024-05-31 Chong Li , Wen Yang , Jiajun Zhang , Jinliang Lu , Shaonan Wang , Chengqing Zong

Recommendation algorithms have been pivotal in handling the overwhelming volume of online content. However, these algorithms seldom consider direct user input, resulting in superficial interaction between them. Efforts have been made to…

Information Retrieval · Computer Science 2024-01-09 Kyle Dylan Spurlock , Cagla Acun , Esin Saka , Olfa Nasraoui

Objective: Assess the feasibility of using ChatGPT or a similar AI-based chatbot for patient-provider communication. Participants: A US representative sample of 430 study participants aged 18 and above. 53.2% of respondents analyzed were…

Human-Computer Interaction · Computer Science 2023-01-25 Oded Nov , Nina Singh , Devin Mann

While large language models have made strides in natural language processing, their proficiency in complex reasoning tasks requiring formal language comprehension, such as chess, remains less investigated. This paper probes the performance…

Computation and Language · Computer Science 2023-08-30 Mu-Tien Kuo , Chih-Chung Hsueh , Richard Tzong-Han Tsai

Random Number Generation Tasks (RNGTs) are used in psychology for examining how humans generate sequences devoid of predictable patterns. By adapting an existing human RNGT for an LLM-compatible environment, this preliminary study tests…

Artificial Intelligence · Computer Science 2024-08-21 Rachel M. Harrison

ChatGPT is a large language model recently released by the OpenAI company. In this technical report, we explore for the first time the capability of ChatGPT for programming numerical algorithms. Specifically, we examine the capability of…

Machine Learning · Computer Science 2023-04-28 Ali Kashefi , Tapan Mukerji

The release of ChatGPT has uncovered a range of possibilities whereby large language models (LLMs) can substitute human intelligence. In this paper, we seek to understand whether ChatGPT has the potential to reproduce human-generated label…

Artificial Intelligence · Computer Science 2023-04-25 Yiming Zhu , Peixian Zhang , Ehsan-Ul Haq , Pan Hui , Gareth Tyson