English
Related papers

Related papers: ChatGPT Prompting Cannot Estimate Predictive Uncer…

200 papers

Background: The integration of artificial intelligence (AI) into daily life, particularly through chatbots utilizing natural language processing (NLP), presents both revolutionary potential and unique challenges. This intended to…

Computation and Language · Computer Science 2024-04-16 Gian Alexandre Michaelsen , Renato P. dos Santos

Human cognitive performance is enhanced by the use of tools. For example, a human can produce a much greater, and more accurate, volume of mathematical calculation in a unit of time using a calculator or a spreadsheet application on a…

Human-Computer Interaction · Computer Science 2024-01-23 Ron Fulbright , Miranda Morrison

ChatGPT is a chatbot that can answer text prompts fairly accurately, even performing very well on postgraduate-level questions. Many educators have found that their take-home or remote tests and exams are vulnerable to ChatGPT-based…

Computation and Language · Computer Science 2024-02-26 Shanker Ram , Chen Qian

ChatGPT has changed the AI community and an active research line is the performance evaluation of ChatGPT. A key challenge for the evaluation is that ChatGPT is still closed-source and traditional benchmark datasets may have been used by…

Computation and Language · Computer Science 2024-05-13 Ming Liu , Ran Liu , Ye Zhu , Hua Wang , Youyang Qu , Rongsheng Li , Yongpan Sheng , Wray Buntine

ChatGPT has gained a huge popularity since its introduction. Its positive aspects have been reported through many media platforms, and some analyses even showed that ChatGPT achieved a decent grade in professional exams, adding extra…

Computation and Language · Computer Science 2023-11-15 Myeongjun Erik Jang , Thomas Lukasiewicz

ChatGPT has recently emerged as a powerful tool for performing diverse NLP tasks. However, ChatGPT has been criticized for generating nonfactual responses, raising concerns about its usability for sensitive tasks like fact verification.…

Information Retrieval · Computer Science 2023-11-14 Mohna Chakraborty , Adithya Kulkarni , Qi Li

This study sets out to answer one major question: Who thinks better, non-native speakers of English or ChatGPT?, providing evidence from processing and interpreting center-embedding English constructions that human brain surpasses ChatGPT,…

Computation and Language · Computer Science 2025-12-23 Mohammed Q. Shormani

Evaluating the quality of generated text is a challenging task in NLP, due to the inherent complexity and diversity of text. Recently, large language models (LLMs) have garnered significant attention due to their impressive performance in…

Computation and Language · Computer Science 2023-09-19 Yi Chen , Rui Wang , Haiyun Jiang , Shuming Shi , Ruifeng Xu

Recently, ChatGPT has attracted great attention, as it can generate fluent and high-quality responses to human inquiries. Several prior studies have shown that ChatGPT attains remarkable generation ability compared with existing models.…

Computation and Language · Computer Science 2023-03-03 Qihuang Zhong , Liang Ding , Juhua Liu , Bo Du , Dacheng Tao

Language models (LMs) are statistical models trained to assign probability to human-generated text. As such, it is reasonable to question whether they approximate linguistic variability exhibited by humans well. This form of statistical…

Computation and Language · Computer Science 2024-03-19 Evgenia Ilia , Wilker Aziz

Artificial Intelligence (AI) advancements have enabled the development of Large Language Models (LLMs) that can perform a variety of tasks with remarkable semantic understanding and accuracy. ChatGPT is one such LLM that has gained…

Software Engineering · Computer Science 2024-08-02 M. Mehdi Kholoosi , M. Ali Babar , Roland Croft

ChatGPT has shown its great power in text processing, including its reasoning ability from text reading. However, there has not been any direct comparison between human readers and ChatGPT in reasoning ability related to text reading. This…

Computation and Language · Computer Science 2023-11-20 Tongquan Zhou , Yao Zhang , Siyi Cao , Yulu Li , Tao Wang

Context: ChatGPT and other large language models (LLMs) are widely used across healthcare, business, economics, engineering, and software engineering (SE). Despite their popularity, concerns persist about their reliability, especially their…

Software Engineering · Computer Science 2025-04-29 Vahid Garousi

How good a research scientist is ChatGPT? We systematically probed the capabilities of GPT-3.5 and GPT-4 across four central components of the scientific process: as a Research Librarian, Research Ethicist, Data Generator, and Novel Data…

Artificial Intelligence · Computer Science 2024-06-24 Steven A. Lehr , Aylin Caliskan , Suneragiri Liyanage , Mahzarin R. Banaji

Large Language Models (LLMs) have revo lutionized natural language processing Natural Language Processing (NLP), with Chat Generative Pre-trained Transformer (ChatGPT) standing out as a notable exampledue to its advanced capabilities and…

Computation and Language · Computer Science 2025-03-25 Azim Akhtarshenas , Afshin Dini , Navid Ayoobi

Artificial intelligence is gaining traction in more ways than ever before. The popularity of language models and AI-based businesses has soared since ChatGPT was made available to the general public via OpenAI. It is becoming increasingly…

Computers and Society · Computer Science 2023-07-31 Prabin Sharma , Kisan Thapa , Dikshya Thapa , Prastab Dhakal , Mala Deep Upadhaya , Santosh Adhikari , Salik Ram Khanal

As AI becomes more integral in our lives, the need for transparency and responsibility grows. While natural language explanations (NLEs) are vital for clarifying the reasoning behind AI decisions, evaluating them through human judgments is…

Computation and Language · Computer Science 2024-03-27 Fan Huang , Haewoon Kwak , Kunwoo Park , Jisun An

Scientific workflow systems are increasingly popular for expressing and executing complex data analysis pipelines over large datasets, as they offer reproducibility, dependability, and scalability of analyses by automatic parallelization on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-09 Mario Sänger , Ninon De Mecquenem , Katarzyna Ewa Lewińska , Vasilis Bountris , Fabian Lehmann , Ulf Leser , Thomas Kosch

Large Language Models (LLMs) have recently shown impressive abilities in handling various natural language-related tasks. Among different LLMs, current studies have assessed ChatGPT's superior performance across manifold tasks, especially…

The rampant spread of fake news has adversely affected society, resulting in extensive research on curbing its spread. As a notable milestone in large language models (LLMs), ChatGPT has gained significant attention due to its exceptional…

Computation and Language · Computer Science 2024-04-09 Yue Huang , Lichao Sun