English
Related papers

Related papers: ChatGPT Prompting Cannot Estimate Predictive Uncer…

200 papers

Large language models have gained considerable interest for their impressive performance on various tasks. Among these models, ChatGPT developed by OpenAI has become extremely popular among early adopters who even regard it as a disruptive…

Computation and Language · Computer Science 2023-04-10 Aman Rangapur , Haoran Wang

ChatGPT, a large-scale language model based on the advanced GPT-3.5 architecture, has shown remarkable potential in various Natural Language Processing (NLP) tasks. However, there is currently a dearth of comprehensive study exploring its…

Computation and Language · Computer Science 2023-04-05 Tao Fang , Shu Yang , Kaixin Lan , Derek F. Wong , Jinpeng Hu , Lidia S. Chao , Yue Zhang

Spurred by advancements in scale, large language models (LLMs) have demonstrated the ability to perform a variety of natural language processing (NLP) tasks zero-shot -- i.e., without adaptation on downstream data. Recently, the debut of…

Computation and Language · Computer Science 2023-11-21 Chengwei Qin , Aston Zhang , Zhuosheng Zhang , Jiaao Chen , Michihiro Yasunaga , Diyi Yang

Generative artificial intelligence tools, like ChatGPT, are an increasingly utilized resource among computational social scientists. Nevertheless, there remains space for improved understanding of the performance of ChatGPT in complex tasks…

Computation and Language · Computer Science 2025-12-02 Breanna E. Green , Ashley L. Shea , Pengfei Zhao , Drew B. Margolin

ChatGPT is an AI language model developed by OpenAI that can understand and generate human-like text. It can be used for a variety of use cases such as language generation, question answering, text summarization, chatbot development,…

Human-Computer Interaction · Computer Science 2023-10-09 Ishika Joshi , Ritvik Budhiraja , Harshal Dev , Jahnvi Kadia , M. Osama Ataullah , Sayan Mitra , Dhruv Kumar , Harshal D. Akolekar

ChatGPT shows remarkable capabilities for machine translation (MT). Several prior studies have shown that it achieves comparable results to commercial systems for high-resource languages, but lags behind in complex tasks, e.g., low-resource…

Computation and Language · Computer Science 2023-10-23 Keqin Peng , Liang Ding , Qihuang Zhong , Li Shen , Xuebo Liu , Min Zhang , Yuanxin Ouyang , Dacheng Tao

ChatGPT, as a recently launched large language model (LLM), has shown superior performance in various natural language processing (NLP) tasks. However, two major limitations hinder its potential applications: (1) the inflexibility of…

Computation and Language · Computer Science 2023-09-20 Yucheng Shi , Hehuan Ma , Wenliang Zhong , Qiaoyu Tan , Gengchen Mai , Xiang Li , Tianming Liu , Junzhou Huang

Over the past decade, predictive language modeling for code has proven to be a valuable tool for enabling new forms of automation for developers. More recently, we have seen the advent of general purpose "large language models", based on…

Software Engineering · Computer Science 2023-06-05 Sajed Jalil , Suzzana Rafi , Thomas D. LaToza , Kevin Moran , Wing Lam

The increasing use of large language models (LLMs) in natural language processing (NLP) tasks has sparked significant interest in evaluating their effectiveness across diverse applications. While models like ChatGPT and DeepSeek have shown…

Computation and Language · Computer Science 2025-08-12 Wael Etaiwi , Bushra Alhijawi

Interest in Large Language Models (LLMs) has increased drastically since the emergence of ChatGPT and the outstanding positive societal response to the ease with which it performs tasks in Natural Language Processing (NLP). The triumph of…

Computation and Language · Computer Science 2023-04-06 Oluwatosin Ogundare , Gustavo Quiros Araya

Large Language Models (LLM) have become sophisticated enough that complex computer programs can be created through interpretation of plain English sentences and implemented in a variety of modern languages such as Python, Java Script, C++…

Software Engineering · Computer Science 2023-09-04 Simon Thorne

This paper investigates the capabilities of ChatGPT as an automated assistant in diverse domains, including scientific writing, mathematics, education, programming, and healthcare. We explore the potential of ChatGPT to enhance…

Human-Computer Interaction · Computer Science 2023-06-07 Amos Azaria , Rina Azoulay , Shulamit Reches

Extractive summarization is a crucial task in natural language processing that aims to condense long documents into shorter versions by directly extracting sentences. The recent introduction of large language models has attracted…

Computation and Language · Computer Science 2023-10-11 Haopeng Zhang , Xiao Liu , Jiawei Zhang

The way users acquire information is undergoing a paradigm shift with the advent of ChatGPT. Unlike conventional search engines, ChatGPT retrieves knowledge from the model itself and generates answers for users. ChatGPT's impressive…

Cryptography and Security · Computer Science 2023-10-06 Xinyue Shen , Zeyuan Chen , Michael Backes , Yang Zhang

The introduction of ChatGPT has garnered widespread attention in both academic and industrial communities. ChatGPT is able to respond effectively to a wide range of human questions, providing fluent and comprehensive answers that…

Computation and Language · Computer Science 2023-01-19 Biyang Guo , Xin Zhang , Ziyuan Wang , Minqi Jiang , Jinran Nie , Yuxuan Ding , Jianwei Yue , Yupeng Wu

OpenAI has released the Chat Generative Pre-trained Transformer (ChatGPT) and revolutionized the approach in artificial intelligence to human-model interaction. Several publications on ChatGPT evaluation test its effectiveness on well-known…

ChatGPT has the ability to generate grammatically flawless and seemingly-human replies to different types of questions from various domains. The number of its users and of its applications is growing at an unprecedented rate. Unfortunately,…

Computation and Language · Computer Science 2023-02-01 Sandra Mitrović , Davide Andreoletti , Omran Ayoub

In this paper, we assess the efficacy of ChatGPT (version Feb 2023), a large-scale language model, in solving probability problems typically presented in introductory computer engineering exams. Our study comprised a set of 23 probability…

Large language models such as ChatGPT are increasingly explored in medical domains. However, the absence of standard guidelines for performance evaluation has led to methodological inconsistencies. This study aims to summarize the available…

Methodology · Statistics 2024-03-12 Qiuhong Wei , Zhengxiong Yao , Ying Cui , Bo Wei , Zhezhen Jin , Ximing Xu

Developed by OpenAI, ChatGPT (Conditional Generative Pre-trained Transformer) is an artificial intelligence technology that is fine-tuned using supervised machine learning and reinforcement learning techniques, allowing a computer to…