English
Related papers

Related papers: ChatLog: Carefully Evaluating the Evolution of Cha…

200 papers

The increasing use of large language models (LLMs) in natural language processing (NLP) tasks has sparked significant interest in evaluating their effectiveness across diverse applications. While models like ChatGPT and DeepSeek have shown…

Computation and Language · Computer Science 2025-08-12 Wael Etaiwi , Bushra Alhijawi

Large language models (LLMs) such as ChatGPT are increasingly being used for various use cases, including text content generation at scale. Although detection methods for such AI-generated text exist already, we investigate ChatGPT's…

Computation and Language · Computer Science 2023-08-21 Amrita Bhattacharjee , Huan Liu

ChatGPT, a large-scale language model based on the advanced GPT-3.5 architecture, has shown remarkable potential in various Natural Language Processing (NLP) tasks. However, there is currently a dearth of comprehensive study exploring its…

Computation and Language · Computer Science 2023-04-05 Tao Fang , Shu Yang , Kaixin Lan , Derek F. Wong , Jinpeng Hu , Lidia S. Chao , Yue Zhang

As a natural language assistant, ChatGPT is capable of performing various tasks, including but not limited to article generation, code completion, and data analysis. Furthermore, ChatGPT has consistently demonstrated a remarkable level of…

Computation and Language · Computer Science 2023-03-15 Yunjie Ji , Yan Gong , Yiping Peng , Chao Ni , Peiyan Sun , Dongyu Pan , Baochang Ma , Xiangang Li

Spurred by advancements in scale, large language models (LLMs) have demonstrated the ability to perform a variety of natural language processing (NLP) tasks zero-shot -- i.e., without adaptation on downstream data. Recently, the debut of…

Computation and Language · Computer Science 2023-11-21 Chengwei Qin , Aston Zhang , Zhuosheng Zhang , Jiaao Chen , Michihiro Yasunaga , Diyi Yang

Large language models (LLMs) have demonstrated impressive capabilities across various NLP tasks. Additionally, LLMs are also highly valuable in supporting software engineering tasks, particularly in the field of code generation. Automatic…

Software Engineering · Computer Science 2024-04-16 Zhijie Liu , Yutian Tang , Xiapu Luo , Yuming Zhou , Liang Feng Zhang

ChatGPT is a cutting-edge artificial intelligence language model developed by OpenAI, which has attracted a lot of attention due to its surprisingly strong ability in answering follow-up questions. In this report, we aim to evaluate ChatGPT…

Computation and Language · Computer Science 2023-03-27 Haoran Wu , Wenxuan Wang , Yuxuan Wan , Wenxiang Jiao , Michael Lyu

Dialogue-based language models mark a huge milestone in the field of artificial intelligence, by their impressive ability to interact with users, as well as a series of challenging tasks prompted by customized instructions. However, the…

Artificial Intelligence · Computer Science 2023-04-26 Rui Hao , Linmei Hu , Weijian Qi , Qingliu Wu , Yirui Zhang , Liqiang Nie

Artificial intelligence (AI) and machine learning have changed the nature of scientific inquiry in recent years. Of these, the development of virtual assistants has accelerated greatly in the past few years, with ChatGPT becoming a…

Computers and Society · Computer Science 2023-05-25 Sukhpal Singh Gill , Rupinder Kaur

The pursuit of article or text summarization has captured the attention of natural language processing (NLP) practitioners, presenting itself as a formidable challenge. ChatGPT 3.5 exhibits the capacity to condense the content of up to 3000…

Computation and Language · Computer Science 2023-12-08 Arman Sarraf , Amirabbas Abbaspour

The advent of Large Language Models (LLMs) has introduced a new paradigm in Software Engineering (SE), with generative AI tools like ChatGPT gaining widespread adoption among developers. While ChatGPT's potential has been extensively…

Software Engineering · Computer Science 2026-02-19 Ruiyin Li , Peng Liang , Yifei Wang , Yangxiao Cai , Weisong Sun , Zengyang Li

OpenAI has released the Chat Generative Pre-trained Transformer (ChatGPT) and revolutionized the approach in artificial intelligence to human-model interaction. Several publications on ChatGPT evaluation test its effectiveness on well-known…

Large language models (LLMs) have made significant progress in NLP. However, their ability to memorize, represent, and leverage commonsense knowledge has been a well-known pain point. In this paper, we specifically focus on ChatGPT, a…

Computation and Language · Computer Science 2024-04-22 Ning Bian , Xianpei Han , Le Sun , Hongyu Lin , Yaojie Lu , Ben He , Shanshan Jiang , Bin Dong

Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning…

Computation and Language · Computer Science 2024-01-17 Hailin Chen , Fangkai Jiao , Xingxuan Li , Chengwei Qin , Mathieu Ravaut , Ruochen Zhao , Caiming Xiong , Shafiq Joty

Along with the development of large language models (LLMs), e.g., ChatGPT, many existing approaches and tools for software security are changing. It is, therefore, essential to understand how security-aware these models are and how these…

Computers and Society · Computer Science 2023-09-20 Jingyue Li , Per Håkon Meland , Jakob Svennevik Notland , André Storhaug , Jostein Hjortland Tysse

Understanding sentence meanings and updating information states appropriately across time -- what we call "situational understanding" (SU) -- is a critical ability for human-like AI agents. SU is essential in particular for chat models,…

Computation and Language · Computer Science 2023-10-26 Chenghao Yang , Allyson Ettinger

The recently released ChatGPT has demonstrated surprising abilities in natural language understanding and natural language generation. Machine translation relies heavily on the abilities of language understanding and generation. Thus, in…

Computation and Language · Computer Science 2023-04-24 Yuan Gao , Ruili Wang , Feng Hou

In the era of sustainable smart agriculture, a massive amount of agricultural news text is being posted on the Internet, in which massive agricultural knowledge has been accumulated. In this context, it is urgent to explore effective text…

Computation and Language · Computer Science 2023-05-25 Biao Zhao , Weiqiang Jin , Javier Del Ser , Guang Yang

ChatGPT is a chatbot that can answer text prompts fairly accurately, even performing very well on postgraduate-level questions. Many educators have found that their take-home or remote tests and exams are vulnerable to ChatGPT-based…

Computation and Language · Computer Science 2024-02-26 Shanker Ram , Chen Qian

The emergence of an AI-powered chatbot that can generate human-like sentences and write coherent essays has caught the world's attention. This paper discusses the historical overview of chatbots and the technology behind Chat Generative…

Computation and Language · Computer Science 2023-08-11 Sakib Shahriar , Kadhim Hayawi