English
Related papers

Related papers: ChatLog: Carefully Evaluating the Evolution of Cha…

200 papers

Hate speech is a severe issue that affects many online platforms. So far, several studies have been performed to develop robust hate speech detection systems. Large language models like ChatGPT have recently shown a great promise in…

Computation and Language · Computer Science 2023-05-24 Mithun Das , Saurabh Kumar Pandey , Animesh Mukherjee

Chat Generative Pre-trained Transformer (ChatGPT) has gained significant interest and attention since its launch in November 2022. It has shown impressive performance in various domains, including passing exams and creative writing.…

Computation and Language · Computer Science 2023-08-28 Shahab Saquib Sohail , Faiza Farhat , Yassine Himeur , Mohammad Nadeem , Dag Øivind Madsen , Yashbir Singh , Shadi Atalla , Wathiq Mansoor

ChatGPT is a generative pretrained transformer language model created using artificial intelligence implemented as chatbot which can provide very detailed responses to a wide variety of questions. As a very contemporary phenomenon, this…

Cryptography and Security · Computer Science 2023-07-14 Sheetal Temara

In Agile software development, user stories play a vital role in capturing and conveying end-user needs, prioritizing features, and facilitating communication and collaboration within development teams. However, automated methods for…

Software Engineering · Computer Science 2023-06-22 Krishna Ronanki , Beatriz Cabrero-Daniel , Christian Berger

ChatGPT, powered by a large language model (LLM), has revolutionized everyday human-computer interaction (HCI) since its 2022 release. While now used by millions around the world, a coherent pathway for evaluating the user experience (UX)…

Human-Computer Interaction · Computer Science 2025-03-21 Katie Seaborn

Recently, ChatGPT has attracted great attention, as it can generate fluent and high-quality responses to human inquiries. Several prior studies have shown that ChatGPT attains remarkable generation ability compared with existing models.…

Computation and Language · Computer Science 2023-03-03 Qihuang Zhong , Liang Ding , Juhua Liu , Bo Du , Dacheng Tao

The increasing volume of log data produced by software-intensive systems makes it impractical to analyze them manually. Many deep learning-based methods have been proposed for log-based anomaly detection. These methods face several…

Machine Learning · Computer Science 2023-09-06 Jiaxing Qi , Shaohan Huang , Zhongzhi Luan , Carol Fung , Hailong Yang , Depei Qian

ChatGPT took the world by storm for its impressive abilities. Due to its release without documentation, scientists immediately attempted to identify its limits, mainly through its performance in natural language processing (NLP) tasks. This…

Computation and Language · Computer Science 2023-11-14 Martino Pelucchi , Matias Valdenegro-Toro

Text summarization has been a crucial problem in natural language processing (NLP) for several decades. It aims to condense lengthy documents into shorter versions while retaining the most critical information. Various methods have been…

Computation and Language · Computer Science 2023-02-17 Xianjun Yang , Yan Li , Xinlu Zhang , Haifeng Chen , Wei Cheng

The capability of Large Language Models (LLMs) like ChatGPT to comprehend user intent and provide reasonable responses has made them extremely popular lately. In this paper, we focus on assessing the overall ability of ChatGPT using 7…

Computation and Language · Computer Science 2023-04-25 Bo Li , Gexiang Fang , Yang Yang , Quansen Wang , Wei Ye , Wen Zhao , Shikun Zhang

Interest in Large Language Models (LLMs) has increased drastically since the emergence of ChatGPT and the outstanding positive societal response to the ease with which it performs tasks in Natural Language Processing (NLP). The triumph of…

Computation and Language · Computer Science 2023-04-06 Oluwatosin Ogundare , Gustavo Quiros Araya

The introduction of ChatGPT has garnered widespread attention in both academic and industrial communities. ChatGPT is able to respond effectively to a wide range of human questions, providing fluent and comprehensive answers that…

Computation and Language · Computer Science 2023-01-19 Biyang Guo , Xin Zhang , Ziyuan Wang , Minqi Jiang , Jinran Nie , Yuxuan Ding , Jianwei Yue , Yupeng Wu

Since the launch of ChatGPT in 2022, an increasing number of ChatGPT-related projects are being published on GitHub, sparking widespread discussions. However, GitHub does not provide a detailed classification of these projects to help users…

Software Engineering · Computer Science 2024-08-13 Zheng Lin , Neng Zhang , Chao Liu , Zibin Zheng

Recommendation systems have witnessed significant advancements and have been widely used over the past decades. However, most traditional recommendation methods are task-specific and therefore lack efficient generalization ability.…

Information Retrieval · Computer Science 2023-10-30 Junling Liu , Chao Liu , Peilin Zhou , Renjie Lv , Kang Zhou , Yan Zhang

This report provides a preliminary evaluation of ChatGPT for machine translation, including translation prompt, multilingual translation, and translation robustness. We adopt the prompts advised by ChatGPT to trigger its translation ability…

Computation and Language · Computer Science 2023-11-03 Wenxiang Jiao , Wenxuan Wang , Jen-tse Huang , Xing Wang , Shuming Shi , Zhaopeng Tu

Large language models such as ChatGPT are increasingly explored in medical domains. However, the absence of standard guidelines for performance evaluation has led to methodological inconsistencies. This study aims to summarize the available…

Methodology · Statistics 2024-03-12 Qiuhong Wei , Zhengxiong Yao , Ying Cui , Bo Wei , Zhezhen Jin , Ximing Xu

The rampant spread of fake news has adversely affected society, resulting in extensive research on curbing its spread. As a notable milestone in large language models (LLMs), ChatGPT has gained significant attention due to its exceptional…

Computation and Language · Computer Science 2024-04-09 Yue Huang , Lichao Sun

This paper presents a comprehensive evaluation of the code generation capabilities of ChatGPT, a prominent large language model, compared to human programmers. A novel dataset of 131 code-generation prompts across 5 categories was curated…

Software Engineering · Computer Science 2023-11-07 Muhammad Fawad Akbar Khan , Max Ramsdell , Erik Falor , Hamid Karimi

With a major focus on its history, difficulties, and promise, this research paper provides a thorough analysis of the chatbot technology environment as it exists today. It provides a very flexible chatbot system that makes use of…

Artificial Intelligence · Computer Science 2023-10-16 Shivom Aggarwal , Shourya Mehra , Pritha Mitra

Large Language Models (LLMs) like ChatGPT have demonstrated amazing capabilities in comprehending user intents and generate reasonable and useful responses. Beside their ability to chat, their capabilities in various natural language…

Computation and Language · Computer Science 2026-02-12 Liz Li , Wei Zhu