English
Related papers

Related papers: ChatLog: Carefully Evaluating the Evolution of Cha…

200 papers

The rapid advancement of artificial intelligence (AI) has highlighted ChatGPT as a pivotal technology in the field of information retrieval (IR). Distinguished from its predecessors, ChatGPT offers significant benefits that have attracted…

Information Retrieval · Computer Science 2024-04-18 Yizheng Huang , Jimmy Huang

Recently, the ChatGPT LLM has received great attention: it can be used as a bot for discussing source code, prompting it to suggest changes, provide descriptions or even generate code. Typical demonstrations generally focus on existing…

Software Engineering · Computer Science 2023-09-01 Haoye Tian , Weiqi Lu , Tsz On Li , Xunzhu Tang , Shing-Chi Cheung , Jacques Klein , Tegawendé F. Bissyandé

Dialogue systems have become recently essential in our life. Their use is getting more and more fluid and easy throughout the time. This boils down to the improvements made in NLP and AI fields. In this paper, we try to provide an overview…

Computation and Language · Computer Science 2019-03-22 Maali Mnasri

In the dynamic landscape of software engineering, the emergence of ChatGPT-generated code signifies a distinctive and evolving paradigm in development practices. We delve into the impact of interactions with ChatGPT on the software…

Software Engineering · Computer Science 2025-04-09 Piotr Przymus , Mikołaj Fejzer , Jakub Narębski , Krzysztof Stencel

One critical issue for chat systems is to stay consistent about preferences, opinions, beliefs and facts of itself, which has been shown a difficult problem. In this work, we study methods to assess and bolster utterance consistency of chat…

Computation and Language · Computer Science 2024-01-22 Mian Zhang , Lifeng Jin , Linfeng Song , Haitao Mi , Dong Yu

ChatGPT is currently the most popular large language model (LLM), with over 100 million users, making a significant impact on people's lives. However, due to the presence of jailbreak vulnerabilities, ChatGPT might have negative effects on…

Software Engineering · Computer Science 2023-12-19 Poorna Chander Reddy Puttaparthi , Soham Sanjay Deo , Hakan Gul , Yiming Tang , Weiyi Shang , Zhe Yu

ChatGPT is a language model based on Generative AI. Existing research work on ChatGPT focused on its use in various domains. However, its potential for Sign Language Translation (SLT) is yet to be explored. This paper addresses this void.…

Computation and Language · Computer Science 2024-01-17 Nada Shahin , Leila Ismail

Large Language Models (LLMs) are frequently discussed in academia and the general public as support tools for virtually any use case that relies on the production of text, including software engineering. Currently there is much debate, but…

Software Engineering · Computer Science 2024-05-22 Ranim Khojah , Mazen Mohamad , Philipp Leitner , Francisco Gomes de Oliveira Neto

Chatbots have long been capable of answering basic questions and even responding to obscure prompts, but recently their improvements have been far more significant. Modern chatbots like Open AIs ChatGPT3 not only have the ability to answer…

Computation and Language · Computer Science 2023-03-22 Grant Rosario , David Noever

In recent years, personality has been regarded as a valuable personal factor being incorporated into numerous tasks such as sentiment analysis and product recommendation. This has led to widespread attention to text-based personality…

Computation and Language · Computer Science 2023-12-29 Yu Ji , Wen Wu , Hong Zheng , Yi Hu , Xi Chen , Liang He

This study investigated how perceived workload, satisfaction, performance expectancy, and risk-benefit perception influenced users' trust in Chat Generative Pre-Trained Transformer (ChatGPT). We aimed to understand the nuances of user…

Computers and Society · Computer Science 2023-11-13 Hamid Shamszare , Avishek Choudhury

As artificial intelligence technology continues to advance, chatbots are becoming increasingly powerful. Among them, ChatGPT, launched by OpenAI, has garnered widespread attention globally due to its powerful natural language processing…

Cryptography and Security · Computer Science 2026-02-03 Yushan Xiang , Zhongwen Li , Xiaoqi Li

Evaluating the quality of generated text is a challenging task in NLP, due to the inherent complexity and diversity of text. Recently, large language models (LLMs) have garnered significant attention due to their impressive performance in…

Computation and Language · Computer Science 2023-09-19 Yi Chen , Rui Wang , Haiyun Jiang , Shuming Shi , Ruifeng Xu

ChatGPT is a type of artificial intelligence language model that uses deep learning algorithms to generate human-like responses to text-based prompts. The introduction of the latest ChatGPT version in November of 2022 has caused shockwaves…

Computers and Society · Computer Science 2023-05-02 Mohammad Fraiwan , Natheer Khasawneh

Generative artificial intelligence tools, like ChatGPT, are an increasingly utilized resource among computational social scientists. Nevertheless, there remains space for improved understanding of the performance of ChatGPT in complex tasks…

Computation and Language · Computer Science 2025-12-02 Breanna E. Green , Ashley L. Shea , Pengfei Zhao , Drew B. Margolin

Natural Language Processing (NLP) for Requirements Engineering (RE) (NLP4RE) seeks to apply NLP tools, techniques, and resources to the RE process to increase the quality of the requirements. There is little research involving the…

Software Engineering · Computer Science 2023-07-17 Krishna Ronanki , Christian Berger , Jennifer Horkoff

Objective: To evaluate the efficiency of large language models (LLMs) such as ChatGPT to assist in diagnosing neuro-ophthalmic diseases based on detailed case descriptions. Methods: We selected 22 different case reports of neuro-ophthalmic…

Computers and Society · Computer Science 2023-09-25 Yeganeh Madadi , Mohammad Delsoz , Priscilla A. Lao , Joseph W. Fong , TJ Hollingsworth , Malik Y. Kahook , Siamak Yousefi

The recent success of large language models (LLMs) has shown great potential to develop more powerful conversational recommender systems (CRSs), which rely on natural language conversations to satisfy user needs. In this paper, we embark on…

Computation and Language · Computer Science 2024-06-21 Xiaolei Wang , Xinyu Tang , Wayne Xin Zhao , Jingyuan Wang , Ji-Rong Wen

Code review is an essential activity for ensuring the quality and maintainability of software projects. However, it is a time-consuming and often error-prone task that can significantly impact the development process. Recently, ChatGPT, a…

Software Engineering · Computer Science 2023-09-18 Qi Guo , Junming Cao , Xiaofei Xie , Shangqing Liu , Xiaohong Li , Bihuan Chen , Xin Peng

Mathematical questioning is crucial for assessing students problem-solving skills. Since manually creating such questions requires substantial effort, automatic methods have been explored. Existing state-of-the-art models rely on…

Computation and Language · Computer Science 2024-02-29 Phuoc Pham Van Long , Duc Anh Vu , Nhat M. Hoang , Xuan Long Do , Anh Tuan Luu