English
Related papers

Related papers: PokemonChat: Auditing ChatGPT for Pok\'emon Univer…

200 papers

Artificial intelligence (AI) has made remarkable progress across various domains, with large language models like ChatGPT gaining substantial attention for their human-like text-generation capabilities. Despite these achievements, spatial…

Artificial Intelligence · Computer Science 2024-01-11 Fangjun Li , David C. Hogg , Anthony G. Cohn

Large, transformer-based pretrained language models like BERT, GPT, and T5 have demonstrated a deep understanding of contextual semantics and language syntax. Their success has enabled significant advances in conversational AI, including…

Computation and Language · Computer Science 2023-02-17 Christopher Richardson , Larry Heck

In recent years, large language models (LLMs), such as ChatGPT, have been pivotal in advancing various artificial intelligence applications, including natural language processing and software engineering. A promising yet underexplored area…

Software Engineering · Computer Science 2024-01-26 Hiroyuki Kirinuki , Haruto Tanno

Chain-of-Thought (CoT) prompting can effectively elicit complex multi-step reasoning from Large Language Models~(LLMs). For example, by simply adding CoT instruction ``Let's think step-by-step'' to each input query of MultiArith dataset,…

Artificial Intelligence · Computer Science 2023-04-19 Jiuhai Chen , Lichang Chen , Heng Huang , Tianyi Zhou

Emergent chain-of-thought (CoT) reasoning capabilities promise to improve performance and explainability of large language models (LLMs). However, uncertainties remain about how reasoning strategies formulated for previous model generations…

Computation and Language · Computer Science 2023-08-04 Konstantin Hebenstreit , Robert Praas , Louis P Kiesewetter , Matthias Samwald

This paper demonstrates how OpenAI's ChatGPT can be used in a few-shot setting to convert natural language instructions into a sequence of executable robot actions. The paper proposes easy-to-customize input prompts for ChatGPT that meet…

Robotics · Computer Science 2023-08-31 Naoki Wake , Atsushi Kanehira , Kazuhiro Sasabuchi , Jun Takamatsu , Katsushi Ikeuchi

Human-like chatbots necessitate the use of commonsense reasoning in order to effectively comprehend and respond to implicit information present within conversations. Achieving such coherence and informativeness in responses, however, is a…

Computation and Language · Computer Science 2023-10-24 Hyungjoo Chae , Yongho Song , Kai Tzu-iunn Ong , Taeyoon Kwon , Minjin Kim , Youngjae Yu , Dongha Lee , Dongyeop Kang , Jinyoung Yeo

ChatGPT shows remarkable capabilities for machine translation (MT). Several prior studies have shown that it achieves comparable results to commercial systems for high-resource languages, but lags behind in complex tasks, e.g., low-resource…

Computation and Language · Computer Science 2023-10-23 Keqin Peng , Liang Ding , Qihuang Zhong , Li Shen , Xuebo Liu , Min Zhang , Yuanxin Ouyang , Dacheng Tao

The emergence of ChatGPT has recently garnered significant attention from the computational linguistics community. To demonstrate its capabilities as a keyphrase generator, we conduct a preliminary evaluation of ChatGPT for the keyphrase…

Computation and Language · Computer Science 2023-12-25 Mingyang Song , Haiyun Jiang , Shuming Shi , Songfang Yao , Shilong Lu , Yi Feng , Huafeng Liu , Liping Jing

This research paper presents the findings of two experimental studies that explore the use of ChatGPT as a tool for theory prototyping. The objective of the studies is to assess ChatGPT's ability to comprehend theoretical concepts and…

Human-Computer Interaction · Computer Science 2023-07-13 Tiong-Thye Goh

ChatGPT is built on a large language model trained on an enormous corpus of human text to emulate human conversation. Despite lacking any explicit programming regarding the laws of physics, recent work has demonstrated that GPT-3.5 could…

Physics Education · Physics 2023-04-18 Colin G. West

This article presents a comparative analysis of the ability of two large language model (LLM)-based chatbots, ChatGPT and Bing Chat, recently rebranded to Microsoft Copilot, to detect veracity of political information. We use AI auditing…

Computation and Language · Computer Science 2023-12-21 Elizaveta Kuznetsova , Mykola Makhortykh , Victoria Vziatysheva , Martha Stolze , Ani Baghumyan , Aleksandra Urman

Since its recent debut, ChatGPT has become a global sensation and significantly impacted the field of education. Both educational researchers and practitioners have identified opportunities as well as risks associated with the use of this…

Human-Computer Interaction · Computer Science 2025-08-26 Surat Teerakapibal , Poompak Kusawat

App reviews are a critical source of user feedback, offering valuable insights into an app's performance, features, usability, and overall user experience. Effectively analyzing these reviews is essential for guiding app development,…

Software Engineering · Computer Science 2025-05-09 Mohit Chaudhary , Chirag Jain , Preethu Rose Anish

ChatGPT has recently gathered attention from the general public and academia as a tool that is able to generate plausible and human-sounding text answers to various questions. One potential use, or abuse, of ChatGPT is in answering various…

Computers and Society · Computer Science 2023-04-17 Sanjay Deshpande , Jakub Szefer

This paper aims to investigate the mathematical problem-solving capabilities of Chat Generative Pre-Trained Transformer (ChatGPT) in case of Bayesian reasoning. The study draws inspiration from Zhu & Gigerenzer's research in 2006, which…

Artificial Intelligence · Computer Science 2023-08-29 Renato A. Krohling

Recently, ChatGPT has attracted great attention from the code analysis domain. Prior works show that ChatGPT has the capabilities of processing foundational code analysis tasks, such as abstract syntax tree generation, which indicates the…

Software Engineering · Computer Science 2024-06-21 Peiyu Liu , Junming Liu , Lirong Fu , Kangjie Lu , Yifan Xia , Xuhong Zhang , Wenzhi Chen , Haiqin Weng , Shouling Ji , Wenhai Wang

This paper describes a dialogue system developed for the Dialogue Robot Competition 2023 that achieves topic control for trip planning by inserting text into prompts using the ChatGPT-API. We built a system that is capable of generating…

Human-Computer Interaction · Computer Science 2023-12-21 Miyama Tamotsu , Okada Shogo

Humor is a central aspect of human communication that has not been solved for artificial agents so far. Large language models (LLMs) are increasingly able to capture implicit and contextual information. Especially, OpenAI's ChatGPT recently…

Artificial Intelligence · Computer Science 2023-06-08 Sophie Jentzsch , Kristian Kersting

The rapid advancement of artificial intelligence (AI) has highlighted ChatGPT as a pivotal technology in the field of information retrieval (IR). Distinguished from its predecessors, ChatGPT offers significant benefits that have attracted…

Information Retrieval · Computer Science 2024-04-18 Yizheng Huang , Jimmy Huang