English
Related papers

Related papers: Exploring ChatGPT's Ability to Rank Content: A Pre…

200 papers

Over the past decade, predictive language modeling for code has proven to be a valuable tool for enabling new forms of automation for developers. More recently, we have seen the advent of general purpose "large language models", based on…

Software Engineering · Computer Science 2023-06-05 Sajed Jalil , Suzzana Rafi , Thomas D. LaToza , Kevin Moran , Wing Lam

New chat AI applications like ChatGPT offer an advanced understanding of question context and memory across multi-step tasks, such that experiments can test its deductive reasoning. This paper proposes a multi-role and multi-step challenge,…

Artificial Intelligence · Computer Science 2023-01-05 David Noever , Forrest McKee

Artificial intelligence has been around for a while, but suddenly it has received more attention than ever before. Thanks to innovations from companies like Google, Microsoft, Meta, and other major brands in technology. OpenAI, though, has…

Computers and Society · Computer Science 2024-03-26 Md. Asraful Haque , Shuai Li

ChatGPT has shown the potential of emerging general artificial intelligence capabilities, as it has demonstrated competent performance across many natural language processing tasks. In this work, we evaluate the capabilities of ChatGPT to…

Computation and Language · Computer Science 2023-03-07 Mostafa M. Amin , Erik Cambria , Björn W. Schuller

This study explores how generative artificial intelligence, specifically ChatGPT, can assist in the evaluation of laboratory reports in Experimental Physics. Two interaction modalities were implemented: an automated API-based evaluation and…

Physics Education · Physics 2026-03-24 Marcos Abreu , Álvaro Suárez , Cecilia Stari , Arturo C. Marti

This study explores how generative artificial intelligence, specifically ChatGPT, can assist in the evaluation of laboratory reports in Experimental Physics. Two interaction modalities were implemented: an automated API-based evaluation and…

Physics Education · Physics 2025-10-21 Marcos Abreu , Álvaro Suárez , Cecilia Stari , Arturo C. Marti

Large language models such as ChatGPT are increasingly explored in medical domains. However, the absence of standard guidelines for performance evaluation has led to methodological inconsistencies. This study aims to summarize the available…

Methodology · Statistics 2024-03-12 Qiuhong Wei , Zhengxiong Yao , Ying Cui , Bo Wei , Zhezhen Jin , Ximing Xu

Email continues to be a pivotal and extensively utilized communication medium within professional and commercial domains. Nonetheless, the prevalence of spam emails poses a significant challenge for users, disrupting their daily routines…

Computation and Language · Computer Science 2025-02-13 Shijing Si , Yuwei Wu , Le Tang , Yugui Zhang , Jedrek Wosik , Qinliang Su

Recent research highlights the significant potential of ChatGPT for text annotation in social science research. However, ChatGPT is a closed-source product which has major drawbacks with regards to transparency, reproducibility, cost, and…

Computation and Language · Computer Science 2025-02-26 Ross Deans Kristensen-McLachlan , Miceal Canavan , Márton Kardos , Mia Jacobsen , Lene Aarøe

The way users acquire information is undergoing a paradigm shift with the advent of ChatGPT. Unlike conventional search engines, ChatGPT retrieves knowledge from the model itself and generates answers for users. ChatGPT's impressive…

Cryptography and Security · Computer Science 2023-10-06 Xinyue Shen , Zeyuan Chen , Michael Backes , Yang Zhang

Web accessibility ensures that individuals with disabilities can access and interact with digital content without barriers, yet a significant majority of most used websites fail to meet accessibility standards. This study evaluates…

Human-Computer Interaction · Computer Science 2025-07-21 Ammar Ahmed , Margarida Fresco , Fredrik Forsberg , Hallvard Grotli

This innovative practice WIP paper describes a research study that explores the integration of ChatGPT into the software testing curriculum and evaluates its effectiveness compared to human-generated testing artifacts. In a Capstone Project…

Software Engineering · Computer Science 2025-03-07 Susmita Haldar , Mary Pierce , Luiz Fernando Capretz

ChatGPT's emergence heralds a transformative phase in NLP, particularly demonstrated through its excellent performance on many English benchmarks. However, the model's efficacy across diverse linguistic contexts remains largely uncharted…

Computation and Language · Computer Science 2023-10-24 Md Tawkat Islam Khondaker , Abdul Waheed , El Moatez Billah Nagoudi , Muhammad Abdul-Mageed

ChatGPT is a large language model developed by OpenAI. Despite its impressive performance across various tasks, no prior work has investigated its capability in the biomedical domain yet. To this end, this paper aims to evaluate the…

Computation and Language · Computer Science 2023-08-25 Israt Jahan , Md Tahmid Rahman Laskar , Chun Peng , Jimmy Huang

Large language models (LLMs) such as ChatGPT have demonstrated superior performance on a variety of natural language processing (NLP) tasks including sentiment analysis, mathematical reasoning and summarization. Furthermore, since these…

Computation and Language · Computer Science 2023-10-18 Shiyuan Huang , Siddarth Mamidanna , Shreedhar Jangam , Yilun Zhou , Leilani H. Gilpin

Objective: Assess the feasibility of using ChatGPT or a similar AI-based chatbot for patient-provider communication. Participants: A US representative sample of 430 study participants aged 18 and above. 53.2% of respondents analyzed were…

Human-Computer Interaction · Computer Science 2023-01-25 Oded Nov , Nina Singh , Devin Mann

Large pre-trained language models have exhibited unprecedented capabilities in producing high-quality text via prompting techniques. This fact introduces new possibilities for data collection and annotation, particularly in situations where…

Computation and Language · Computer Science 2023-05-25 Tiziano Labruna , Sofia Brenna , Andrea Zaninello , Bernardo Magnini

This study evaluates the potential of ChatGPT-4, an artificial intelligence language model developed by OpenAI, as an editing tool for Spanish literary and academic books. The need for efficient and accessible reviewing and editing…

Artificial Intelligence · Computer Science 2023-09-21 Jonnathan Berrezueta-Guzman , Laura Malache-Silva , Stephan Krusche

The capability of Large Language Models (LLMs) like ChatGPT to comprehend user intent and provide reasonable responses has made them extremely popular lately. In this paper, we focus on assessing the overall ability of ChatGPT using 7…

Computation and Language · Computer Science 2023-04-25 Bo Li , Gexiang Fang , Yang Yang , Quansen Wang , Wei Ye , Wen Zhao , Shikun Zhang

Recently, generative AIs like ChatGPT have become available to the wide public. These tools can for instance be used by students to generate essays or whole theses. But how does a teacher know whether a text is written by a student or an…

Computation and Language · Computer Science 2023-11-14 Lorenz Mindner , Tim Schlippe , Kristina Schaaff