English
Related papers

Related papers: How Close is ChatGPT to Human Experts? Comparison …

200 papers

This article presents a comparative analysis of the ability of two large language model (LLM)-based chatbots, ChatGPT and Bing Chat, recently rebranded to Microsoft Copilot, to detect veracity of political information. We use AI auditing…

Computation and Language · Computer Science 2023-12-21 Elizaveta Kuznetsova , Mykola Makhortykh , Victoria Vziatysheva , Martha Stolze , Ani Baghumyan , Aleksandra Urman

The emergence of generative artificial intelligence (GAI) and large language models (LLMs) such ChatGPT has enabled the realization of long-harbored desires in software and robotic development. The technology however, has brought with it…

Background: Recently, ChatGPT and similar generative AI models have attracted hundreds of millions of users and become part of the public discourse. Many believe that such models will disrupt society and will result in a significant change…

Computation and Language · Computer Science 2023-04-28 Steffen Herbold , Annette Hautli-Janisz , Ute Heuer , Zlata Kikteva , Alexander Trautsch

We evaluate the effectiveness of Large Language Models (LLMs) in assessing essay quality, focusing on their alignment with human grading. More precisely, we evaluate ChatGPT and Llama in the Automated Essay Scoring (AES) task, a crucial…

Computation and Language · Computer Science 2024-09-23 Anindita Kundu , Denilson Barbosa

Recently, large language models (LLM) based generative AI has been gaining momentum for their impressive high-quality performances in multiple domains, particularly after the release of the ChatGPT. Many believe that they have the potential…

Software Engineering · Computer Science 2024-02-22 Wei Wang , Huilong Ning , Gaowei Zhang , Libo Liu , Yi Wang

Prompt engineering has shown potential for improving translation quality in LLMs. However, the possibility of using translation concepts in prompt design remains largely underexplored. Against this backdrop, the current paper discusses the…

Computation and Language · Computer Science 2026-04-06 Sui He

Generative AI models garnered a large amount of public attention and speculation with the release of OpenAIs chatbot, ChatGPT. At least two opinion camps exist: one excited about possibilities these models offer for fundamental changes to…

Artificial Intelligence · Computer Science 2024-06-28 Ann Speed

Cutting-edge Artificial Intelligence (AI) techniques keep reshaping our view of the world. For example, Large Language Models (LLMs) based applications such as ChatGPT have shown the capability of generating human-like conversation on…

This study aimed to determine if ChatGPT's large language models could match the scoring accuracy of human and machine scores from the ASAP competition. The investigation focused on various prediction models, including linear regression,…

Computation and Language · Computer Science 2024-08-20 Mark D. Shermis

Recently, the flourishing large language models(LLM), especially ChatGPT, have shown exceptional performance in language understanding, reasoning, and interaction, attracting users and researchers from multiple fields and domains. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Haonan Guo , Xin Su , Chen Wu , Bo Du , Liangpei Zhang , Deren Li

The increasing popularity of large language models (LLMs) such as ChatGPT has led to growing concerns about their safety, security risks, and ethical implications. This paper aims to provide an overview of the different types of security…

Cryptography and Security · Computer Science 2023-05-16 Erik Derner , Kristina Batistič

ChatGPT has achieved great success and can be considered to have acquired an infrastructural status. There are abundant works for evaluating ChatGPT on benchmarks. However, existing benchmarks encounter two challenges: (1) Disregard for…

Computation and Language · Computer Science 2024-06-19 Shangqing Tu , Chunyang Li , Jifan Yu , Xiaozhi Wang , Lei Hou , Juanzi Li

The widespread adoption of Large Language Models and publicly available ChatGPT has marked a significant turning point in the integration of Artificial Intelligence into people's everyday lives. The academic community has taken notice of…

Purpose: It has become increasingly likely that Large Language Models (LLMs) will be used to score the quality of academic publications to support research assessment goals in the future. This may cause problems for fields with competing…

Digital Libraries · Computer Science 2026-02-27 Mike Thelwall , Ralph Schroeder , Meena Dhanda

Recent advances in natural language processing (NLP) have led to the development of large language models (LLMs) such as ChatGPT. This paper proposes a methodology for developing and evaluating ChatGPT detectors for French text, with a…

Computation and Language · Computer Science 2023-06-12 Wissam Antoun , Virginie Mouilleron , Benoît Sagot , Djamé Seddah

The recent success of Large Language Models (LLMs) has sparked concerns about their potential to spread misinformation. As a result, there is a pressing need for tools to identify ``fake arguments'' generated by such models. To create these…

Large language models (LLMs), such as ChatGPT and Copilot, are transforming software development by automating code generation and, arguably, enable rapid prototyping, support education, and boost productivity. Therefore, correctness and…

Software Engineering · Computer Science 2024-08-30 Robin Beer , Alexander Feix , Tim Guttzeit , Tamara Muras , Vincent Müller , Maurice Rauscher , Florian Schäffler , Welf Löwe

Large language models (LLMs) are starting to complement traditional information seeking mechanisms such as web search. LLM-powered chatbots like ChatGPT are gaining prominence among the general public. AI chatbots are also increasingly…

Computation and Language · Computer Science 2025-11-25 Vibhor Agarwal , Yiqiao Jin , Mohit Chandra , Munmun De Choudhury , Srijan Kumar , Nishanth Sastry

Since the release of ChatGPT, numerous studies have highlighted the remarkable performance of ChatGPT, which often rivals or even surpasses human capabilities in various tasks and domains. However, this paper presents a contrasting…

Software Engineering · Computer Science 2023-05-12 Anis Koubaa , Basit Qureshi , Adel Ammar , Zahid Khan , Wadii Boulila , Lahouari Ghouti

Large Language Models (LLMs) like the GPT and LLaMA families have demonstrated exceptional capabilities in capturing and condensing critical contextual information and achieving state-of-the-art performance in the summarization task.…

Computation and Language · Computer Science 2023-11-06 Prakamya Mishra , Zonghai Yao , Shuwei Chen , Beining Wang , Rohan Mittal , Hong Yu