English
Related papers

Related papers: Creating Large Language Model Resistant Exams: Gui…

200 papers

Large Language Models (LLMs) such as ChatGPT demonstrated the potential to replicate human language abilities through technology, ranging from text generation to engaging in conversations. However, it remains controversial to what extent…

Computation and Language · Computer Science 2025-07-09 Martin Schuele

The remarkable capabilities of Large Language Models (LLMs) make them increasingly compelling for adoption in real-world healthcare applications. However, the risks associated with using LLMs in medical applications have not been…

ChatGPT, the first large language model (LLM) with mass adoption, has demonstrated remarkable performance in numerous natural language tasks. Despite its evident usefulness, evaluating ChatGPT's performance in diverse problem domains…

Computation and Language · Computer Science 2024-08-23 Rachith Aiyappa , Jisun An , Haewoon Kwak , Yong-Yeol Ahn

The recent release of very large language models such as PaLM and GPT-4 has made an unprecedented impact in the popular media and public consciousness, giving rise to a mixture of excitement and fear as to their capabilities and potential…

Recent years have witnessed remarkable progress made in large language models (LLMs). Such advancements, while garnering significant attention, have concurrently elicited various concerns. The potential of these models is undeniably vast;…

Computation and Language · Computer Science 2023-09-27 Tianhao Shen , Renren Jin , Yufei Huang , Chuang Liu , Weilong Dong , Zishan Guo , Xinwei Wu , Yan Liu , Deyi Xiong

Automatic evaluation is an integral aspect of dialogue system research. The traditional reference-based NLG metrics are generally found to be unsuitable for dialogue assessment. Consequently, recent studies have suggested various unique,…

Computation and Language · Computer Science 2024-01-23 Chen Zhang , Luis Fernando D'Haro , Yiming Chen , Malu Zhang , Haizhou Li

The burgeoning capabilities of advanced large language models (LLMs) such as ChatGPT have led to an increase in synthetic content generation with implications across a variety of sectors, including media, cybersecurity, public discourse,…

Computation and Language · Computer Science 2023-10-25 Xianjun Yang , Liangming Pan , Xuandong Zhao , Haifeng Chen , Linda Petzold , William Yang Wang , Wei Cheng

Large Language Models (LLMs) like GPT and Bard are capable of producing code based on textual descriptions, with remarkable efficacy. Such technology will have profound implications for computing education, raising concerns about cheating,…

Emerging Technologies · Computer Science 2024-04-29 Bruno Pereira Cipriano , Pedro Alves

Large Language Models (LLMs) are frequently discussed in academia and the general public as support tools for virtually any use case that relies on the production of text, including software engineering. Currently there is much debate, but…

Software Engineering · Computer Science 2024-05-22 Ranim Khojah , Mazen Mohamad , Philipp Leitner , Francisco Gomes de Oliveira Neto

Large Language Models (LLMs) have proven immensely beneficial in education by capturing vast amounts of literature-based information, allowing them to generate context without relying on external sources. In this paper, we propose a…

Information Retrieval · Computer Science 2025-07-03 Umar Ali Khan , Ekram Khan , Fiza Khan , Athar Ali Moinuddin

Rapid integration of large language models (LLMs) in health care is sparking global discussion about their potential to revolutionize health care quality and accessibility. At a time when improving health care quality and access remains a…

Computers and Society · Computer Science 2025-04-01 Troy Zada , Natalie Tam , Francois Barnard , Marlize Van Sittert , Venkat Bhat , Sirisha Rambhatla

Researchers have made notable progress in applying Large Language Models (LLMs) to solve math problems, as demonstrated through efforts like GSM8k, ProofNet, AlphaGeometry, and MathOdyssey. This progress has sparked interest in their…

Human-Computer Interaction · Computer Science 2025-03-24 Adit Gupta , Jennifer Reddig , Tommaso Calo , Daniel Weitekamp , Christopher J. MacLellan

In the short period since the release of ChatGPT, large language models (LLMs) have changed the software engineering research landscape. While there are numerous opportunities to use LLMs for supporting research or software engineering…

Software Engineering · Computer Science 2025-02-05 Stefan Wagner , Marvin Muñoz Barón , Davide Falessi , Sebastian Baltes

The evolution of Generative AI and the capabilities of the newly released Large Language Models (LLMs) open new opportunities in software engineering. However, they also lead to new challenges in cybersecurity. Recently, researchers have…

Cryptography and Security · Computer Science 2023-09-08 Mika Beckerich , Laura Plein , Sergio Coronado

Large Language Models (LLMs), such as ChatGPT, exhibit advanced capabilities in generating text, images, and videos. However, their effective use remains constrained by challenges in prompt formulation, personalization, and opaque…

Human-Computer Interaction · Computer Science 2025-03-04 Si Thu , A. Baki Kocaballi

Evaluating the quality of academic journal articles is a time consuming but critical task for national research evaluation exercises, appointments and promotion. It is therefore important to investigate whether Large Language Models (LLMs)…

Digital Libraries · Computer Science 2024-12-02 Mike Thelwall

This paper presents a comprehensive survey of ChatGPT-related (GPT-3.5 and GPT-4) research, state-of-the-art large language models (LLM) from the GPT series, and their prospective applications across diverse domains. Indeed, key innovations…

Large Language Models (LLMs) have demonstrated a powerful ability for text generation. However, achieving optimal results with a given prompt or instruction can be challenging, especially for billion-sized models. Additionally, undesired…

Computation and Language · Computer Science 2024-10-07 Lifu Tu , Semih Yavuz , Jin Qu , Jiacheng Xu , Rui Meng , Caiming Xiong , Yingbo Zhou

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs…

Computation and Language · Computer Science 2023-10-10 Thilo Hagendorff , Sarah Fabi , Michal Kosinski

Evaluating open-ended written examination responses from students is an essential yet time-intensive task for educators, requiring a high degree of effort, consistency, and precision. Recent developments in Large Language Models (LLMs)…

Computation and Language · Computer Science 2024-05-10 Jussi S. Jauhiainen , Agustín Garagorry Guerra