English
Related papers

Related papers: Do Large Language Models Reduce Research Novelty? …

200 papers

Large language models (LLMs) have emerged as versatile tools in various daily applications. However, they are fraught with issues that undermine their utility and trustworthiness. These include the incorporation of erroneous references…

Computation and Language · Computer Science 2023-09-13 Dongyub Lee , Taesun Whang , Chanhee Lee , Heuiseok Lim

The adoption of Large Language Models (LLMs) for code generation in data science offers substantial potential for enhancing tasks such as data manipulation, statistical analysis, and visualization. However, the effectiveness of these models…

Software Engineering · Computer Science 2024-11-20 Nathalia Nascimento , Everton Guimaraes , Sai Sanjna Chintakunta , Santhosh Anitha Boominathan

While nationality is a pivotal demographic element that enhances the performance of language models, it has received far less scrutiny regarding inherent biases. This study investigates nationality bias in ChatGPT (GPT-3.5), a large…

Computation and Language · Computer Science 2024-05-14 Shucheng Zhu , Weikang Wang , Ying Liu

The large language based-model chatbot ChatGPT gained a lot of popularity since its launch and has been used in a wide range of situations. This research centers around a particular situation, when the ChatGPT is used to produce news that…

Computation and Language · Computer Science 2023-10-26 Amanda Ferrari Iaquinta , Gustavo Voltani von Atzingen

Since its launch in late 2022, ChatGPT has ignited widespread interest in Large Language Models (LLMs) and broader Artificial Intelligence (AI) solutions. As this new wave of AI permeates various sectors of society, we are continually…

Computers and Society · Computer Science 2025-09-18 Juho Vepsäläinen , Petri Juntunen

As large language models (LLMs) advance and become widespread, students increasingly turn to systems like ChatGPT for assistance with writing tasks. Educators are concerned with students' usage of ChatGPT beyond cheating; using ChatGPT may…

Human-Computer Interaction · Computer Science 2026-04-23 Andrew Jelson , Daniel Manesh , Alice Jang , Daniel Dunlap , Young-Ho Kim , Sang Won Lee

The large language model (LLM) ChatGPT's quality scores for journal articles correlate more strongly with human judgements than some citation-based indicators in most fields. Averaging multiple ChatGPT scores improves the results,…

Digital Libraries · Computer Science 2025-06-17 Mike Thelwall , Yunhan Yang

Large Language Models (LLMs) are reshaping consumer decision-making, particularly in communication with firms, yet our understanding of their impact remains limited. This research explores the effect of LLMs on consumer complaints submitted…

Human-Computer Interaction · Computer Science 2025-02-17 Minkyu Shin , Jin Kim , Jiwoong Shin

The rapid adoption of Generative AI (GenAI) based on Large Language Models (LLMs) such as ChatGPT has recently and profoundly impacted education, offering transformative opportunities while raising significant concerns. In this study we…

Computers and Society · Computer Science 2024-12-24 Jérémie Sublime , Ilaria Renna

Generative large language models (LLMs) have become central to everyday life, producing human-like text across diverse domains. A growing body of research investigates whether these models also exhibit personality- and demographic-like…

Computation and Language · Computer Science 2025-10-14 Dana Sotto Porat , Ella Rabinovich

As researchers increasingly adopt LLMs as writing assistants, generating high-quality research paper introductions remains both challenging and essential. We introduce Scientific Introduction Generation (SciIG), a task that evaluates LLMs'…

Computation and Language · Computer Science 2025-08-26 Krishna Garg , Firoz Shaik , Sambaran Bandyopadhyay , Cornelia Caragea

Language models have demonstrated remarkable capabilities on standard benchmarks, yet they struggle increasingly from mode collapse, the inability to generate diverse and novel outputs. Our work introduces NoveltyBench, a benchmark…

Computation and Language · Computer Science 2025-08-12 Yiming Zhang , Harshita Diddee , Susan Holm , Hanchen Liu , Xinyue Liu , Vinay Samuel , Barry Wang , Daphne Ippolito

The progress of Large Language Models (LLMs) like ChatGPT raises the question of how they can be integrated into education. One hope is that they can support mathematics learning, including word-problem solving. Since LLMs can handle…

Computation and Language · Computer Science 2025-08-12 Anselm R. Strohmaier , Wim Van Dooren , Kathrin Seßler , Brian Greer , Lieven Verschaffel

Introduction: Large language models (LLMs) can process requests and generate texts, but their feasibility for assessing complex academic content needs further investigation. To explore LLM's potential in assisting scientific review, this…

Computation and Language · Computer Science 2026-01-29 Yinuo Liu , Emre Sezgin , Eric A. Youngstrom

Chatbots have shown promise as tools to scale qualitative data collection. Recent advances in Large Language Models (LLMs) could accelerate this process by allowing researchers to easily deploy sophisticated interviewing chatbots. We test…

Human-Computer Interaction · Computer Science 2024-12-05 Alejandro Cuevas , Jennifer V. Scurrell , Eva M. Brown , Jason Entenmann , Madeleine I. G. Daepp

UK academic departments are evaluated partly on the statements that they write about the value of their research environments for the Research Excellence Framework (REF) periodic assessments. These statements mix qualitative narratives and…

Digital Libraries · Computer Science 2025-12-08 Kayvan Kousha , Mike Thelwall , Elizabeth Gadd

Background: Large Language Models (LLMs) such as ChatGPT and CoPilot are influencing software engineering practice. Software engineering educators must teach future software engineers how to use such tools well. As of yet, there have been…

Software Engineering · Computer Science 2024-04-18 Ben Arie Tanay , Lexy Arinze , Siddhant S. Joshi , Kirsten A. Davis , James C. Davis

Large language models (LLMs) are now accessible to anyone with a computer, a web browser, and an internet connection via browser-based interfaces, shifting the dynamics of participation in AI development. This article examines how…

Human-Computer Interaction · Computer Science 2025-10-31 Ned Cooper , Alexandra Zafiroglu

To enhance the quality of generated stories, recent story generation models have been investigating the utilization of higher-level attributes like plots or commonsense knowledge. The application of prompt-based learning with large language…

Computation and Language · Computer Science 2023-07-25 Zhuohan Xie , Trevor Cohn , Jey Han Lau

The rise in popularity of Large Language Models (LLMs) has prompted discussions in academic circles, with students exploring LLM-based tools for coursework inquiries and instructors exploring them for teaching and research. Even though a…